-- Logs begin at Mon 2022-06-27 13:59:42 UTC, end at Mon 2022-06-27 15:22:21 UTC. -- Jun 27 14:36:14.515651 dv-cinder-797608-35-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 27 14:36:14.523568 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 14:36:14 2022] *** Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: nodename: dv-cinder-797608-35-iscsi Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: machine: x86_64 Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: clock source: unix Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: pcre jit disabled Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: detected number of CPU cores: 4 Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: current working directory: / Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: detected binary path: /usr/bin/uwsgi-core Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: your processes number limit is 47680 Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: your memory page size is 4096 bytes Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: detected max file descriptor number: 2048 Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: lock engine: pthread robust mutexes Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: thunder lock: enabled Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 27 14:36:14.528698 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 14:36:14.571687 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: Python main interpreter initialized at 0x55e90e5fe9c0 Jun 27 14:36:14.571687 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: python threads support enabled Jun 27 14:36:14.571687 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: your server socket listen backlog is limited to 100 connections Jun 27 14:36:14.571687 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: your mercy for graceful operations on workers is 90 seconds Jun 27 14:36:14.572084 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 14:36:14.572084 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: *** Operational MODE: preforking *** Jun 27 14:36:14.572388 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: *** uWSGI is running in multiple interpreter mode *** Jun 27 14:36:14.572388 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: spawned uWSGI master process (pid: 91914) Jun 27 14:36:14.572599 dv-cinder-797608-35-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 27 14:36:14.574462 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: spawned uWSGI worker 1 (pid: 91926, cores: 1) Jun 27 14:36:14.574462 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: spawned uWSGI worker 2 (pid: 91927, cores: 1) Jun 27 14:36:14.574462 dv-cinder-797608-35-iscsi devstack@keystone.service[91914]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 14:36:20.068178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 14:36:20.068178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: from cryptography.utils import int_from_bytes Jun 27 14:36:20.069028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 14:36:20.069028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: from cryptography.utils import int_from_bytes Jun 27 14:36:20.069432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 14:36:20.069432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: from cryptography.utils import int_from_bytes Jun 27 14:36:20.069888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 14:36:20.069888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: from cryptography.utils import int_from_bytes Jun 27 14:36:20.117446 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 14:36:20.117639 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 14:36:20.117829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] command line args: [] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 14:36:20.118095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 14:36:20.118275 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ================================================================================ {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 14:36:20.118527 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] admin_token = **** {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.118614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 14:36:20.118769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] config_dir = [] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.118857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 14:36:20.118943 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.119022 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] command line args: [] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 14:36:20.119120 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] config_source = [] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.119205 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 14:36:20.119284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] debug = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.119382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ================================================================================ {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 14:36:20.119473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.119720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] admin_token = **** {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.119873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.119965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] config_dir = [] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.120032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.120100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.120217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] config_source = [] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.120290 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.120387 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] debug = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.120469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.120578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.120754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] list_limit = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.120840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.120908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] log_config_append = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.121017 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.121097 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.121210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] log_dir = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.121284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.121386 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] log_file = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.121466 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.121602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.121690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] list_limit = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.121847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.121938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] log_config_append = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.122006 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.122072 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.122191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] log_dir = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.122310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.122398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] log_file = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.122472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.122571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.122650 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.122817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.122948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.123062 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.123148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.123305 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.123428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.123511 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.123594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.123666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.123737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.123860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.123961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.124691 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.124893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.125039 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.125185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.125329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.125442 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.125538 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.125613 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.125789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.125922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.126031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.126118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] publish_errors = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.126302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.126389 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.126533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.126708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.126853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.126936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.127014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] publish_errors = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.127173 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.127260 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.127403 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] standard_threads = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.127499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.127578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.127656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.127812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.127892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.128015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.128099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.128177 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] use_journal = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.128250 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] standard_threads = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.128355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] use_json = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.128483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.128563 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] use_stderr = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.128709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] use_syslog = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.128807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.128915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.129003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.129082 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] use_journal = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.129180 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.129266 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] use_json = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.129413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] use_stderr = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.129497 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.129650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] use_syslog = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.129725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.129801 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 14:36:20.129875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.130049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.130133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.130286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.130365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.130544 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.130623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.130784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.130868 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.131033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.131112 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.131271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.131349 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.131517 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.131603 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.131753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.131832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.132000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.132079 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.132229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.132314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.132473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.132550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.132727 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.132808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.132960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.133054 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.133195 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.133272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.133441 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.133519 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.133680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.133768 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.133913 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.133991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.134159 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.134235 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.134408 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.134496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.134652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.134730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.134886 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.134970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.135112 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.135268 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.135348 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.135426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.135552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.135630 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.135782 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.135874 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.136025 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.136104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.136268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.136345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.136493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.136580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.136746 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.136825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.136988 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.137061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.137874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.137974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.137974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.138083 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.138147 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.138210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.138280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.138367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.138367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.138498 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.138562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.138632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.138703 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.138776 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.138847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.138917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.138982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.139082 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.139191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.139273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.139422 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.139509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.139709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.140441 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.140587 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.140799 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.140959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.141051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.141119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.141195 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.141272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.141361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.141430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.141510 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.141679 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.141761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.141906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.141986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.142140 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.142221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.142370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.142451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.142601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.142681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.142832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.142913 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.143063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.143143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.143289 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.143378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.143521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.143605 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.143751 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.143829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.143981 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.144072 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.144204 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.144283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.144451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.144531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.144700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.144795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.144931 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.145013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.145159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.145245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.145388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.145467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.145638 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.145718 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.145868 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.145947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.146103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.146182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.146338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.146418 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.146570 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.146648 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.146803 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.146889 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.147040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.147122 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.147268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.147356 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.147502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.147582 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.147736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.147817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.147969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.148047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.148202 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.148280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.148439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.148532 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.148689 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.148771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.148925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.149013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.149156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.149246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.149389 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.149467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.149626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.149706 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.149861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.149949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.150092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.150176 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.150331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.150411 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.150565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.150653 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.150797 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.150876 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.151028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.151107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.151253 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.151341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.151480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.151559 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.151706 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.151785 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.151935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.152024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.152161 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.152242 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.152390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.152474 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.152618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.152728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.152884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.152965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.153114 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.153198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.153355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.153443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.153591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.153677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.153831 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.153910 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.154059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] auth.external = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.154147 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.154286 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.154367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.154554 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.154633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.154792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.154878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.155019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] auth.password = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.155129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] auth.external = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.155248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.155383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] auth.token = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.155606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.155744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.155883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.156039 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.156165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] auth.password = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.156247 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.156357 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] auth.token = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.156466 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.156596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.156748 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.156858 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.156970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.157107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.157187 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.157336 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.157433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] credential.caching = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.157584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.157671 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.157832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.157912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.158063 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.158145 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.158298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] credential.caching = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.158377 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.158543 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.158622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.158774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.158854 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.159028 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.159108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.159263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.159351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.159497 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.159578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.159729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.159808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.159997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.160076 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.160239 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.160319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.160474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.160553 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.160747 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.160832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.160986 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.161065 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.161222 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] federation.caching = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.161313 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.161453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.161534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.161696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.161778 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.161936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.162017 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.162164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.162245 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] federation.caching = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.162407 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.162490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.162639 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.162719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.162888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.162967 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.163117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.163197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.163366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.163448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.163595 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.163676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.163837 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.163918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.164067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity.caching = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.164147 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.164309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.164390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.164545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.164625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.164803 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.164883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.165035 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.165115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity.caching = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.165277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.165359 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.165501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.165581 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.165733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.165813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.165968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.166049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.166212 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.166298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.166440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.166519 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.166664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.166744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.166889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.166976 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.167131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.167211 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.167373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.167453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.167604 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.167685 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.167833 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.167922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.168077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.168158 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.168322 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.168402 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.168568 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.168677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.168823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.168904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.169051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.169209 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.169289 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.169370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.169497 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.169578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.169728 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.169809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.169965 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.170054 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.170199 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.170289 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.170443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.170524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.170669 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.170758 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.170936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.171116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.171262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.171412 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.171542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.171694 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.171791 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.171934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.172014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.172159 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.172237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.172391 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.172473 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.172617 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.172753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.172874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.172954 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.173107 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.173235 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.173350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.173430 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.173586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.173730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.173819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.173894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.174044 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.174125 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.174281 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.174362 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.174508 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.174588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.174736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.174816 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.174971 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.175049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.175212 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.175293 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.175446 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.175526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.175675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.175753 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.175906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.175986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.176132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.176212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.176369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.176448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.176608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.176710 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.176862 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.176942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.177104 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.177184 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.177333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.177415 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.177573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.177659 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.177803 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.177883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.178028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.178109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.178258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.178338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.178492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.178573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.178722 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.178804 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.178947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.179028 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.179186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.179266 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.179422 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.179504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.179656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.179737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.179894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.179981 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.180122 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.180203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.180347 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.180426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.180586 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.180699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.180843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.180931 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.181073 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.181155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.181303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.181392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.181531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.181611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.181768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.181849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.182001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.182089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.182230 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.182310 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.182464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.182543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.182690 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.182783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.182929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.183010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.183159 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.183240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.183389 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.183544 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.183622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.183695 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.183848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.183928 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.184083 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.184173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.184311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.184392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.184541 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.184620 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.184797 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] resource.caching = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.184894 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.185042 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.185122 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.185283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.185371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.185515 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.185604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.185750 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.185831 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.185988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] resource.caching = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.186068 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.186218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.186307 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.186459 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.187033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.187207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.187356 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.187493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.187624 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.187710 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.187834 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] role.caching = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.187915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.188078 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] role.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.188159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.188305 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.188388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.188554 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.188634 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.188821 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.188905 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] role.caching = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.189066 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.189150 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] role.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.189304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.189383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.189546 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.189633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.189790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.189872 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.190031 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.190112 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.190273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.190354 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.190502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.190585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.190746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.190826 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.190988 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.191070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.191230 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.191312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.191461 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.191540 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.191710 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.191848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.191958 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.192082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.192204 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.192328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.192451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.192573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.192841 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.192923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.193086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.193166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.193315 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.193409 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.193563 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.193645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.193808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.193887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.194046 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.194134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.194274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.194355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.194501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.194583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.194729 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.194820 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.194976 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.195058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.195205 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.195284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.195435 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.195525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.195667 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.195747 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.195894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.195974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.196120 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.196209 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.196350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] token.caching = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.196430 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.196581 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.196680 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.196858 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.196953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.197091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.197172 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.197324 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] token.caching = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.197403 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.197560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.197649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.197795 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.197875 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.198029 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.198107 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.198265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.198354 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.198507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.198588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.198742 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.198821 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.198976 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.199057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.199214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.199296 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.199458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.199538 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.199691 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.199772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.199915 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.199995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.200149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.200228 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.200394 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.200476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.200704 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.200791 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.connection = **** {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.200878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.201239 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.201391 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.201472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.201651 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.201732 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.201891 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.201972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.connection = **** {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.202123 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.202861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.203032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.203192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.203333 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.203441 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.203518 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.203592 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.203719 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.203874 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.203952 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.204026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.204178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.204260 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.204411 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.204502 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.204673 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.204759 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.204910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.204991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.205156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.205251 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.205383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.205465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.205619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.205700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.205851 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.205941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.206016 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91927) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 14:36:20.206113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.206343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.206585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.206819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 14:36:20.206989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91926) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 14:36:20.235796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.236014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.236238 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.236737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.236974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.237203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.244619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.245620 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.272988 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.273209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.273923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.274152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.415346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.415788 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.464008 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.464234 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.464934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.465177 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.527706 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.527883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.527996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.528105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.528188 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.528327 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.528409 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.528539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.528622 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.528780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.528860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.528984 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.554182 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.554413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.554500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.554640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.554722 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.554864 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.554956 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.555084 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.555167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.555298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.555378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.555511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.555594 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.555721 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.567091 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.567307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.579930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.580130 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.580259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.580344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.580421 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.580546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.580679 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.580790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.580875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.581005 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.581087 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.581216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91926) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.581300 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.581421 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91927) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 14:36:20.598649 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.598838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.598940 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 14:36:20.599047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 14:36:20.599180 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.599380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 14:36:20.599462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.599577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 14:36:20.599668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.599842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.599925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.600096 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.600177 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.600346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.600428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.600595 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.611807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.611904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.612081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.612183 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.612344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.612428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.612620 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.612742 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.620883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.620970 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.624721 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.624893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.624981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.625176 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.625260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.625455 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.625537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.625737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.625819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.626016 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.626100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.626273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.626352 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.626536 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.626623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.626798 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.626879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.627062 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.627141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.627322 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.627402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.627582 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.654430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.654872 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.656169 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.656446 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.656739 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.657022 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.661725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.662115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.662389 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.662473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.662782 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.663076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.669722 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.669954 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.670499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.670777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.675045 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.675327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.675606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.675886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.676046 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.676155 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.676340 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.676420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.676631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.676731 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.676944 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.677024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.677225 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.677506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.677782 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.678050 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.696244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.696517 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.697493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.697773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.701539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.702923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.705304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.705709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.706596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.707007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.710723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.712058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.714319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.715737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.718012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.718306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.718585 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.718863 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.719137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.719418 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.719769 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.720068 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.720353 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.720663 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.720938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.721216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.738980 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.739259 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.739521 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.739790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.741038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.741320 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.741598 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.741872 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.747637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.749879 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.750165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.750365 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.752061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.752346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.753380 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.753684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.753959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.754234 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.754522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.755578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.755856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.756137 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.756420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.756723 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.767852 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.768115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.768403 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.768708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.770111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.770250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.770377 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.770505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.770633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.770768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.770895 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.772457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.772778 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.773076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.788855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.791015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.792133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.794345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.795424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.797840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.798459 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.799462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.799736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.800014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.800189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.801869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.802152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.802440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.807285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.808912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.809771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.811371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.812857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.813152 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.813537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.813812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.815311 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.815602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.815994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.816274 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.822878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.823162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.823451 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.825463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.825747 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.826289 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.831761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91927) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.832038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.832318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.832592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.832980 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.833347 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.833635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.833916 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.834193 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.834420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91926) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 14:36:20.834557 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.834685 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.834811 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.834965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.835091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.835226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.835351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.835479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91927) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.835605 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.835879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.836157 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.836427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.836742 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.837016 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.837286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.837557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.837825 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.838092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91926) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 14:36:20.874189 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e90e5fe9c0 pid: 91927 (default app) Jun 27 14:36:20.877568 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f222e-adf7-4840-8088-b3f7d52b5d9d None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:20.877867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f222e-adf7-4840-8088-b3f7d52b5d9d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:20.878143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f222e-adf7-4840-8088-b3f7d52b5d9d None None] PATH_INFO: `/v3` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:20.878544 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e90e5fe9c0 pid: 91926 (default app) Jun 27 14:36:20.882335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Mon Jun 27 14:36:20 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:29.285938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b5d4-c77e-4cd4-893b-5936d324c9f4 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:29.286520 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b5d4-c77e-4cd4-893b-5936d324c9f4 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:29.286520 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b5d4-c77e-4cd4-893b-5936d324c9f4 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:29.290786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:29.296135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c9789-87a6-499f-ad5b-7d1120980fcb None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:29.296526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c9789-87a6-499f-ad5b-7d1120980fcb None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:29.296708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c9789-87a6-499f-ad5b-7d1120980fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:29.365071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: INFO dbcounter [None req-b23c9789-87a6-499f-ad5b-7d1120980fcb None None] Registered counter for database keystone Jun 27 14:36:29.385800 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG oslo_db.sqlalchemy.engines [None req-b23c9789-87a6-499f-ad5b-7d1120980fcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91927) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:36:29.392713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writer thread running {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:36:29.568751 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG passlib.handlers.bcrypt [None req-b23c9789-87a6-499f-ad5b-7d1120980fcb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91927) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 27 14:36:29.569162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG passlib.handlers.bcrypt [None req-b23c9789-87a6-499f-ad5b-7d1120980fcb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91927) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 27 14:36:29.623104 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b23c9789-87a6-499f-ad5b-7d1120980fcb None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:29.625207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b23c9789-87a6-499f-ad5b-7d1120980fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:29.745450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 27 14:36:29.907256 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83b5d4-c77e-4cd4-893b-5936d324c9f4 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:29.978109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: INFO dbcounter [None req-5b83b5d4-c77e-4cd4-893b-5936d324c9f4 None None] Registered counter for database keystone Jun 27 14:36:29.997810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG oslo_db.sqlalchemy.engines [None req-5b83b5d4-c77e-4cd4-893b-5936d324c9f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91926) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 14:36:30.004801 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writer thread running {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 14:36:30.128367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83b5d4-c77e-4cd4-893b-5936d324c9f4 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:30.132873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bed0e-9e41-4246-a2ad-1f3881ea47bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:30.136497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bed0e-9e41-4246-a2ad-1f3881ea47bd admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:30.136497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bed0e-9e41-4246-a2ad-1f3881ea47bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:30.136497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bed0e-9e41-4246-a2ad-1f3881ea47bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:30.142399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bed0e-9e41-4246-a2ad-1f3881ea47bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:30.195692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: WARNING keystone.common.rbac_enforcer.enforcer [None req-033bed0e-9e41-4246-a2ad-1f3881ea47bd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 27 14:36:30.195981 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bed0e-9e41-4246-a2ad-1f3881ea47bd admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:30.206440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1324 bytes} [Mon Jun 27 14:36:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 14:36:30.212321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c9789-87a6-499f-ad5b-7d1120980fcb None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:30.227655 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c9789-87a6-499f-ad5b-7d1120980fcb None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:30.233294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc869151-2984-4e55-a60d-a47e8f42e800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:30.233294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc869151-2984-4e55-a60d-a47e8f42e800 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:30.233496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc869151-2984-4e55-a60d-a47e8f42e800 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:30.233775 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc869151-2984-4e55-a60d-a47e8f42e800 admin admin] PATH_INFO: `/v3/projects/782bd5d4029d44cc9364a47cef782a05` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:30.238722 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc869151-2984-4e55-a60d-a47e8f42e800 admin admin] RBAC: Authorizing `identity:get_project(project_id=782bd5d4029d44cc9364a47cef782a05)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:30.290124 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fc869151-2984-4e55-a60d-a47e8f42e800 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 27 14:36:30.290502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc869151-2984-4e55-a60d-a47e8f42e800 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:30.295062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 3/5] 10.222.0.44 () {56 vars in 1207 bytes} [Mon Jun 27 14:36:30 2022] GET /identity/v3/projects/782bd5d4029d44cc9364a47cef782a05 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:32.283417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934157a-a5cf-47c8-bd86-dc3463b06a9e None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:32.283966 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934157a-a5cf-47c8-bd86-dc3463b06a9e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:32.283966 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934157a-a5cf-47c8-bd86-dc3463b06a9e None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:32.288079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 3/6] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:32.293627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f892caf-d270-4f09-ab4d-a846a7215e2f None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:32.294018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f892caf-d270-4f09-ab4d-a846a7215e2f None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:32.294187 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f892caf-d270-4f09-ab4d-a846a7215e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:32.312599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-7f892caf-d270-4f09-ab4d-a846a7215e2f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:32.314227 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7f892caf-d270-4f09-ab4d-a846a7215e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:32.321907 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 27 14:36:32.345223 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934157a-a5cf-47c8-bd86-dc3463b06a9e None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:32.357387 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934157a-a5cf-47c8-bd86-dc3463b06a9e None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:32.361626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302994b-624f-4606-a13c-006b17f2ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:32.362254 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302994b-624f-4606-a13c-006b17f2ce17 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:32.362543 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302994b-624f-4606-a13c-006b17f2ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:32.362824 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302994b-624f-4606-a13c-006b17f2ce17 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:32.370647 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302994b-624f-4606-a13c-006b17f2ce17 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:32.372413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302994b-624f-4606-a13c-006b17f2ce17 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:32.381273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1324 bytes} [Mon Jun 27 14:36:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 14:36:32.386535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f892caf-d270-4f09-ab4d-a846a7215e2f None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:32.396208 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f892caf-d270-4f09-ab4d-a846a7215e2f None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:32.400582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e95299-c241-4bb4-8e4d-1211c1d00675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:32.401462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e95299-c241-4bb4-8e4d-1211c1d00675 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:32.401746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e95299-c241-4bb4-8e4d-1211c1d00675 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:32.402023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e95299-c241-4bb4-8e4d-1211c1d00675 admin admin] PATH_INFO: `/v3/users/34ee4c4ab8ea4807905f919862ea9620` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:32.403399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e95299-c241-4bb4-8e4d-1211c1d00675 admin admin] RBAC: Authorizing `identity:get_user(user_id=34ee4c4ab8ea4807905f919862ea9620)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:32.405234 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e95299-c241-4bb4-8e4d-1211c1d00675 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:32.407445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 5/9] 10.222.0.44 () {56 vars in 1198 bytes} [Mon Jun 27 14:36:32 2022] GET /identity/v3/users/34ee4c4ab8ea4807905f919862ea9620 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:34.508751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b725d2e-a01f-4a65-a19a-b39e4c367c78 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:34.509272 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b725d2e-a01f-4a65-a19a-b39e4c367c78 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:34.509378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b725d2e-a01f-4a65-a19a-b39e4c367c78 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:34.510651 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:34.516397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96ec9d-f98c-4165-9d4b-84b30f9c4b73 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:34.516815 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96ec9d-f98c-4165-9d4b-84b30f9c4b73 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:34.517104 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96ec9d-f98c-4165-9d4b-84b30f9c4b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:34.534043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-6c96ec9d-f98c-4165-9d4b-84b30f9c4b73 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:34.535205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6c96ec9d-f98c-4165-9d4b-84b30f9c4b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:34.541602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b7870-143f-40bd-bd0b-b3680136ab88 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:34.541900 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b7870-143f-40bd-bd0b-b3680136ab88 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:34.542183 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b7870-143f-40bd-bd0b-b3680136ab88 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:34.543525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 6/11] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:36:34.549203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868babac-32bc-40b6-9a78-0f9a2e1a0cdf None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:34.549493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868babac-32bc-40b6-9a78-0f9a2e1a0cdf None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:34.549774 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868babac-32bc-40b6-9a78-0f9a2e1a0cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:34.588974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG passlib.handlers.bcrypt [None req-868babac-32bc-40b6-9a78-0f9a2e1a0cdf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91926) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 27 14:36:34.589396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG passlib.handlers.bcrypt [None req-868babac-32bc-40b6-9a78-0f9a2e1a0cdf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91926) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 27 14:36:34.616502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:34.639406 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-868babac-32bc-40b6-9a78-0f9a2e1a0cdf None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:34.640097 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96ec9d-f98c-4165-9d4b-84b30f9c4b73 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:34.641113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-868babac-32bc-40b6-9a78-0f9a2e1a0cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:34.663501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:34.744771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96ec9d-f98c-4165-9d4b-84b30f9c4b73 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:34.749461 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:36:34.771911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868babac-32bc-40b6-9a78-0f9a2e1a0cdf None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:34.778553 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218ed1b-f3d7-456a-9d6c-f394edb92566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:34.779343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218ed1b-f3d7-456a-9d6c-f394edb92566 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:34.779629 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218ed1b-f3d7-456a-9d6c-f394edb92566 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:34.779904 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218ed1b-f3d7-456a-9d6c-f394edb92566 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:34.791425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218ed1b-f3d7-456a-9d6c-f394edb92566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-5218ed1b-f3d7-456a-9d6c-f394edb92566 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:36:34.803082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:34.804127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:34.805015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:34.805015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:34.805015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:34.805015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:34.805015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:36:34.805015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:36:34.805015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:36:34.805015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:36:34.805015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:36:34.805015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:36:34.805015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:36:34.805015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:36:34.805015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 7/14] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:36:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:36:34.811418 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218ed1b-f3d7-456a-9d6c-f394edb92566 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:34.871794 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868babac-32bc-40b6-9a78-0f9a2e1a0cdf None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:34.874108 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:34.891664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:34.909375 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddae33-039e-4f0f-a95b-075e7fd94f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:34.909801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218ed1b-f3d7-456a-9d6c-f394edb92566 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:34.910271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddae33-039e-4f0f-a95b-075e7fd94f05 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:34.910562 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddae33-039e-4f0f-a95b-075e7fd94f05 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:34.910839 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddae33-039e-4f0f-a95b-075e7fd94f05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:34.946104 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1a4ff-190b-4a0a-9d03-5b6e210cfdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:34.946770 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1a4ff-190b-4a0a-9d03-5b6e210cfdb2 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:34.947057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1a4ff-190b-4a0a-9d03-5b6e210cfdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:34.947335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1a4ff-190b-4a0a-9d03-5b6e210cfdb2 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:34.948090 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1a4ff-190b-4a0a-9d03-5b6e210cfdb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:34.948400 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1a4ff-190b-4a0a-9d03-5b6e210cfdb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:34.949815 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1a4ff-190b-4a0a-9d03-5b6e210cfdb2 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:34.962254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 8/15] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:36:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:34.970060 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1a4ff-190b-4a0a-9d03-5b6e210cfdb2 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:34.979470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddae33-039e-4f0f-a95b-075e7fd94f05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:34.981015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddae33-039e-4f0f-a95b-075e7fd94f05 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:35.071657 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1a4ff-190b-4a0a-9d03-5b6e210cfdb2 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:35.079448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 8/16] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:36:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 14:36:35.086116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddae33-039e-4f0f-a95b-075e7fd94f05 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:35.088192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:35.110295 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d2de4-4ecd-4c85-84e7-ca7d3d2d5586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:35.111167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d2de4-4ecd-4c85-84e7-ca7d3d2d5586 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:35.111446 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d2de4-4ecd-4c85-84e7-ca7d3d2d5586 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:35.111733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d2de4-4ecd-4c85-84e7-ca7d3d2d5586 None admin] PATH_INFO: `/v3/users/34ee4c4ab8ea4807905f919862ea9620` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:35.112947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d2de4-4ecd-4c85-84e7-ca7d3d2d5586 None admin] RBAC: Authorizing `identity:get_user(user_id=34ee4c4ab8ea4807905f919862ea9620)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:35.114393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d2de4-4ecd-4c85-84e7-ca7d3d2d5586 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:35.115999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 9/17] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:36:34 2022] GET /identity/v3/users/34ee4c4ab8ea4807905f919862ea9620 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:35.121202 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d2de4-4ecd-4c85-84e7-ca7d3d2d5586 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:35.136226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:35.187747 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddae33-039e-4f0f-a95b-075e7fd94f05 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:35.222058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a9d08-95de-4280-b7d1-cdcd25b2ee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:35.222611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d2de4-4ecd-4c85-84e7-ca7d3d2d5586 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:35.222851 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a9d08-95de-4280-b7d1-cdcd25b2ee33 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:35.223139 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a9d08-95de-4280-b7d1-cdcd25b2ee33 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:35.223418 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a9d08-95de-4280-b7d1-cdcd25b2ee33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:35.241934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a9d08-95de-4280-b7d1-cdcd25b2ee33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:35.243393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a9d08-95de-4280-b7d1-cdcd25b2ee33 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:35.256544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd169978-5182-42aa-87a2-19348db8d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:35.257355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd169978-5182-42aa-87a2-19348db8d80c None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:35.257643 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd169978-5182-42aa-87a2-19348db8d80c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:35.257923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd169978-5182-42aa-87a2-19348db8d80c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:35.259221 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd169978-5182-42aa-87a2-19348db8d80c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:35.260664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd169978-5182-42aa-87a2-19348db8d80c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:35.262266 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 10/18] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:36:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:35.264119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-776a9d08-95de-4280-b7d1-cdcd25b2ee33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:36:35.264119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:35.264119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:35.264119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:35.264119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:35.264119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:35.264119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:35.264119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:35.264119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:35.264119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:35.264119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:35.264119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:35.264119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:36:35.264119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:36:35.264119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:35.265116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:35.266718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:36:35.266718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:36:35.266718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:36:35.266718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:36:35.266718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 9/19] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:36:35.268521 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd169978-5182-42aa-87a2-19348db8d80c None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:35.272806 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a9d08-95de-4280-b7d1-cdcd25b2ee33 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:35.329060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:35.349250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:35.367956 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd169978-5182-42aa-87a2-19348db8d80c None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:35.374020 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a9d08-95de-4280-b7d1-cdcd25b2ee33 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:35.402725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37057da5-787b-43b8-bd8d-a8480966a7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:35.403383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37057da5-787b-43b8-bd8d-a8480966a7b8 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:35.403668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37057da5-787b-43b8-bd8d-a8480966a7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:35.403946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37057da5-787b-43b8-bd8d-a8480966a7b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:35.404815 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37057da5-787b-43b8-bd8d-a8480966a7b8 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.domain.id=default, user.id=34ee4c4ab8ea4807905f919862ea9620) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:35.405137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37057da5-787b-43b8-bd8d-a8480966a7b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:35.407355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37057da5-787b-43b8-bd8d-a8480966a7b8 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:35.410622 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c13ca-9d25-47dd-a527-5a24eec68cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:35.411695 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c13ca-9d25-47dd-a527-5a24eec68cd0 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:35.411990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c13ca-9d25-47dd-a527-5a24eec68cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:35.412272 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c13ca-9d25-47dd-a527-5a24eec68cd0 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:35.413044 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c13ca-9d25-47dd-a527-5a24eec68cd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:35.413352 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c13ca-9d25-47dd-a527-5a24eec68cd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:35.414068 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 11/20] 10.222.0.44 () {56 vars in 1322 bytes} [Mon Jun 27 14:36:35 2022] GET /identity/v3/role_assignments?user.id=34ee4c4ab8ea4807905f919862ea9620&scope.domain.id=default&role.id=6036efe96c1948fb98d01c8703a0561a => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:35.414718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c13ca-9d25-47dd-a527-5a24eec68cd0 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:35.434255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 10/21] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:37.786274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da274a12-874d-4eb0-8dc0-d2454cd5ed04 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:37.786823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da274a12-874d-4eb0-8dc0-d2454cd5ed04 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:37.786823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da274a12-874d-4eb0-8dc0-d2454cd5ed04 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:37.788205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 12/22] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:37.802956 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e23bb-c8a8-4a69-af0a-13fbcf2a1d12 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:37.803451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e23bb-c8a8-4a69-af0a-13fbcf2a1d12 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:37.803552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e23bb-c8a8-4a69-af0a-13fbcf2a1d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:37.829648 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d48e23bb-c8a8-4a69-af0a-13fbcf2a1d12 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:37.830895 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d48e23bb-c8a8-4a69-af0a-13fbcf2a1d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:37.919200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 11/23] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:37.955128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da274a12-874d-4eb0-8dc0-d2454cd5ed04 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:37.977787 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd97ec-095e-46e3-a914-fe9b1320caa9 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:37.978080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd97ec-095e-46e3-a914-fe9b1320caa9 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:37.978529 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd97ec-095e-46e3-a914-fe9b1320caa9 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:37.980064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 12/24] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:36:37.986378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ff180-5c14-47a1-88b9-4bd5f7990f56 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:37.986914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ff180-5c14-47a1-88b9-4bd5f7990f56 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:37.987375 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ff180-5c14-47a1-88b9-4bd5f7990f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:38.021675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-818ff180-5c14-47a1-88b9-4bd5f7990f56 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:38.023187 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-818ff180-5c14-47a1-88b9-4bd5f7990f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:38.119816 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:38.154650 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da274a12-874d-4eb0-8dc0-d2454cd5ed04 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:38.186266 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 13/25] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:36:38.188589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535a9ed-577f-4e4f-8935-d672f010072a None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:38.189248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535a9ed-577f-4e4f-8935-d672f010072a None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:38.189730 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535a9ed-577f-4e4f-8935-d672f010072a None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:38.191410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 14/26] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:38.197640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2f273-3a65-415c-adf9-4eab00cc1db6 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:38.198185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2f273-3a65-415c-adf9-4eab00cc1db6 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:38.198670 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2f273-3a65-415c-adf9-4eab00cc1db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:38.218138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-aba2f273-3a65-415c-adf9-4eab00cc1db6 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:38.220218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-aba2f273-3a65-415c-adf9-4eab00cc1db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:38.231027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2a55b-18a4-4c22-8f42-1d3afac4bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:38.231827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2a55b-18a4-4c22-8f42-1d3afac4bdad None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:38.232207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2a55b-18a4-4c22-8f42-1d3afac4bdad None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:38.232495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2a55b-18a4-4c22-8f42-1d3afac4bdad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:38.256907 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2a55b-18a4-4c22-8f42-1d3afac4bdad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-2dd2a55b-18a4-4c22-8f42-1d3afac4bdad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:36:38.265023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:38.266649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:38.267416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:38.267416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:38.267416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:38.267416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:38.267416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:36:38.267416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:36:38.267416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:36:38.267416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:36:38.267416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:36:38.267416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:36:38.267416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:36:38.267416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:36:38.270136 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 13/27] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:36:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:36:38.271143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2a55b-18a4-4c22-8f42-1d3afac4bdad None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:38.283857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:38.323721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 15/28] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:36:38.324875 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2f273-3a65-415c-adf9-4eab00cc1db6 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:38.442234 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2f273-3a65-415c-adf9-4eab00cc1db6 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:38.449839 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:38.453967 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2a55b-18a4-4c22-8f42-1d3afac4bdad None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:38.492834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e51c9-9aec-474c-9fa3-b48a169ed1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:38.493617 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e51c9-9aec-474c-9fa3-b48a169ed1a8 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:38.493903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e51c9-9aec-474c-9fa3-b48a169ed1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:38.494178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e51c9-9aec-474c-9fa3-b48a169ed1a8 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:38.494931 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e51c9-9aec-474c-9fa3-b48a169ed1a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:38.495238 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e51c9-9aec-474c-9fa3-b48a169ed1a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:38.496610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e51c9-9aec-474c-9fa3-b48a169ed1a8 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:38.499416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73564da-78ad-46d2-a6bc-cbc7492a6c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:38.501334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73564da-78ad-46d2-a6bc-cbc7492a6c34 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:38.501808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73564da-78ad-46d2-a6bc-cbc7492a6c34 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:38.502260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73564da-78ad-46d2-a6bc-cbc7492a6c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:38.509199 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 16/29] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:36:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:38.509871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e51c9-9aec-474c-9fa3-b48a169ed1a8 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:38.521736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73564da-78ad-46d2-a6bc-cbc7492a6c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:38.524314 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73564da-78ad-46d2-a6bc-cbc7492a6c34 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:38.550376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-e73564da-78ad-46d2-a6bc-cbc7492a6c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:36:38.550376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:38.550376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:38.550376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:38.550376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:38.550376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:38.550376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:38.550376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:38.550376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:38.550376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:38.550376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:38.550376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:38.550376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:36:38.550376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:36:38.550376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:38.551191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:38.551981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:36:38.551981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:36:38.551981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:36:38.551981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:36:38.554508 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 14/30] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:36:38.555997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8873-ec58-4a8d-9a02-312f9c6f458b None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:38.557038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8873-ec58-4a8d-9a02-312f9c6f458b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:38.557490 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e8873-ec58-4a8d-9a02-312f9c6f458b None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:38.559616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 15/31] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:38.560480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e8873-ec58-4a8d-9a02-312f9c6f458b None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:38.625725 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e51c9-9aec-474c-9fa3-b48a169ed1a8 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:38.636697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:38.667834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc84ae4-a484-4e4c-96a6-0494ef1f6e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:38.668563 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc84ae4-a484-4e4c-96a6-0494ef1f6e27 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:38.668899 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc84ae4-a484-4e4c-96a6-0494ef1f6e27 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:38.669181 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc84ae4-a484-4e4c-96a6-0494ef1f6e27 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:38.670220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc84ae4-a484-4e4c-96a6-0494ef1f6e27 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:38.671828 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc84ae4-a484-4e4c-96a6-0494ef1f6e27 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:38.692100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e8873-ec58-4a8d-9a02-312f9c6f458b None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:38.727672 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75259c9b-acf4-46cc-8b4c-f3e097ea2086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:38.728469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75259c9b-acf4-46cc-8b4c-f3e097ea2086 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:38.728821 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75259c9b-acf4-46cc-8b4c-f3e097ea2086 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:38.729098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75259c9b-acf4-46cc-8b4c-f3e097ea2086 None admin] PATH_INFO: `/v3/users/34ee4c4ab8ea4807905f919862ea9620` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:38.730318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75259c9b-acf4-46cc-8b4c-f3e097ea2086 None admin] RBAC: Authorizing `identity:get_user(user_id=34ee4c4ab8ea4807905f919862ea9620)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:38.731756 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75259c9b-acf4-46cc-8b4c-f3e097ea2086 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:38.738155 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 16/32] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:36:38 2022] GET /identity/v3/users/34ee4c4ab8ea4807905f919862ea9620 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:38.738155 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75259c9b-acf4-46cc-8b4c-f3e097ea2086 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:38.852301 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75259c9b-acf4-46cc-8b4c-f3e097ea2086 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:38.872211 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 17/33] 10.222.0.44 () {60 vars in 1131 bytes} [Mon Jun 27 14:36:38 2022] POST /identity/v3/roles => generated 225 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:36:38.873547 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaaa51-cb16-4dec-a272-eb0c8a58d2dd None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:38.873841 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaaa51-cb16-4dec-a272-eb0c8a58d2dd None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:38.874121 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deaaa51-cb16-4dec-a272-eb0c8a58d2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:38.883206 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:38.894943 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-8deaaa51-cb16-4dec-a272-eb0c8a58d2dd None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:38.896491 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-8deaaa51-cb16-4dec-a272-eb0c8a58d2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:38.898087 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba6b5a-ae42-465e-baba-295ccaa816dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:38.899276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba6b5a-ae42-465e-baba-295ccaa816dd None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:38.900692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba6b5a-ae42-465e-baba-295ccaa816dd None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:38.901175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba6b5a-ae42-465e-baba-295ccaa816dd None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:38.902109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba6b5a-ae42-465e-baba-295ccaa816dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:38.902613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba6b5a-ae42-465e-baba-295ccaa816dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:38.904271 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba6b5a-ae42-465e-baba-295ccaa816dd None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:38.923927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:38.932750 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 17/34] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:38.934241 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba6b5a-ae42-465e-baba-295ccaa816dd None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:38.983914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 18/35] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:38.985850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaaa51-cb16-4dec-a272-eb0c8a58d2dd None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:39.063869 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba6b5a-ae42-465e-baba-295ccaa816dd None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:39.109901 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deaaa51-cb16-4dec-a272-eb0c8a58d2dd None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:39.121405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20003afc-b2a4-4a1e-9f48-a449d9ac36bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:39.122229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20003afc-b2a4-4a1e-9f48-a449d9ac36bd None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:39.122515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20003afc-b2a4-4a1e-9f48-a449d9ac36bd None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:39.122792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20003afc-b2a4-4a1e-9f48-a449d9ac36bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:39.124825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20003afc-b2a4-4a1e-9f48-a449d9ac36bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:39.126322 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20003afc-b2a4-4a1e-9f48-a449d9ac36bd None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:39.128258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 18/36] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:36:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:39.131356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20003afc-b2a4-4a1e-9f48-a449d9ac36bd None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:39.168445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550f47d-8eb7-424e-9483-46f2a66ca387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:39.169484 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550f47d-8eb7-424e-9483-46f2a66ca387 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:39.170002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550f47d-8eb7-424e-9483-46f2a66ca387 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:39.170485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550f47d-8eb7-424e-9483-46f2a66ca387 None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:39.171776 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550f47d-8eb7-424e-9483-46f2a66ca387 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:39.173599 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550f47d-8eb7-424e-9483-46f2a66ca387 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:39.207993 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:39.264819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20003afc-b2a4-4a1e-9f48-a449d9ac36bd None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:39.286686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 19/37] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Jun 27 14:36:38 2022] POST /identity/v3/projects => generated 301 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:36:39.288835 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550f47d-8eb7-424e-9483-46f2a66ca387 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:39.308540 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:39.311944 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cea1e8-0d4e-43f5-bee1-842c441d6d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:39.311944 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cea1e8-0d4e-43f5-bee1-842c441d6d6d None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:39.311944 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cea1e8-0d4e-43f5-bee1-842c441d6d6d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:39.311944 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cea1e8-0d4e-43f5-bee1-842c441d6d6d None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:39.313057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cea1e8-0d4e-43f5-bee1-842c441d6d6d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:39.313279 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cea1e8-0d4e-43f5-bee1-842c441d6d6d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:39.415441 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550f47d-8eb7-424e-9483-46f2a66ca387 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:39.459366 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d00635-f30b-4e77-8d99-3ae49ef895d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:39.460255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d00635-f30b-4e77-8d99-3ae49ef895d2 None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:39.460546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d00635-f30b-4e77-8d99-3ae49ef895d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:39.460882 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d00635-f30b-4e77-8d99-3ae49ef895d2 None admin] PATH_INFO: `/v3/domains/default/users/34ee4c4ab8ea4807905f919862ea9620/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:39.464965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d00635-f30b-4e77-8d99-3ae49ef895d2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=34ee4c4ab8ea4807905f919862ea9620, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:39.466496 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d00635-f30b-4e77-8d99-3ae49ef895d2 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:39.511865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 19/38] 10.222.0.44 () {60 vars in 1131 bytes} [Mon Jun 27 14:36:39 2022] POST /identity/v3/roles => generated 219 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:36:39.513420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfc717-2ce5-4345-9c29-cdc6e7c6ae43 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:39.513710 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfc717-2ce5-4345-9c29-cdc6e7c6ae43 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:39.513995 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfc717-2ce5-4345-9c29-cdc6e7c6ae43 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:39.518256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 20/39] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:39.518256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd34e35-e18d-483d-9ed1-c081fcd44123 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:39.518256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd34e35-e18d-483d-9ed1-c081fcd44123 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:39.518256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd34e35-e18d-483d-9ed1-c081fcd44123 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:39.520221 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 21/40] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:39.523411 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf38e7-6ad6-45a1-955a-db35f2025f62 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:39.523714 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf38e7-6ad6-45a1-955a-db35f2025f62 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:39.524051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf38e7-6ad6-45a1-955a-db35f2025f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:39.543774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-6cbf38e7-6ad6-45a1-955a-db35f2025f62 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:39.545401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6cbf38e7-6ad6-45a1-955a-db35f2025f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:39.580678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 20/41] 10.222.0.44 () {58 vars in 1361 bytes} [Mon Jun 27 14:36:39 2022] PUT /identity/v3/domains/default/users/34ee4c4ab8ea4807905f919862ea9620/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:36:39.580678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d8bab-11a5-4203-8c10-e77dbb13c3f0 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:39.580678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d8bab-11a5-4203-8c10-e77dbb13c3f0 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:39.580678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d8bab-11a5-4203-8c10-e77dbb13c3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:39.601865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-5a7d8bab-11a5-4203-8c10-e77dbb13c3f0 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:39.603422 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-5a7d8bab-11a5-4203-8c10-e77dbb13c3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:39.685047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:39.691651 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 21/42] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:39.718009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d8bab-11a5-4203-8c10-e77dbb13c3f0 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:39.757263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 22/43] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:39.782873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf38e7-6ad6-45a1-955a-db35f2025f62 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:39.830388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:39.835256 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d8bab-11a5-4203-8c10-e77dbb13c3f0 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:39.872178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e097a4-8ad7-466a-84ba-0870cb3b16fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:39.872882 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e097a4-8ad7-466a-84ba-0870cb3b16fb None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:39.873474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e097a4-8ad7-466a-84ba-0870cb3b16fb None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:39.873474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e097a4-8ad7-466a-84ba-0870cb3b16fb None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:39.874326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e097a4-8ad7-466a-84ba-0870cb3b16fb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:39.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e097a4-8ad7-466a-84ba-0870cb3b16fb None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:39.892456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf38e7-6ad6-45a1-955a-db35f2025f62 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:39.926787 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526461f-fad2-4769-8b15-390e446a5792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:39.931240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526461f-fad2-4769-8b15-390e446a5792 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:39.931240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526461f-fad2-4769-8b15-390e446a5792 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:39.931240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526461f-fad2-4769-8b15-390e446a5792 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:39.931240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526461f-fad2-4769-8b15-390e446a5792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:39.931240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526461f-fad2-4769-8b15-390e446a5792 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:39.932457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 23/44] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:36:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:39.937912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526461f-fad2-4769-8b15-390e446a5792 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:39.995123 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1131 bytes} [Mon Jun 27 14:36:39 2022] POST /identity/v3/roles => generated 223 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:36:40.044836 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526461f-fad2-4769-8b15-390e446a5792 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:40.056856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:40.085164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66480f5e-9672-4dcd-97d5-585577cf2bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:40.085164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66480f5e-9672-4dcd-97d5-585577cf2bd6 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:40.085164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66480f5e-9672-4dcd-97d5-585577cf2bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:40.085164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66480f5e-9672-4dcd-97d5-585577cf2bd6 None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:40.085744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66480f5e-9672-4dcd-97d5-585577cf2bd6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:40.087201 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66480f5e-9672-4dcd-97d5-585577cf2bd6 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:40.174008 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Jun 27 14:36:39 2022] POST /identity/v3/projects => generated 312 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:36:41.666950 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2b890-2cad-48be-867b-fd4414669256 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:41.667490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2b890-2cad-48be-867b-fd4414669256 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:41.667490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2b890-2cad-48be-867b-fd4414669256 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:41.668895 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 23/47] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:41.674675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5234910-809a-4129-9a41-28d2ce423e10 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:41.675080 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5234910-809a-4129-9a41-28d2ce423e10 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:41.675249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5234910-809a-4129-9a41-28d2ce423e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:41.691692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-c5234910-809a-4129-9a41-28d2ce423e10 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:41.692917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-c5234910-809a-4129-9a41-28d2ce423e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:41.760541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 25/48] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:41.783927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2b890-2cad-48be-867b-fd4414669256 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:41.847838 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:41.995435 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2b890-2cad-48be-867b-fd4414669256 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:42.029986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288da519-30b8-4d89-9b38-1341bc690547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:42.031413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288da519-30b8-4d89-9b38-1341bc690547 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:42.031708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288da519-30b8-4d89-9b38-1341bc690547 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:42.031986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288da519-30b8-4d89-9b38-1341bc690547 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:42.043021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288da519-30b8-4d89-9b38-1341bc690547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-288da519-30b8-4d89-9b38-1341bc690547 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:36:42.051980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:42.052842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:42.053812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:42.053812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:42.053812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:42.053812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:42.053812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:36:42.053812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:36:42.053812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:36:42.053812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:36:42.053812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:36:42.053812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:36:42.053812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:36:42.053812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:36:42.053812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 24/49] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:36:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:36:42.059003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5234910-809a-4129-9a41-28d2ce423e10 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:42.151886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:42.160942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5234910-809a-4129-9a41-28d2ce423e10 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:42.193979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de738f62-6bda-4cda-b565-18aaf4149fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:42.199261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de738f62-6bda-4cda-b565-18aaf4149fbc None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:42.199261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de738f62-6bda-4cda-b565-18aaf4149fbc None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:42.199261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de738f62-6bda-4cda-b565-18aaf4149fbc None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:42.199261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de738f62-6bda-4cda-b565-18aaf4149fbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:42.199261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de738f62-6bda-4cda-b565-18aaf4149fbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:42.199261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de738f62-6bda-4cda-b565-18aaf4149fbc None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:42.206379 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 26/50] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:36:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:42.211897 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288da519-30b8-4d89-9b38-1341bc690547 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:42.270765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44703419-22b7-497b-a3ec-916648103b9d None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:42.270980 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44703419-22b7-497b-a3ec-916648103b9d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:42.271268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44703419-22b7-497b-a3ec-916648103b9d None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:42.272637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 27/51] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:36:42.277607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239b33b-9ddd-4c16-a4e0-43865aed622b None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:42.277897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239b33b-9ddd-4c16-a4e0-43865aed622b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:42.278186 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239b33b-9ddd-4c16-a4e0-43865aed622b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:42.294329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-e239b33b-9ddd-4c16-a4e0-43865aed622b None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:42.295523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-e239b33b-9ddd-4c16-a4e0-43865aed622b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:42.319128 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288da519-30b8-4d89-9b38-1341bc690547 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:42.339877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:42.353737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48733691-cc1d-4759-9652-555d9576cc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:42.354338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48733691-cc1d-4759-9652-555d9576cc7a None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:42.354626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48733691-cc1d-4759-9652-555d9576cc7a None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:42.354900 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48733691-cc1d-4759-9652-555d9576cc7a None admin] PATH_INFO: `/v3/users/34ee4c4ab8ea4807905f919862ea9620` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:42.356119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48733691-cc1d-4759-9652-555d9576cc7a None admin] RBAC: Authorizing `identity:get_user(user_id=34ee4c4ab8ea4807905f919862ea9620)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:42.357607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48733691-cc1d-4759-9652-555d9576cc7a None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:42.359541 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 25/52] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:36:42 2022] GET /identity/v3/users/34ee4c4ab8ea4807905f919862ea9620 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:42.364761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48733691-cc1d-4759-9652-555d9576cc7a None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:42.368671 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 28/53] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:36:42.391830 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239b33b-9ddd-4c16-a4e0-43865aed622b None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:42.463367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48733691-cc1d-4759-9652-555d9576cc7a None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:42.474217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:42.490001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239b33b-9ddd-4c16-a4e0-43865aed622b None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:42.495930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e48e61-60ed-4277-8f7c-59b316df6928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:42.496747 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e48e61-60ed-4277-8f7c-59b316df6928 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:42.497037 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e48e61-60ed-4277-8f7c-59b316df6928 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:42.497311 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e48e61-60ed-4277-8f7c-59b316df6928 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:42.498492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e48e61-60ed-4277-8f7c-59b316df6928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:42.500425 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e48e61-60ed-4277-8f7c-59b316df6928 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:42.502114 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 26/54] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:36:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:42.507639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e48e61-60ed-4277-8f7c-59b316df6928 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:42.527937 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e97eb-f15e-4dde-ac9d-fe2ab03e2b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:42.528683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e97eb-f15e-4dde-ac9d-fe2ab03e2b14 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:42.528979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e97eb-f15e-4dde-ac9d-fe2ab03e2b14 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:42.529270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e97eb-f15e-4dde-ac9d-fe2ab03e2b14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:42.530448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e97eb-f15e-4dde-ac9d-fe2ab03e2b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:42.532256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e97eb-f15e-4dde-ac9d-fe2ab03e2b14 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:42.533914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 29/55] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:36:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:42.539263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e97eb-f15e-4dde-ac9d-fe2ab03e2b14 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:42.563164 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:42.606486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e48e61-60ed-4277-8f7c-59b316df6928 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:42.638415 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e97eb-f15e-4dde-ac9d-fe2ab03e2b14 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:42.641489 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b605eb9-597a-4f40-a158-be4e21403462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:42.642149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b605eb9-597a-4f40-a158-be4e21403462 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:42.642441 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b605eb9-597a-4f40-a158-be4e21403462 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:42.642724 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b605eb9-597a-4f40-a158-be4e21403462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:42.643561 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b605eb9-597a-4f40-a158-be4e21403462 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.domain.id=default, user.id=34ee4c4ab8ea4807905f919862ea9620) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:42.643881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b605eb9-597a-4f40-a158-be4e21403462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:42.645365 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b605eb9-597a-4f40-a158-be4e21403462 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:42.654575 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 27/56] 10.222.0.44 () {56 vars in 1322 bytes} [Mon Jun 27 14:36:42 2022] GET /identity/v3/role_assignments?user.id=34ee4c4ab8ea4807905f919862ea9620&scope.domain.id=default&role.id=6036efe96c1948fb98d01c8703a0561a => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:42.675248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abe353-a96b-48e6-ae9c-e422ddbc482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:42.675924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abe353-a96b-48e6-ae9c-e422ddbc482e None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:42.676205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abe353-a96b-48e6-ae9c-e422ddbc482e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:42.676478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abe353-a96b-48e6-ae9c-e422ddbc482e None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:42.677308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abe353-a96b-48e6-ae9c-e422ddbc482e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:42.678772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abe353-a96b-48e6-ae9c-e422ddbc482e None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:42.767628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 30/57] 10.222.0.44 () {60 vars in 1140 bytes} [Mon Jun 27 14:36:42 2022] POST /identity/v3/projects => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:36:44.783407 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ecb0-9dec-4c98-bfbd-88ae5a53c262 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:44.783959 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ecb0-9dec-4c98-bfbd-88ae5a53c262 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:44.783959 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ecb0-9dec-4c98-bfbd-88ae5a53c262 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:44.785351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 28/58] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:44.790461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eeacc-c2fd-401e-b6d5-d54922403e40 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:44.790857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eeacc-c2fd-401e-b6d5-d54922403e40 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:44.791021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eeacc-c2fd-401e-b6d5-d54922403e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:44.797638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:44.808086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-8e4eeacc-c2fd-401e-b6d5-d54922403e40 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:44.813235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8e4eeacc-c2fd-401e-b6d5-d54922403e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:44.875340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 31/59] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:44.900143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ecb0-9dec-4c98-bfbd-88ae5a53c262 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:44.998732 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ecb0-9dec-4c98-bfbd-88ae5a53c262 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:45.018050 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:45.031556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1c6dc-d1c1-4dd8-84f3-33ec3ccd2bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:45.032346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1c6dc-d1c1-4dd8-84f3-33ec3ccd2bc3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:45.032611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1c6dc-d1c1-4dd8-84f3-33ec3ccd2bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:45.032949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1c6dc-d1c1-4dd8-84f3-33ec3ccd2bc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:45.034173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1c6dc-d1c1-4dd8-84f3-33ec3ccd2bc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:45.035574 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1c6dc-d1c1-4dd8-84f3-33ec3ccd2bc3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:45.037195 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 29/60] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:45.042594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4eeacc-c2fd-401e-b6d5-d54922403e40 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:45.137451 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4eeacc-c2fd-401e-b6d5-d54922403e40 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:45.170798 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a246db-7d29-4af2-8466-b199f9adeb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:45.171542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a246db-7d29-4af2-8466-b199f9adeb73 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:45.171823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a246db-7d29-4af2-8466-b199f9adeb73 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:45.172101 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a246db-7d29-4af2-8466-b199f9adeb73 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:45.172849 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a246db-7d29-4af2-8466-b199f9adeb73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:45.174269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a246db-7d29-4af2-8466-b199f9adeb73 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:45.182563 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:45.251134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 32/61] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:36:45 2022] POST /identity/v3/users => generated 275 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:36:48.331467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea7403-27b5-484d-8e04-c37e09035316 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:48.331971 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea7403-27b5-484d-8e04-c37e09035316 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:48.332043 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea7403-27b5-484d-8e04-c37e09035316 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:48.333430 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 30/62] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:48.350289 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e67c50-b79b-470f-8163-7de535baf738 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:48.351204 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e67c50-b79b-470f-8163-7de535baf738 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:48.351683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e67c50-b79b-470f-8163-7de535baf738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:48.373737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-d7e67c50-b79b-470f-8163-7de535baf738 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:48.375910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-d7e67c50-b79b-470f-8163-7de535baf738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:48.467163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 33/63] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:48.506454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea7403-27b5-484d-8e04-c37e09035316 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:48.548685 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401090e-0de3-4ab4-b3ab-6f626e34dd96 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:48.549414 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401090e-0de3-4ab4-b3ab-6f626e34dd96 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:48.549984 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401090e-0de3-4ab4-b3ab-6f626e34dd96 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:48.551595 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 34/64] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:48.558053 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf598a29-d2cf-4d60-9bb2-c35a0be38547 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:48.558339 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf598a29-d2cf-4d60-9bb2-c35a0be38547 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:48.558829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf598a29-d2cf-4d60-9bb2-c35a0be38547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:48.589664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-bf598a29-d2cf-4d60-9bb2-c35a0be38547 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:48.590892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-bf598a29-d2cf-4d60-9bb2-c35a0be38547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:48.689075 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea7403-27b5-484d-8e04-c37e09035316 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:48.728307 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d25c68-fec5-4f27-9645-418dad68f9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:48.729146 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d25c68-fec5-4f27-9645-418dad68f9fe None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:48.729435 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d25c68-fec5-4f27-9645-418dad68f9fe None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:48.729718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d25c68-fec5-4f27-9645-418dad68f9fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:48.735541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 35/65] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:36:48.754688 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d25c68-fec5-4f27-9645-418dad68f9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-00d25c68-fec5-4f27-9645-418dad68f9fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:36:48.762784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:48.763657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:48.764410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:48.764410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:48.764410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:48.764410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:48.764410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:36:48.764410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:36:48.764410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:36:48.764410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:36:48.764410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:36:48.764410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:36:48.764410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:36:48.764410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:36:48.764410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 31/66] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:36:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:36:48.771377 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf598a29-d2cf-4d60-9bb2-c35a0be38547 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:48.779144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d25c68-fec5-4f27-9645-418dad68f9fe None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:48.842354 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:48.851637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:48.898895 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d25c68-fec5-4f27-9645-418dad68f9fe None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:48.905157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf598a29-d2cf-4d60-9bb2-c35a0be38547 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:48.934033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ea683-838b-4b25-bbd4-169a0cfbf105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:48.935099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ea683-838b-4b25-bbd4-169a0cfbf105 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:48.935384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ea683-838b-4b25-bbd4-169a0cfbf105 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:48.935661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ea683-838b-4b25-bbd4-169a0cfbf105 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:48.942129 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87cea0-0ee6-4aa0-9a05-d707c832d8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:48.942736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87cea0-0ee6-4aa0-9a05-d707c832d8d0 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:48.943019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87cea0-0ee6-4aa0-9a05-d707c832d8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:48.943298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87cea0-0ee6-4aa0-9a05-d707c832d8d0 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:48.944046 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87cea0-0ee6-4aa0-9a05-d707c832d8d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:48.944351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87cea0-0ee6-4aa0-9a05-d707c832d8d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:48.945763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87cea0-0ee6-4aa0-9a05-d707c832d8d0 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:48.946167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ea683-838b-4b25-bbd4-169a0cfbf105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:36:48.959053 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 36/67] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:36:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-1a8ea683-838b-4b25-bbd4-169a0cfbf105 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:36:48.959206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:48.960015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:48.960796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:48.960796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:48.960796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:48.960796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:48.960796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:36:48.960796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:36:48.960796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:36:48.960796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:36:48.960796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:36:48.960796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:36:48.960796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:36:48.960796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:36:48.960796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 32/68] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:36:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:36:48.961505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832b79d-42b6-4507-97c8-d284048940c1 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:48.961505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832b79d-42b6-4507-97c8-d284048940c1 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:48.961505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832b79d-42b6-4507-97c8-d284048940c1 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:48.961681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b2991-c097-46c6-b977-fbfcce05527a None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:48.961681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b2991-c097-46c6-b977-fbfcce05527a None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:48.961681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b2991-c097-46c6-b977-fbfcce05527a None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:48.961681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 33/69] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:48.961898 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 37/70] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:48.963906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b2991-c097-46c6-b977-fbfcce05527a None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:48.966898 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec0aa7-6745-4a8f-a866-e998b67f740b None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:48.967193 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec0aa7-6745-4a8f-a866-e998b67f740b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:48.967479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec0aa7-6745-4a8f-a866-e998b67f740b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:48.984855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-39ec0aa7-6745-4a8f-a866-e998b67f740b None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:48.986133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-39ec0aa7-6745-4a8f-a866-e998b67f740b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:49.055784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 38/71] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:49.057097 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e4c22-39f0-4552-a29c-f71069ab4887 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:49.057390 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e4c22-39f0-4552-a29c-f71069ab4887 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:49.057669 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e4c22-39f0-4552-a29c-f71069ab4887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:49.074048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-9f0e4c22-39f0-4552-a29c-f71069ab4887 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:49.075234 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-9f0e4c22-39f0-4552-a29c-f71069ab4887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:49.094595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b2991-c097-46c6-b977-fbfcce05527a None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:49.103906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:49.113373 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:49.128727 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ac6f5-d55b-4050-bb87-4bd5b71a0620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:49.129639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ac6f5-d55b-4050-bb87-4bd5b71a0620 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:49.129921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ac6f5-d55b-4050-bb87-4bd5b71a0620 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:49.130198 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ac6f5-d55b-4050-bb87-4bd5b71a0620 None admin] PATH_INFO: `/v3/users/6b3f273238ff429fb6fd5818edbed0d6` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:49.144176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 39/72] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:49.152438 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e4c22-39f0-4552-a29c-f71069ab4887 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:49.152518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ac6f5-d55b-4050-bb87-4bd5b71a0620 None admin] RBAC: Authorizing `identity:get_user(user_id=6b3f273238ff429fb6fd5818edbed0d6)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:49.152518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ac6f5-d55b-4050-bb87-4bd5b71a0620 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:49.152518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 34/73] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:36:48 2022] GET /identity/v3/users/6b3f273238ff429fb6fd5818edbed0d6 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:49.152518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c242fd9-d2d1-4a12-91e3-712f4d05d4fc None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:49.152518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c242fd9-d2d1-4a12-91e3-712f4d05d4fc None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:49.152518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c242fd9-d2d1-4a12-91e3-712f4d05d4fc None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:49.152869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 35/74] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:49.153299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c242fd9-d2d1-4a12-91e3-712f4d05d4fc None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:49.250795 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e4c22-39f0-4552-a29c-f71069ab4887 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:49.258230 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c242fd9-d2d1-4a12-91e3-712f4d05d4fc None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:49.283643 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6dd80-01db-4c23-a637-b1c45f49cd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:49.284311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6dd80-01db-4c23-a637-b1c45f49cd0e None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:49.284589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6dd80-01db-4c23-a637-b1c45f49cd0e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:49.284893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6dd80-01db-4c23-a637-b1c45f49cd0e None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:49.285648 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6dd80-01db-4c23-a637-b1c45f49cd0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:49.285951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6dd80-01db-4c23-a637-b1c45f49cd0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:49.287315 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6dd80-01db-4c23-a637-b1c45f49cd0e None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:49.291752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a861e-e0ea-48fa-a089-f1ba1794553b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:49.292542 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a861e-e0ea-48fa-a089-f1ba1794553b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:49.292881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a861e-e0ea-48fa-a089-f1ba1794553b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:49.293165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a861e-e0ea-48fa-a089-f1ba1794553b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:49.299979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 40/75] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:49.299979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6dd80-01db-4c23-a637-b1c45f49cd0e None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:49.308213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a861e-e0ea-48fa-a089-f1ba1794553b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-5e0a861e-e0ea-48fa-a089-f1ba1794553b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:36:49.316465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:49.317347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:49.318127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:49.318127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:49.318127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:49.318127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:49.318127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:36:49.318127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:36:49.318127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:36:49.318127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:36:49.318127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:36:49.318127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:36:49.318127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:36:49.318127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:36:49.318127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 36/76] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:36:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:36:49.318924 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a691c2-44df-4fce-8a70-84c26aa8ac10 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:49.319214 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a691c2-44df-4fce-8a70-84c26aa8ac10 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:49.319498 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a691c2-44df-4fce-8a70-84c26aa8ac10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:49.334702 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:49.337275 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-f4a691c2-44df-4fce-8a70-84c26aa8ac10 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:49.338470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f4a691c2-44df-4fce-8a70-84c26aa8ac10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:49.359022 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:49.398429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6dd80-01db-4c23-a637-b1c45f49cd0e None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:49.404324 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 37/77] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:49.405178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a691c2-44df-4fce-8a70-84c26aa8ac10 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:49.432344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981ef57-145a-4d2b-a00e-66bb97c0616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:49.433018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981ef57-145a-4d2b-a00e-66bb97c0616e None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:49.433305 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981ef57-145a-4d2b-a00e-66bb97c0616e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:49.433583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981ef57-145a-4d2b-a00e-66bb97c0616e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:49.502298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981ef57-145a-4d2b-a00e-66bb97c0616e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:49.503688 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981ef57-145a-4d2b-a00e-66bb97c0616e None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:49.510674 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a691c2-44df-4fce-8a70-84c26aa8ac10 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:49.535131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:49.543668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2a387-050b-4424-bf84-8211a9ea22e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:49.546724 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2a387-050b-4424-bf84-8211a9ea22e8 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:49.546724 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2a387-050b-4424-bf84-8211a9ea22e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:49.546724 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2a387-050b-4424-bf84-8211a9ea22e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:49.555663 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2a387-050b-4424-bf84-8211a9ea22e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-7ef2a387-050b-4424-bf84-8211a9ea22e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:36:49.564342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:49.565399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:49.566273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:49.566273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:49.566273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:49.566273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:49.566273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:36:49.566273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:36:49.566273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:36:49.566273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:36:49.566273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:36:49.566273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:36:49.566273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:36:49.566273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:36:49.568783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 38/78] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:36:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:36:49.569741 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2a387-050b-4424-bf84-8211a9ea22e8 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:49.588508 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:49.603535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 41/79] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:36:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:36:49.604535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981ef57-145a-4d2b-a00e-66bb97c0616e None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:49.670081 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2a387-050b-4424-bf84-8211a9ea22e8 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:49.705012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203afc4-6718-4f17-b6d6-2b9465898d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:49.705873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203afc4-6718-4f17-b6d6-2b9465898d07 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:49.705989 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981ef57-145a-4d2b-a00e-66bb97c0616e None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:49.706158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203afc4-6718-4f17-b6d6-2b9465898d07 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:49.706433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203afc4-6718-4f17-b6d6-2b9465898d07 None admin] PATH_INFO: `/v3/users/34ee4c4ab8ea4807905f919862ea9620` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:49.707633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203afc4-6718-4f17-b6d6-2b9465898d07 None admin] RBAC: Authorizing `identity:get_user(user_id=34ee4c4ab8ea4807905f919862ea9620)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:49.709109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203afc4-6718-4f17-b6d6-2b9465898d07 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:49.710802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 39/80] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:36:49 2022] GET /identity/v3/users/34ee4c4ab8ea4807905f919862ea9620 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:49.711558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203afc4-6718-4f17-b6d6-2b9465898d07 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:49.742010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb59535-2d27-436f-8516-acde10aedf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:49.742667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb59535-2d27-436f-8516-acde10aedf89 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:49.742946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb59535-2d27-436f-8516-acde10aedf89 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:49.743220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb59535-2d27-436f-8516-acde10aedf89 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:49.743964 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb59535-2d27-436f-8516-acde10aedf89 None admin] RBAC: Adding query filter params (name=member) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:49.744267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb59535-2d27-436f-8516-acde10aedf89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:49.745665 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb59535-2d27-436f-8516-acde10aedf89 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:49.746948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:49.759226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 42/81] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:36:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:49.759226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb59535-2d27-436f-8516-acde10aedf89 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:49.794897 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:49.810871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203afc4-6718-4f17-b6d6-2b9465898d07 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:49.844696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff3a65-7822-454b-99a2-cd2e63715dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:49.845471 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff3a65-7822-454b-99a2-cd2e63715dff None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:49.845769 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff3a65-7822-454b-99a2-cd2e63715dff None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:49.846041 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff3a65-7822-454b-99a2-cd2e63715dff None admin] PATH_INFO: `/v3/domains/default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:49.847234 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff3a65-7822-454b-99a2-cd2e63715dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:49.848711 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff3a65-7822-454b-99a2-cd2e63715dff None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:49.850312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 40/82] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:36:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:49.851066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff3a65-7822-454b-99a2-cd2e63715dff None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:49.858397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb59535-2d27-436f-8516-acde10aedf89 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:49.893786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729534b-bc67-4759-9550-a69518f4ee76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:49.894451 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729534b-bc67-4759-9550-a69518f4ee76 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:49.894734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729534b-bc67-4759-9550-a69518f4ee76 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:49.895012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729534b-bc67-4759-9550-a69518f4ee76 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:49.895754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729534b-bc67-4759-9550-a69518f4ee76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:49.896086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729534b-bc67-4759-9550-a69518f4ee76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:49.897516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729534b-bc67-4759-9550-a69518f4ee76 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:49.905911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 43/83] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:36:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:49.906654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729534b-bc67-4759-9550-a69518f4ee76 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:49.959049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff3a65-7822-454b-99a2-cd2e63715dff None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:49.964801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:49.993670 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bb0a1-d177-418a-a4d1-9faeb7bc1721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:49.994516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bb0a1-d177-418a-a4d1-9faeb7bc1721 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:49.994796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bb0a1-d177-418a-a4d1-9faeb7bc1721 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:49.995065 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bb0a1-d177-418a-a4d1-9faeb7bc1721 None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:49.996334 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176bb0a1-d177-418a-a4d1-9faeb7bc1721 None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:49.997893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176bb0a1-d177-418a-a4d1-9faeb7bc1721 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:50.000071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 41/84] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:36:49 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:50.000850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bb0a1-d177-418a-a4d1-9faeb7bc1721 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:50.006334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729534b-bc67-4759-9550-a69518f4ee76 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:50.026349 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:50.041160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436d104-cb9d-432b-8aac-72c860b295f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:50.041804 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436d104-cb9d-432b-8aac-72c860b295f2 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:50.042088 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436d104-cb9d-432b-8aac-72c860b295f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:50.042367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436d104-cb9d-432b-8aac-72c860b295f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:50.109340 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bb0a1-d177-418a-a4d1-9faeb7bc1721 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:50.111166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436d104-cb9d-432b-8aac-72c860b295f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:50.112653 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436d104-cb9d-432b-8aac-72c860b295f2 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:50.143424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05003e1-4d27-4e39-a794-369dc2bd6983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:50.144289 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05003e1-4d27-4e39-a794-369dc2bd6983 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:50.144573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05003e1-4d27-4e39-a794-369dc2bd6983 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:50.144887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05003e1-4d27-4e39-a794-369dc2bd6983 None admin] PATH_INFO: `/v3/users/6b3f273238ff429fb6fd5818edbed0d6` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:50.146087 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05003e1-4d27-4e39-a794-369dc2bd6983 None admin] RBAC: Authorizing `identity:get_user(user_id=6b3f273238ff429fb6fd5818edbed0d6)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:50.147501 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05003e1-4d27-4e39-a794-369dc2bd6983 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:50.149144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 42/85] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:36:50 2022] GET /identity/v3/users/6b3f273238ff429fb6fd5818edbed0d6 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:50.153808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05003e1-4d27-4e39-a794-369dc2bd6983 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:50.168621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:50.212056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 44/86] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:36:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:36:50.212888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436d104-cb9d-432b-8aac-72c860b295f2 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:50.244122 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:50.256152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05003e1-4d27-4e39-a794-369dc2bd6983 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:50.289848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff66e6-7523-475c-9f97-e535a6d0af41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:50.290440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff66e6-7523-475c-9f97-e535a6d0af41 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:50.290728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff66e6-7523-475c-9f97-e535a6d0af41 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:50.291007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff66e6-7523-475c-9f97-e535a6d0af41 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:50.291726 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff66e6-7523-475c-9f97-e535a6d0af41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:50.293238 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff66e6-7523-475c-9f97-e535a6d0af41 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:50.309854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436d104-cb9d-432b-8aac-72c860b295f2 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:50.344043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bba4a-cc9e-4c28-816b-d7befac92c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:50.344937 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bba4a-cc9e-4c28-816b-d7befac92c16 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:50.345223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bba4a-cc9e-4c28-816b-d7befac92c16 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:50.345501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bba4a-cc9e-4c28-816b-d7befac92c16 None admin] PATH_INFO: `/v3/users/6b3f273238ff429fb6fd5818edbed0d6` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:50.346688 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bba4a-cc9e-4c28-816b-d7befac92c16 None admin] RBAC: Authorizing `identity:get_user(user_id=6b3f273238ff429fb6fd5818edbed0d6)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:50.348177 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bba4a-cc9e-4c28-816b-d7befac92c16 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:50.349828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 45/87] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:36:50 2022] GET /identity/v3/users/6b3f273238ff429fb6fd5818edbed0d6 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:50.350592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bba4a-cc9e-4c28-816b-d7befac92c16 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:50.377171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 43/88] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:36:50 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:36:50.378037 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff66e6-7523-475c-9f97-e535a6d0af41 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:50.378855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:50.466799 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bba4a-cc9e-4c28-816b-d7befac92c16 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:50.491919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff66e6-7523-475c-9f97-e535a6d0af41 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:50.505816 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66eb13-4f71-4a73-93dc-8d200037d632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:50.506789 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66eb13-4f71-4a73-93dc-8d200037d632 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:50.507304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66eb13-4f71-4a73-93dc-8d200037d632 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:50.507756 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66eb13-4f71-4a73-93dc-8d200037d632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:50.508829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66eb13-4f71-4a73-93dc-8d200037d632 None admin] RBAC: Adding query filter params (role.id=4568d65f55c74c2bbc8265f34e62bbc4, scope.project.id=c4e4f97ef7884bcab434c35f9d529509, user.id=6b3f273238ff429fb6fd5818edbed0d6) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:50.509290 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66eb13-4f71-4a73-93dc-8d200037d632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:50.511009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66eb13-4f71-4a73-93dc-8d200037d632 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:50.520535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 46/89] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:36:50 2022] GET /identity/v3/role_assignments?user.id=6b3f273238ff429fb6fd5818edbed0d6&scope.project.id=c4e4f97ef7884bcab434c35f9d529509&role.id=4568d65f55c74c2bbc8265f34e62bbc4 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:50.521893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66eb13-4f71-4a73-93dc-8d200037d632 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:50.546705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e734f-d2c3-4f8b-86a0-f0b2d4703b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:50.547319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e734f-d2c3-4f8b-86a0-f0b2d4703b43 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:50.547604 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e734f-d2c3-4f8b-86a0-f0b2d4703b43 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:50.547883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e734f-d2c3-4f8b-86a0-f0b2d4703b43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:50.571939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:50.652676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e734f-d2c3-4f8b-86a0-f0b2d4703b43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:50.655036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e734f-d2c3-4f8b-86a0-f0b2d4703b43 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:50.662687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:50.678785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66eb13-4f71-4a73-93dc-8d200037d632 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:50.736083 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23438f1f-a63b-49c8-b219-4161c0bed476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:50.737716 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23438f1f-a63b-49c8-b219-4161c0bed476 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:50.738437 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23438f1f-a63b-49c8-b219-4161c0bed476 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:50.738883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23438f1f-a63b-49c8-b219-4161c0bed476 None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:50.740847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23438f1f-a63b-49c8-b219-4161c0bed476 None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:50.742889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23438f1f-a63b-49c8-b219-4161c0bed476 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:50.745378 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 47/90] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:36:50 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:50.746381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23438f1f-a63b-49c8-b219-4161c0bed476 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:50.785717 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 44/91] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:36:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:36:50.786859 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e734f-d2c3-4f8b-86a0-f0b2d4703b43 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:50.852976 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:50.910066 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23438f1f-a63b-49c8-b219-4161c0bed476 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:50.947025 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e734f-d2c3-4f8b-86a0-f0b2d4703b43 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:50.979018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb3d43-06aa-4ac5-836a-3714b8b34b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:50.979685 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb3d43-06aa-4ac5-836a-3714b8b34b7f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:50.979976 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb3d43-06aa-4ac5-836a-3714b8b34b7f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:50.980261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb3d43-06aa-4ac5-836a-3714b8b34b7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:51.014930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582976e-da1b-4e9d-8d23-b79855dbc8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:51.015678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582976e-da1b-4e9d-8d23-b79855dbc8b0 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:51.015986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582976e-da1b-4e9d-8d23-b79855dbc8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:51.016268 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582976e-da1b-4e9d-8d23-b79855dbc8b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:51.017155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582976e-da1b-4e9d-8d23-b79855dbc8b0 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=c4e4f97ef7884bcab434c35f9d529509, user.id=34ee4c4ab8ea4807905f919862ea9620) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:51.017474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582976e-da1b-4e9d-8d23-b79855dbc8b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:51.025936 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582976e-da1b-4e9d-8d23-b79855dbc8b0 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:51.035496 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 45/92] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:36:50 2022] GET /identity/v3/role_assignments?user.id=34ee4c4ab8ea4807905f919862ea9620&scope.project.id=c4e4f97ef7884bcab434c35f9d529509&role.id=6036efe96c1948fb98d01c8703a0561a => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:51.036162 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582976e-da1b-4e9d-8d23-b79855dbc8b0 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:51.039309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:51.153780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb3d43-06aa-4ac5-836a-3714b8b34b7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:51.155284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb3d43-06aa-4ac5-836a-3714b8b34b7f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:51.205290 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582976e-da1b-4e9d-8d23-b79855dbc8b0 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:51.230456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:51.257637 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512c017-5160-4a59-a098-6a159f617e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:51.258877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512c017-5160-4a59-a098-6a159f617e13 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:51.259354 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512c017-5160-4a59-a098-6a159f617e13 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:51.259815 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512c017-5160-4a59-a098-6a159f617e13 None admin] PATH_INFO: `/v3/projects/717478031d394496bdf1a87cb5deb235` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:51.261338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512c017-5160-4a59-a098-6a159f617e13 None admin] RBAC: Authorizing `identity:get_project(project_id=717478031d394496bdf1a87cb5deb235)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:51.265361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512c017-5160-4a59-a098-6a159f617e13 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:51.267391 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 46/93] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:36:51 2022] GET /identity/v3/projects/717478031d394496bdf1a87cb5deb235 => generated 312 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:51.273218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512c017-5160-4a59-a098-6a159f617e13 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:51.392331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 48/94] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:36:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:36:51.411546 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb3d43-06aa-4ac5-836a-3714b8b34b7f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:51.464408 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512c017-5160-4a59-a098-6a159f617e13 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:51.519208 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:51.531082 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e0e04-80b8-43e1-8acc-00f7f1119654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:51.531757 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e0e04-80b8-43e1-8acc-00f7f1119654 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:51.539371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e0e04-80b8-43e1-8acc-00f7f1119654 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:51.539371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e0e04-80b8-43e1-8acc-00f7f1119654 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:51.539371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e0e04-80b8-43e1-8acc-00f7f1119654 None admin] RBAC: Adding query filter params (role.id=4568d65f55c74c2bbc8265f34e62bbc4, scope.project.id=717478031d394496bdf1a87cb5deb235, user.id=6b3f273238ff429fb6fd5818edbed0d6) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:51.539371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e0e04-80b8-43e1-8acc-00f7f1119654 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:51.539371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e0e04-80b8-43e1-8acc-00f7f1119654 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:51.542447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 47/95] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:36:51 2022] GET /identity/v3/role_assignments?user.id=6b3f273238ff429fb6fd5818edbed0d6&scope.project.id=717478031d394496bdf1a87cb5deb235&role.id=4568d65f55c74c2bbc8265f34e62bbc4 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:51.573456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb3d43-06aa-4ac5-836a-3714b8b34b7f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:51.615592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52e887-543a-4443-8bc0-8ecb8ade2fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:51.616474 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52e887-543a-4443-8bc0-8ecb8ade2fae None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:51.616779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52e887-543a-4443-8bc0-8ecb8ade2fae None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:51.617057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52e887-543a-4443-8bc0-8ecb8ade2fae None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:51.618270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52e887-543a-4443-8bc0-8ecb8ade2fae None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:51.619727 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52e887-543a-4443-8bc0-8ecb8ade2fae None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:51.621448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 49/96] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:36:51 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:51.627730 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e0e04-80b8-43e1-8acc-00f7f1119654 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:51.690771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:51.765642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e0e04-80b8-43e1-8acc-00f7f1119654 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:51.818344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02246f-de2f-4ff3-a744-b5ec6933db02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:51.819033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02246f-de2f-4ff3-a744-b5ec6933db02 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:51.819350 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02246f-de2f-4ff3-a744-b5ec6933db02 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:51.819593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02246f-de2f-4ff3-a744-b5ec6933db02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:51.820460 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02246f-de2f-4ff3-a744-b5ec6933db02 None admin] RBAC: Adding query filter params (role.id=aef73ff3b03c4ad0878a0dbb33fc285c, scope.project.id=c4e4f97ef7884bcab434c35f9d529509, user.id=6b3f273238ff429fb6fd5818edbed0d6) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:51.820790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02246f-de2f-4ff3-a744-b5ec6933db02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:51.822248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02246f-de2f-4ff3-a744-b5ec6933db02 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:51.833251 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 48/97] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:36:51 2022] GET /identity/v3/role_assignments?user.id=6b3f273238ff429fb6fd5818edbed0d6&scope.project.id=c4e4f97ef7884bcab434c35f9d529509&role.id=aef73ff3b03c4ad0878a0dbb33fc285c => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:53.259542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b1e67-cb4a-4dc0-826f-85f7a5f1e920 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:53.260539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b1e67-cb4a-4dc0-826f-85f7a5f1e920 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:53.261031 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b1e67-cb4a-4dc0-826f-85f7a5f1e920 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:53.262621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 50/98] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:53.268059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785d74a-0063-4d49-8c67-30ed54563834 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:53.268509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785d74a-0063-4d49-8c67-30ed54563834 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:53.268749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785d74a-0063-4d49-8c67-30ed54563834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:53.285567 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-0785d74a-0063-4d49-8c67-30ed54563834 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:53.286836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-0785d74a-0063-4d49-8c67-30ed54563834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:53.359594 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 49/99] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:53.383176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b1e67-cb4a-4dc0-826f-85f7a5f1e920 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:53.400912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14052174-e2ad-4df3-aa3f-5366bbc94e6c None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:53.401205 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14052174-e2ad-4df3-aa3f-5366bbc94e6c None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:53.401490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14052174-e2ad-4df3-aa3f-5366bbc94e6c None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:53.402882 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 50/100] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:53.408061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22af14e-b1ff-453f-a2b0-51a28951099f None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:53.408367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22af14e-b1ff-453f-a2b0-51a28951099f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:53.408671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22af14e-b1ff-453f-a2b0-51a28951099f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:53.426551 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d22af14e-b1ff-453f-a2b0-51a28951099f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:53.427562 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d22af14e-b1ff-453f-a2b0-51a28951099f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:53.456625 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:53.513582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b1e67-cb4a-4dc0-826f-85f7a5f1e920 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:53.538000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 51/101] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:36:53.541886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:53.555169 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f0b49-6af5-4034-a76d-0aac71209ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:53.556243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f0b49-6af5-4034-a76d-0aac71209ff6 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:53.556717 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f0b49-6af5-4034-a76d-0aac71209ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:53.557152 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f0b49-6af5-4034-a76d-0aac71209ff6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:53.569447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22af14e-b1ff-453f-a2b0-51a28951099f None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:53.576521 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f0b49-6af5-4034-a76d-0aac71209ff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-169f0b49-6af5-4034-a76d-0aac71209ff6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:36:53.585814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:53.586697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:53.587445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:53.587445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:53.587445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:53.587445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:53.587445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:36:53.587445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:36:53.587445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:36:53.587445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:36:53.587445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:36:53.587445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:36:53.587445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:36:53.587445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:36:53.590093 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 51/102] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:36:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:36:53.597796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f0b49-6af5-4034-a76d-0aac71209ff6 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:53.701877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f0b49-6af5-4034-a76d-0aac71209ff6 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:53.742074 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636a8e1-c32b-4160-ab22-d22dd895d745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:53.743116 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636a8e1-c32b-4160-ab22-d22dd895d745 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:53.743592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636a8e1-c32b-4160-ab22-d22dd895d745 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:53.744081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636a8e1-c32b-4160-ab22-d22dd895d745 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:53.745065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636a8e1-c32b-4160-ab22-d22dd895d745 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:53.745578 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636a8e1-c32b-4160-ab22-d22dd895d745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:53.747152 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636a8e1-c32b-4160-ab22-d22dd895d745 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:53.756427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 52/103] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:36:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:53.765698 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636a8e1-c32b-4160-ab22-d22dd895d745 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:53.839035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22af14e-b1ff-453f-a2b0-51a28951099f None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:53.860291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:53.892046 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718dd26-7001-4a06-82b6-b599f8bace33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:53.892929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718dd26-7001-4a06-82b6-b599f8bace33 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:53.893213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718dd26-7001-4a06-82b6-b599f8bace33 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:53.893539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718dd26-7001-4a06-82b6-b599f8bace33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:53.908667 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718dd26-7001-4a06-82b6-b599f8bace33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-2718dd26-7001-4a06-82b6-b599f8bace33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:36:53.913585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:53.914446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:53.915201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:53.915201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:53.915201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:53.915201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:53.915201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:36:53.915201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:36:53.915201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:36:53.915201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:36:53.915201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:36:53.915201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:36:53.915201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:36:53.915201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:36:53.915201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 52/104] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:36:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:36:53.922359 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f5c68-7011-4e79-ba50-fbca0af1cf54 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:53.922929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f5c68-7011-4e79-ba50-fbca0af1cf54 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:53.923308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f5c68-7011-4e79-ba50-fbca0af1cf54 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:53.926842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 53/105] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:53.927955 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f5c68-7011-4e79-ba50-fbca0af1cf54 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:53.938871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636a8e1-c32b-4160-ab22-d22dd895d745 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:54.013973 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:54.024152 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4070dc-22d9-46d2-84f2-60c1388fd352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:54.025378 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4070dc-22d9-46d2-84f2-60c1388fd352 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:54.025861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4070dc-22d9-46d2-84f2-60c1388fd352 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:54.026374 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4070dc-22d9-46d2-84f2-60c1388fd352 None admin] PATH_INFO: `/v3/users/8534baf0e398469eafbea89867013cec` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:54.043392 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4070dc-22d9-46d2-84f2-60c1388fd352 None admin] RBAC: Authorizing `identity:get_user(user_id=8534baf0e398469eafbea89867013cec)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:54.045299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4070dc-22d9-46d2-84f2-60c1388fd352 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:54.047736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 53/106] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:36:53 2022] GET /identity/v3/users/8534baf0e398469eafbea89867013cec => generated 289 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:54.049470 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557cec9-8ec7-4133-abed-b24f08ffab80 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:54.049961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557cec9-8ec7-4133-abed-b24f08ffab80 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:54.050452 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557cec9-8ec7-4133-abed-b24f08ffab80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:54.068865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-c557cec9-8ec7-4133-abed-b24f08ffab80 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:54.070418 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-c557cec9-8ec7-4133-abed-b24f08ffab80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:54.096676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f5c68-7011-4e79-ba50-fbca0af1cf54 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:54.136062 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb80ccf-d4f7-4894-95e6-0b8209bc7bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:54.136814 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb80ccf-d4f7-4894-95e6-0b8209bc7bba None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:54.137360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb80ccf-d4f7-4894-95e6-0b8209bc7bba None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:54.137646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb80ccf-d4f7-4894-95e6-0b8209bc7bba None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:54.138462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb80ccf-d4f7-4894-95e6-0b8209bc7bba None admin] RBAC: Adding query filter params (name=member) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:54.138772 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb80ccf-d4f7-4894-95e6-0b8209bc7bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:54.141438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb80ccf-d4f7-4894-95e6-0b8209bc7bba None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:54.151892 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 54/107] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:36:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:54.153834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13ab5-6f42-4a66-b05d-b026fbb98828 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:54.154126 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13ab5-6f42-4a66-b05d-b026fbb98828 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:54.154407 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c13ab5-6f42-4a66-b05d-b026fbb98828 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:54.156771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 55/108] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:54.157934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c13ab5-6f42-4a66-b05d-b026fbb98828 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:54.166175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 54/109] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:54.167692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a959cb-0f7e-4fbf-8fb9-8c3711ed811e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:54.168790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a959cb-0f7e-4fbf-8fb9-8c3711ed811e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:54.169269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a959cb-0f7e-4fbf-8fb9-8c3711ed811e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:54.197305 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-64a959cb-0f7e-4fbf-8fb9-8c3711ed811e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:54.198523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-64a959cb-0f7e-4fbf-8fb9-8c3711ed811e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:54.242411 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:54.274247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:54.290847 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c13ab5-6f42-4a66-b05d-b026fbb98828 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:54.299983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 55/110] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:54.301048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a959cb-0f7e-4fbf-8fb9-8c3711ed811e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:54.331643 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db41849-2b2d-43f0-9081-efdcb9d3e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:54.332731 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db41849-2b2d-43f0-9081-efdcb9d3e62f None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:54.333269 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db41849-2b2d-43f0-9081-efdcb9d3e62f None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:54.333721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db41849-2b2d-43f0-9081-efdcb9d3e62f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:54.412218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db41849-2b2d-43f0-9081-efdcb9d3e62f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:54.414143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db41849-2b2d-43f0-9081-efdcb9d3e62f None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:54.428918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a959cb-0f7e-4fbf-8fb9-8c3711ed811e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:54.475690 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12be89d-4233-4f7c-b89f-958e560e054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:54.476819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12be89d-4233-4f7c-b89f-958e560e054c None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:54.478292 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12be89d-4233-4f7c-b89f-958e560e054c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:54.478766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12be89d-4233-4f7c-b89f-958e560e054c None admin] PATH_INFO: `/v3/users/6b3f273238ff429fb6fd5818edbed0d6` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:54.480852 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12be89d-4233-4f7c-b89f-958e560e054c None admin] RBAC: Authorizing `identity:get_user(user_id=6b3f273238ff429fb6fd5818edbed0d6)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:54.482595 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12be89d-4233-4f7c-b89f-958e560e054c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:54.484792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 56/111] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:36:54 2022] GET /identity/v3/users/6b3f273238ff429fb6fd5818edbed0d6 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:54.485757 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12be89d-4233-4f7c-b89f-958e560e054c None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:54.512968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:54.522754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:54.538551 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 56/112] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:36:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:36:54.538551 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db41849-2b2d-43f0-9081-efdcb9d3e62f None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:54.598264 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12be89d-4233-4f7c-b89f-958e560e054c None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:54.635722 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5787dfd-9844-4b3a-bbbe-1d8ac7d4aa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:54.636530 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5787dfd-9844-4b3a-bbbe-1d8ac7d4aa64 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:54.636846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5787dfd-9844-4b3a-bbbe-1d8ac7d4aa64 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:54.637126 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5787dfd-9844-4b3a-bbbe-1d8ac7d4aa64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:54.638301 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5787dfd-9844-4b3a-bbbe-1d8ac7d4aa64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:54.639773 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5787dfd-9844-4b3a-bbbe-1d8ac7d4aa64 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:54.645840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 57/113] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:36:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:54.645840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5787dfd-9844-4b3a-bbbe-1d8ac7d4aa64 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:54.652570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db41849-2b2d-43f0-9081-efdcb9d3e62f None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:54.691237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614044a9-ce68-4942-91e8-08dbce2afdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:54.692033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614044a9-ce68-4942-91e8-08dbce2afdc2 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:54.692318 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614044a9-ce68-4942-91e8-08dbce2afdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:54.692602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614044a9-ce68-4942-91e8-08dbce2afdc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:54.705123 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614044a9-ce68-4942-91e8-08dbce2afdc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-614044a9-ce68-4942-91e8-08dbce2afdc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:36:54.713378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:54.714237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:54.714998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:54.714998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:54.714998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:54.714998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:54.714998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:36:54.714998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:36:54.714998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:36:54.714998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:36:54.714998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:36:54.714998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:36:54.714998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:36:54.714998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:36:54.714998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 57/114] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:36:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:36:54.721429 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614044a9-ce68-4942-91e8-08dbce2afdc2 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:54.752251 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5787dfd-9844-4b3a-bbbe-1d8ac7d4aa64 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:54.754127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:54.770059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:54.791297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b4a6f-2eb9-48f4-b657-e1e1a3e41b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:54.792905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b4a6f-2eb9-48f4-b657-e1e1a3e41b0d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:54.793811 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b4a6f-2eb9-48f4-b657-e1e1a3e41b0d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:54.794461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b4a6f-2eb9-48f4-b657-e1e1a3e41b0d None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:54.795990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b4a6f-2eb9-48f4-b657-e1e1a3e41b0d None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:54.797503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b4a6f-2eb9-48f4-b657-e1e1a3e41b0d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:54.799220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 58/115] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:36:54 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:54.800411 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03289009-4bd2-45b6-b207-db7dd44def5d None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:54.802010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03289009-4bd2-45b6-b207-db7dd44def5d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:54.802010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03289009-4bd2-45b6-b207-db7dd44def5d None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:54.802410 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 59/116] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:54.802922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03289009-4bd2-45b6-b207-db7dd44def5d None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:54.835664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614044a9-ce68-4942-91e8-08dbce2afdc2 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:54.870541 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10426c7b-7728-4b74-9d09-2bb407c75093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:54.871629 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10426c7b-7728-4b74-9d09-2bb407c75093 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:54.871917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10426c7b-7728-4b74-9d09-2bb407c75093 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:54.872193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10426c7b-7728-4b74-9d09-2bb407c75093 None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:54.873440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10426c7b-7728-4b74-9d09-2bb407c75093 None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:54.875139 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10426c7b-7728-4b74-9d09-2bb407c75093 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:54.877033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 58/117] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:36:54 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:54.877624 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10426c7b-7728-4b74-9d09-2bb407c75093 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:54.926319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03289009-4bd2-45b6-b207-db7dd44def5d None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:54.961977 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab09095-fc9c-4c46-90c5-b7a02a139bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:54.963050 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab09095-fc9c-4c46-90c5-b7a02a139bbd None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:54.963451 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab09095-fc9c-4c46-90c5-b7a02a139bbd None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:54.963738 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab09095-fc9c-4c46-90c5-b7a02a139bbd None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:54.964458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab09095-fc9c-4c46-90c5-b7a02a139bbd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:54.965950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab09095-fc9c-4c46-90c5-b7a02a139bbd None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:54.987005 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10426c7b-7728-4b74-9d09-2bb407c75093 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:55.000932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:55.020372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4059752-9602-4e09-a69b-cc42c8ee84b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:55.021124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4059752-9602-4e09-a69b-cc42c8ee84b2 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:55.021414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4059752-9602-4e09-a69b-cc42c8ee84b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:55.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4059752-9602-4e09-a69b-cc42c8ee84b2 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:55.022477 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4059752-9602-4e09-a69b-cc42c8ee84b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:55.022788 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4059752-9602-4e09-a69b-cc42c8ee84b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:55.024157 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4059752-9602-4e09-a69b-cc42c8ee84b2 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:55.032398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 59/118] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:36:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:55.034263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4059752-9602-4e09-a69b-cc42c8ee84b2 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:55.045438 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 60/119] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Jun 27 14:36:54 2022] POST /identity/v3/projects => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:36:55.046911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4807b49-7a15-47fe-98ff-65a2b9a5e267 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:55.047312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4807b49-7a15-47fe-98ff-65a2b9a5e267 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:55.047606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4807b49-7a15-47fe-98ff-65a2b9a5e267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:55.066207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f4807b49-7a15-47fe-98ff-65a2b9a5e267 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:55.067459 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f4807b49-7a15-47fe-98ff-65a2b9a5e267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:55.092637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:55.149006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 61/120] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:55.149696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4807b49-7a15-47fe-98ff-65a2b9a5e267 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:55.174472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4059752-9602-4e09-a69b-cc42c8ee84b2 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:55.217023 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3637400-73cb-490f-b8fb-9d542738ba32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:55.218351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3637400-73cb-490f-b8fb-9d542738ba32 None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:55.218644 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3637400-73cb-490f-b8fb-9d542738ba32 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:55.218928 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3637400-73cb-490f-b8fb-9d542738ba32 None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509/users/6b3f273238ff429fb6fd5818edbed0d6/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:55.221118 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3637400-73cb-490f-b8fb-9d542738ba32 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4e4f97ef7884bcab434c35f9d529509, user_id=6b3f273238ff429fb6fd5818edbed0d6, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:55.222564 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3637400-73cb-490f-b8fb-9d542738ba32 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:55.260981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4807b49-7a15-47fe-98ff-65a2b9a5e267 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:55.279883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 60/121] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:36:55 2022] PUT /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509/users/6b3f273238ff429fb6fd5818edbed0d6/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:36:55.289351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0c1a1-763e-409b-b55c-9e94d6df1b93 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:55.289351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0c1a1-763e-409b-b55c-9e94d6df1b93 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:55.289351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0c1a1-763e-409b-b55c-9e94d6df1b93 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:55.289351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 61/122] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:55.289351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0c1a1-763e-409b-b55c-9e94d6df1b93 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:55.301949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046ec0f-2a1b-4887-bdcb-2fa326589d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:55.302640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046ec0f-2a1b-4887-bdcb-2fa326589d4f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:55.302971 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046ec0f-2a1b-4887-bdcb-2fa326589d4f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:55.303257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046ec0f-2a1b-4887-bdcb-2fa326589d4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:55.304426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046ec0f-2a1b-4887-bdcb-2fa326589d4f None admin] RBAC: Adding query filter params (role.id=0896209e464b4256b7999b25e1972696, scope.project.id=c4e4f97ef7884bcab434c35f9d529509, user.id=8534baf0e398469eafbea89867013cec) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:55.304820 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046ec0f-2a1b-4887-bdcb-2fa326589d4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:55.306544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046ec0f-2a1b-4887-bdcb-2fa326589d4f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:55.314903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 62/123] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:36:55 2022] GET /identity/v3/role_assignments?user.id=8534baf0e398469eafbea89867013cec&scope.project.id=c4e4f97ef7884bcab434c35f9d529509&role.id=0896209e464b4256b7999b25e1972696 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:55.315994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046ec0f-2a1b-4887-bdcb-2fa326589d4f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:55.339038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:55.343061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:55.436191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0c1a1-763e-409b-b55c-9e94d6df1b93 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:55.490785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046ec0f-2a1b-4887-bdcb-2fa326589d4f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:55.492212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a511d1-132e-4912-bc79-44eb2fdd5d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:55.493249 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a511d1-132e-4912-bc79-44eb2fdd5d0b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:55.493641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a511d1-132e-4912-bc79-44eb2fdd5d0b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:55.494256 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a511d1-132e-4912-bc79-44eb2fdd5d0b None admin] PATH_INFO: `/v3/users/34ee4c4ab8ea4807905f919862ea9620` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:55.497729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a511d1-132e-4912-bc79-44eb2fdd5d0b None admin] RBAC: Authorizing `identity:get_user(user_id=34ee4c4ab8ea4807905f919862ea9620)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:55.499561 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a511d1-132e-4912-bc79-44eb2fdd5d0b None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:55.501546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 62/124] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:36:55 2022] GET /identity/v3/users/34ee4c4ab8ea4807905f919862ea9620 => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:55.503575 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecaae4-d652-4f22-999a-a1f3507c88e0 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:55.503973 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecaae4-d652-4f22-999a-a1f3507c88e0 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:55.504414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecaae4-d652-4f22-999a-a1f3507c88e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:55.529983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-21ecaae4-d652-4f22-999a-a1f3507c88e0 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:55.532471 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-21ecaae4-d652-4f22-999a-a1f3507c88e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:55.539493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de4577-1cac-4342-9f4d-928888fcefa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:55.540570 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de4577-1cac-4342-9f4d-928888fcefa5 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:55.541069 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de4577-1cac-4342-9f4d-928888fcefa5 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:55.541488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de4577-1cac-4342-9f4d-928888fcefa5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:55.556139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de4577-1cac-4342-9f4d-928888fcefa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-55de4577-1cac-4342-9f4d-928888fcefa5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:36:55.565899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:55.567032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:55.567992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:55.567992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:55.567992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:55.567992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:55.567992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:36:55.567992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:36:55.567992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:36:55.567992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:36:55.567992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:36:55.567992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:36:55.567992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:36:55.567992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:36:55.570368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 63/125] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:36:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:36:55.571449 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de4577-1cac-4342-9f4d-928888fcefa5 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:55.612893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 63/126] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:55.613842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecaae4-d652-4f22-999a-a1f3507c88e0 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:55.650239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:55.673406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:55.714199 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de4577-1cac-4342-9f4d-928888fcefa5 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:55.746500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecaae4-d652-4f22-999a-a1f3507c88e0 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:55.785546 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588bb43-4bbd-46de-aa51-eac12b9ea0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:55.786707 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588bb43-4bbd-46de-aa51-eac12b9ea0ec None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:55.787159 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588bb43-4bbd-46de-aa51-eac12b9ea0ec None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:55.787581 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588bb43-4bbd-46de-aa51-eac12b9ea0ec None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:55.789098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588bb43-4bbd-46de-aa51-eac12b9ea0ec None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:55.790682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588bb43-4bbd-46de-aa51-eac12b9ea0ec None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:55.798598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 64/127] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:36:55 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:55.799434 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588bb43-4bbd-46de-aa51-eac12b9ea0ec None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:55.805093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffccd3-f523-4d66-85fc-f829822b345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:55.805953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffccd3-f523-4d66-85fc-f829822b345a None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:55.806432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffccd3-f523-4d66-85fc-f829822b345a None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:55.806855 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffccd3-f523-4d66-85fc-f829822b345a None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:55.807766 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ffccd3-f523-4d66-85fc-f829822b345a None admin] RBAC: Adding query filter params (name=member) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:55.808212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ffccd3-f523-4d66-85fc-f829822b345a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:55.809849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ffccd3-f523-4d66-85fc-f829822b345a None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:55.821700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 64/128] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:36:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:55.822749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffccd3-f523-4d66-85fc-f829822b345a None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:55.929855 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffccd3-f523-4d66-85fc-f829822b345a None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:55.932969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:55.967350 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c0189-8895-4b9e-9313-0d9126fe0e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:55.968320 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c0189-8895-4b9e-9313-0d9126fe0e60 None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:55.968715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c0189-8895-4b9e-9313-0d9126fe0e60 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:55.969002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c0189-8895-4b9e-9313-0d9126fe0e60 None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509/users/34ee4c4ab8ea4807905f919862ea9620/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:55.971002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c0189-8895-4b9e-9313-0d9126fe0e60 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4e4f97ef7884bcab434c35f9d529509, user_id=34ee4c4ab8ea4807905f919862ea9620, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:55.972443 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c0189-8895-4b9e-9313-0d9126fe0e60 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:56.008578 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588bb43-4bbd-46de-aa51-eac12b9ea0ec None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:56.043243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59d87d-a62e-41af-b9cc-8bfcf5b9f634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:56.044057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59d87d-a62e-41af-b9cc-8bfcf5b9f634 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:56.044391 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59d87d-a62e-41af-b9cc-8bfcf5b9f634 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:56.044694 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59d87d-a62e-41af-b9cc-8bfcf5b9f634 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:56.055560 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59d87d-a62e-41af-b9cc-8bfcf5b9f634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-fe59d87d-a62e-41af-b9cc-8bfcf5b9f634 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:36:56.065755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:56.066809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:56.067746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:56.067746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:56.067746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:56.067746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:56.067746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:36:56.067746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:36:56.067746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:36:56.067746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:36:56.067746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:36:56.067746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:36:56.067746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:36:56.067746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:36:56.067746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 65/129] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:36:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:36:56.067746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59d87d-a62e-41af-b9cc-8bfcf5b9f634 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:56.071243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:56.097233 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 65/130] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:36:55 2022] PUT /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509/users/34ee4c4ab8ea4807905f919862ea9620/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:36:56.098000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c0189-8895-4b9e-9313-0d9126fe0e60 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:56.270748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c0189-8895-4b9e-9313-0d9126fe0e60 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:56.278185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59d87d-a62e-41af-b9cc-8bfcf5b9f634 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:56.340240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c6276-7358-48f8-bd51-126b7a778070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:56.341088 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c6276-7358-48f8-bd51-126b7a778070 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:56.341381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c6276-7358-48f8-bd51-126b7a778070 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:56.341799 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c6276-7358-48f8-bd51-126b7a778070 None admin] PATH_INFO: `/v3/users/6b3f273238ff429fb6fd5818edbed0d6` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:56.345422 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c6276-7358-48f8-bd51-126b7a778070 None admin] RBAC: Authorizing `identity:get_user(user_id=6b3f273238ff429fb6fd5818edbed0d6)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:56.346896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c6276-7358-48f8-bd51-126b7a778070 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:56.348822 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 66/131] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:36:56 2022] GET /identity/v3/users/6b3f273238ff429fb6fd5818edbed0d6 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:56.350544 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2048583-61eb-4cc7-9905-b588003f63e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:56.351237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2048583-61eb-4cc7-9905-b588003f63e7 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:56.351526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2048583-61eb-4cc7-9905-b588003f63e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:56.351809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2048583-61eb-4cc7-9905-b588003f63e7 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:56.352581 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2048583-61eb-4cc7-9905-b588003f63e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:56.352926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2048583-61eb-4cc7-9905-b588003f63e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:56.354315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2048583-61eb-4cc7-9905-b588003f63e7 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:56.357147 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c6276-7358-48f8-bd51-126b7a778070 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:56.372240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 66/132] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:36:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:56.379666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2048583-61eb-4cc7-9905-b588003f63e7 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:56.413883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:56.454241 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:56.498164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c6276-7358-48f8-bd51-126b7a778070 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:56.554296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0cd3f-57a7-4d34-b06b-d3822b090c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:56.555171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0cd3f-57a7-4d34-b06b-d3822b090c44 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:56.555460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0cd3f-57a7-4d34-b06b-d3822b090c44 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:56.555743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0cd3f-57a7-4d34-b06b-d3822b090c44 None admin] PATH_INFO: `/v3/projects/717478031d394496bdf1a87cb5deb235` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:56.556995 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0cd3f-57a7-4d34-b06b-d3822b090c44 None admin] RBAC: Authorizing `identity:get_project(project_id=717478031d394496bdf1a87cb5deb235)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:56.558449 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0cd3f-57a7-4d34-b06b-d3822b090c44 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:56.560309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 67/133] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:36:56 2022] GET /identity/v3/projects/717478031d394496bdf1a87cb5deb235 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:56.567596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0cd3f-57a7-4d34-b06b-d3822b090c44 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:56.596729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2048583-61eb-4cc7-9905-b588003f63e7 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:56.678048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0cd3f-57a7-4d34-b06b-d3822b090c44 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:56.709921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b853e1-cd2f-4ce2-9eb5-df0e8ebceb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:56.710814 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b853e1-cd2f-4ce2-9eb5-df0e8ebceb8f None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:56.711099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b853e1-cd2f-4ce2-9eb5-df0e8ebceb8f None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:56.711378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b853e1-cd2f-4ce2-9eb5-df0e8ebceb8f None admin] PATH_INFO: `/v3/users/6b3f273238ff429fb6fd5818edbed0d6` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:56.712600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b853e1-cd2f-4ce2-9eb5-df0e8ebceb8f None admin] RBAC: Authorizing `identity:get_user(user_id=6b3f273238ff429fb6fd5818edbed0d6)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:56.714090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b853e1-cd2f-4ce2-9eb5-df0e8ebceb8f None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:56.715732 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 67/134] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:36:56 2022] GET /identity/v3/users/6b3f273238ff429fb6fd5818edbed0d6 => generated 275 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:56.721831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b853e1-cd2f-4ce2-9eb5-df0e8ebceb8f None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:56.729265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3f8a5-4ac0-4ad2-94f1-b143338fe7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:56.730162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f8a5-4ac0-4ad2-94f1-b143338fe7df None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:56.730451 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f8a5-4ac0-4ad2-94f1-b143338fe7df None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:56.730733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f8a5-4ac0-4ad2-94f1-b143338fe7df None admin] PATH_INFO: `/v3/projects/717478031d394496bdf1a87cb5deb235/users/6b3f273238ff429fb6fd5818edbed0d6/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:56.732783 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3f8a5-4ac0-4ad2-94f1-b143338fe7df None admin] RBAC: Authorizing `identity:create_grant(project_id=717478031d394496bdf1a87cb5deb235, user_id=6b3f273238ff429fb6fd5818edbed0d6, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:56.734871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3f8a5-4ac0-4ad2-94f1-b143338fe7df None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:56.813979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:56.822977 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 68/135] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:36:56 2022] PUT /identity/v3/projects/717478031d394496bdf1a87cb5deb235/users/6b3f273238ff429fb6fd5818edbed0d6/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:36:56.868211 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:56.893445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b853e1-cd2f-4ce2-9eb5-df0e8ebceb8f None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:56.949445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87085e3-1da5-4c9a-82ce-b072d2862515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:56.950575 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87085e3-1da5-4c9a-82ce-b072d2862515 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:56.950861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87085e3-1da5-4c9a-82ce-b072d2862515 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:56.951144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87085e3-1da5-4c9a-82ce-b072d2862515 None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:56.952402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87085e3-1da5-4c9a-82ce-b072d2862515 None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:56.953884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87085e3-1da5-4c9a-82ce-b072d2862515 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:56.955771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 68/136] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:36:56 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:56.961679 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3f8a5-4ac0-4ad2-94f1-b143338fe7df None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:57.090651 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3f8a5-4ac0-4ad2-94f1-b143338fe7df None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:57.127562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e60aae-47f9-4e8e-9257-69538c3b0e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:57.128388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e60aae-47f9-4e8e-9257-69538c3b0e4c None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:57.128691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e60aae-47f9-4e8e-9257-69538c3b0e4c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:57.128978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e60aae-47f9-4e8e-9257-69538c3b0e4c None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509/users/6b3f273238ff429fb6fd5818edbed0d6/roles/aef73ff3b03c4ad0878a0dbb33fc285c` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:57.131793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e60aae-47f9-4e8e-9257-69538c3b0e4c None admin] RBAC: Authorizing `identity:create_grant(project_id=c4e4f97ef7884bcab434c35f9d529509, user_id=6b3f273238ff429fb6fd5818edbed0d6, role_id=aef73ff3b03c4ad0878a0dbb33fc285c)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:57.133294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e60aae-47f9-4e8e-9257-69538c3b0e4c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:57.211874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 69/137] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:36:56 2022] PUT /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509/users/6b3f273238ff429fb6fd5818edbed0d6/roles/aef73ff3b03c4ad0878a0dbb33fc285c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:36:57.591862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d2022-48e8-4249-9591-cd9066bc4f1a None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:57.592396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d2022-48e8-4249-9591-cd9066bc4f1a None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:57.592470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d2022-48e8-4249-9591-cd9066bc4f1a None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:57.594172 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 69/138] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:57.599112 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efd0c6-fa8f-42f9-8034-cea4164ee426 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:57.599514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efd0c6-fa8f-42f9-8034-cea4164ee426 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:57.599678 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efd0c6-fa8f-42f9-8034-cea4164ee426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:57.626300 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-49efd0c6-fa8f-42f9-8034-cea4164ee426 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:57.627519 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-49efd0c6-fa8f-42f9-8034-cea4164ee426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:57.703761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:57.721652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 70/139] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:57.760424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d2022-48e8-4249-9591-cd9066bc4f1a None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:57.901442 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d2022-48e8-4249-9591-cd9066bc4f1a None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:57.943718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be2def-85b8-41c2-a323-e1e8b17c5732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:57.944920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be2def-85b8-41c2-a323-e1e8b17c5732 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:57.945407 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be2def-85b8-41c2-a323-e1e8b17c5732 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:57.945879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be2def-85b8-41c2-a323-e1e8b17c5732 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:57.947289 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be2def-85b8-41c2-a323-e1e8b17c5732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:57.949044 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be2def-85b8-41c2-a323-e1e8b17c5732 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:57.951150 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 70/140] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:36:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:57.957385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efd0c6-fa8f-42f9-8034-cea4164ee426 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:58.082914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efd0c6-fa8f-42f9-8034-cea4164ee426 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:58.124962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18307cb2-148a-48d4-a450-2c9490a1d1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:58.125648 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18307cb2-148a-48d4-a450-2c9490a1d1b2 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:58.125949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18307cb2-148a-48d4-a450-2c9490a1d1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:58.126229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18307cb2-148a-48d4-a450-2c9490a1d1b2 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:58.126956 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18307cb2-148a-48d4-a450-2c9490a1d1b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:58.128583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18307cb2-148a-48d4-a450-2c9490a1d1b2 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:58.286044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 71/141] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:36:57 2022] POST /identity/v3/users => generated 283 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:36:58.377513 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85898437-2eb9-4cb1-a0a0-52ad6b68f1c6 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:58.378186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85898437-2eb9-4cb1-a0a0-52ad6b68f1c6 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:58.378686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85898437-2eb9-4cb1-a0a0-52ad6b68f1c6 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:58.381503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 71/142] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:58.387652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7f723-1295-4e5a-b777-662b957dfabc None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:58.387652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7f723-1295-4e5a-b777-662b957dfabc None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:58.388280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7f723-1295-4e5a-b777-662b957dfabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:58.413697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-35a7f723-1295-4e5a-b777-662b957dfabc None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:58.414916 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-35a7f723-1295-4e5a-b777-662b957dfabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:58.478902 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:58.510589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 72/143] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:58.548835 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85898437-2eb9-4cb1-a0a0-52ad6b68f1c6 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:58.583312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:58.683658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85898437-2eb9-4cb1-a0a0-52ad6b68f1c6 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:58.728918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972d79a-ebab-489e-96db-51028a6e85b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:58.730090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972d79a-ebab-489e-96db-51028a6e85b5 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:58.730599 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972d79a-ebab-489e-96db-51028a6e85b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:58.731080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972d79a-ebab-489e-96db-51028a6e85b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:58.743692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972d79a-ebab-489e-96db-51028a6e85b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:36:58.747746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389f198-5cb9-402d-80a6-9b4f4a50d85b None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:58.748219 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389f198-5cb9-402d-80a6-9b4f4a50d85b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:58.748299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389f198-5cb9-402d-80a6-9b4f4a50d85b None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:58.750652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 73/144] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-7972d79a-ebab-489e-96db-51028a6e85b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:36:58.753849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:58.754737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:58.755530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:58.755530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:58.755530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:58.755530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:58.755530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:36:58.755530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:36:58.755530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:36:58.755530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:36:58.755530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:36:58.755530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:36:58.755530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:36:58.755530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:36:58.757931 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 72/145] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:36:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:36:58.762239 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2cd29-3f61-4e9d-9126-210cdeef6d22 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:58.762468 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2cd29-3f61-4e9d-9126-210cdeef6d22 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:58.765200 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2cd29-3f61-4e9d-9126-210cdeef6d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:58.766938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972d79a-ebab-489e-96db-51028a6e85b5 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:58.790667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-a8c2cd29-3f61-4e9d-9126-210cdeef6d22 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:58.791782 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-a8c2cd29-3f61-4e9d-9126-210cdeef6d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:58.873260 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:58.896097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972d79a-ebab-489e-96db-51028a6e85b5 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:58.942477 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797b80a-13dc-4b30-8186-2e8b3f9f503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:58.943532 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797b80a-13dc-4b30-8186-2e8b3f9f503d None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:58.945509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797b80a-13dc-4b30-8186-2e8b3f9f503d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:58.946024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797b80a-13dc-4b30-8186-2e8b3f9f503d None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:58.947003 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797b80a-13dc-4b30-8186-2e8b3f9f503d None admin] RBAC: Adding query filter params (name=reader) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:58.947876 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797b80a-13dc-4b30-8186-2e8b3f9f503d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:58.949900 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 74/146] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:36:58.951751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797b80a-13dc-4b30-8186-2e8b3f9f503d None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:58.965123 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 73/147] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:36:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:36:58.971304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2cd29-3f61-4e9d-9126-210cdeef6d22 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:59.034119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5521-df82-42e9-a35e-b8e09b4d69d9 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:59.034430 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5521-df82-42e9-a35e-b8e09b4d69d9 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:59.034690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5521-df82-42e9-a35e-b8e09b4d69d9 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:59.036054 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 74/148] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:36:59.040996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df895684-3629-4760-995f-9f033cecd161 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:59.041283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df895684-3629-4760-995f-9f033cecd161 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:59.041561 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df895684-3629-4760-995f-9f033cecd161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:59.063366 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-df895684-3629-4760-995f-9f033cecd161 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:36:59.064668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-df895684-3629-4760-995f-9f033cecd161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:36:59.119015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2cd29-3f61-4e9d-9126-210cdeef6d22 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:59.129817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:59.160133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa7021-b7cc-411e-8756-90542ff0335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:59.161054 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa7021-b7cc-411e-8756-90542ff0335c None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:59.161421 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa7021-b7cc-411e-8756-90542ff0335c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:59.161600 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa7021-b7cc-411e-8756-90542ff0335c None admin] PATH_INFO: `/v3/users/8534baf0e398469eafbea89867013cec` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:59.162004 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 75/149] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:36:59.163117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df895684-3629-4760-995f-9f033cecd161 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:59.169447 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa7021-b7cc-411e-8756-90542ff0335c None admin] RBAC: Authorizing `identity:get_user(user_id=8534baf0e398469eafbea89867013cec)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:59.171034 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa7021-b7cc-411e-8756-90542ff0335c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:59.172673 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 75/150] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:36:58 2022] GET /identity/v3/users/8534baf0e398469eafbea89867013cec => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:59.180785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa7021-b7cc-411e-8756-90542ff0335c None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:59.260599 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:59.295427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df895684-3629-4760-995f-9f033cecd161 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:59.308456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa7021-b7cc-411e-8756-90542ff0335c None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:59.343321 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d0f74-515c-492c-b66e-d880e36d0ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:59.344460 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d0f74-515c-492c-b66e-d880e36d0ae2 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:59.344893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d0f74-515c-492c-b66e-d880e36d0ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:59.345220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d0f74-515c-492c-b66e-d880e36d0ae2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:59.358329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb568d-1dbd-4ae3-9d09-caf399bc8e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:59.359433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb568d-1dbd-4ae3-9d09-caf399bc8e8c None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:59.359784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb568d-1dbd-4ae3-9d09-caf399bc8e8c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:59.360126 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb568d-1dbd-4ae3-9d09-caf399bc8e8c None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:59.361451 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb568d-1dbd-4ae3-9d09-caf399bc8e8c None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:59.362949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb568d-1dbd-4ae3-9d09-caf399bc8e8c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:59.364518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d0f74-515c-492c-b66e-d880e36d0ae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:36:59.364998 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 76/151] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:36:59 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:59.365834 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb568d-1dbd-4ae3-9d09-caf399bc8e8c None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-e29d0f74-515c-492c-b66e-d880e36d0ae2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:36:59.375807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:59.376702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:59.377492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:59.377492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:59.377492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:59.377492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:59.377492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:36:59.377492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:36:59.377492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:36:59.377492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:36:59.377492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:36:59.377492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:36:59.377492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:36:59.377492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:36:59.380062 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 76/152] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:36:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:36:59.381027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d0f74-515c-492c-b66e-d880e36d0ae2 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:59.419504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:59.483051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb568d-1dbd-4ae3-9d09-caf399bc8e8c None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:59.492805 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d0f74-515c-492c-b66e-d880e36d0ae2 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:59.521851 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81728572-7666-470f-abba-2ee2106d531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:59.522788 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81728572-7666-470f-abba-2ee2106d531e None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:59.523106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81728572-7666-470f-abba-2ee2106d531e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:59.523416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81728572-7666-470f-abba-2ee2106d531e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:59.533587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dea736-42c9-4628-975e-32a02dd9c341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:59.534822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea736-42c9-4628-975e-32a02dd9c341 None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:59.535003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81728572-7666-470f-abba-2ee2106d531e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:36:59.535478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea736-42c9-4628-975e-32a02dd9c341 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:59.535953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea736-42c9-4628-975e-32a02dd9c341 None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509/users/8534baf0e398469eafbea89867013cec/roles/0896209e464b4256b7999b25e1972696` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:59.538221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dea736-42c9-4628-975e-32a02dd9c341 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4e4f97ef7884bcab434c35f9d529509, user_id=8534baf0e398469eafbea89867013cec, role_id=0896209e464b4256b7999b25e1972696)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:59.539888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dea736-42c9-4628-975e-32a02dd9c341 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:59.542424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-81728572-7666-470f-abba-2ee2106d531e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:36:59.543970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:36:59.545014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:36:59.545903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:36:59.545903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:36:59.545903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:36:59.545903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:36:59.545903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:36:59.545903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:36:59.545903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:36:59.545903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:36:59.545903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:36:59.545903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:36:59.545903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:36:59.545903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:36:59.545903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 77/153] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:36:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:36:59.546543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81728572-7666-470f-abba-2ee2106d531e None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:59.622453 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 77/154] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:36:59 2022] PUT /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509/users/8534baf0e398469eafbea89867013cec/roles/0896209e464b4256b7999b25e1972696 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:36:59.624291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dea736-42c9-4628-975e-32a02dd9c341 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:59.730776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81728572-7666-470f-abba-2ee2106d531e None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:59.732559 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:36:59.819003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0f0b3-6337-4e28-9e83-1a8aa672fcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:59.819777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0f0b3-6337-4e28-9e83-1a8aa672fcde None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:59.820049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0f0b3-6337-4e28-9e83-1a8aa672fcde None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:59.820323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0f0b3-6337-4e28-9e83-1a8aa672fcde None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:59.821149 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0f0b3-6337-4e28-9e83-1a8aa672fcde None admin] RBAC: Adding query filter params (name=member) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:59.821455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0f0b3-6337-4e28-9e83-1a8aa672fcde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:59.823542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0f0b3-6337-4e28-9e83-1a8aa672fcde None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:59.838770 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 78/155] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:36:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:59.844065 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dea736-42c9-4628-975e-32a02dd9c341 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:36:59.845077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0f0b3-6337-4e28-9e83-1a8aa672fcde None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:59.918468 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bef69-97ac-4654-9d8e-d48ba8217cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:36:59.919172 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bef69-97ac-4654-9d8e-d48ba8217cdc None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:36:59.919465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bef69-97ac-4654-9d8e-d48ba8217cdc None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:36:59.919759 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bef69-97ac-4654-9d8e-d48ba8217cdc None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:36:59.920532 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655bef69-97ac-4654-9d8e-d48ba8217cdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:36:59.920903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655bef69-97ac-4654-9d8e-d48ba8217cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:36:59.922305 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655bef69-97ac-4654-9d8e-d48ba8217cdc None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:36:59.936629 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 78/156] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:36:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:36:59.945710 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bef69-97ac-4654-9d8e-d48ba8217cdc None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:36:59.979236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0f0b3-6337-4e28-9e83-1a8aa672fcde None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:00.018160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e02b9-cd32-4a83-9f07-2d2c22b23bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:00.018962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e02b9-cd32-4a83-9f07-2d2c22b23bc9 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:00.019243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e02b9-cd32-4a83-9f07-2d2c22b23bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:00.019516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e02b9-cd32-4a83-9f07-2d2c22b23bc9 None admin] PATH_INFO: `/v3/users/6b3f273238ff429fb6fd5818edbed0d6` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:00.021423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e02b9-cd32-4a83-9f07-2d2c22b23bc9 None admin] RBAC: Authorizing `identity:get_user(user_id=6b3f273238ff429fb6fd5818edbed0d6)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:00.022862 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e02b9-cd32-4a83-9f07-2d2c22b23bc9 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:00.024813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 79/157] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:36:59 2022] GET /identity/v3/users/6b3f273238ff429fb6fd5818edbed0d6 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:00.031022 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e02b9-cd32-4a83-9f07-2d2c22b23bc9 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:00.045075 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:00.076550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:00.105044 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bef69-97ac-4654-9d8e-d48ba8217cdc None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:00.141778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e02b9-cd32-4a83-9f07-2d2c22b23bc9 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:00.194612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66137e5-c39a-405d-ae61-ffbdbd06fec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:00.195380 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66137e5-c39a-405d-ae61-ffbdbd06fec3 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:00.195731 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66137e5-c39a-405d-ae61-ffbdbd06fec3 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:00.196071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66137e5-c39a-405d-ae61-ffbdbd06fec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:00.209364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba49c2e-a9cc-4998-b8a1-c69dba8b4e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:00.210519 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba49c2e-a9cc-4998-b8a1-c69dba8b4e26 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:00.211009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba49c2e-a9cc-4998-b8a1-c69dba8b4e26 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:00.211437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba49c2e-a9cc-4998-b8a1-c69dba8b4e26 None admin] PATH_INFO: `/v3/users/34ee4c4ab8ea4807905f919862ea9620` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:00.212899 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba49c2e-a9cc-4998-b8a1-c69dba8b4e26 None admin] RBAC: Authorizing `identity:get_user(user_id=34ee4c4ab8ea4807905f919862ea9620)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:00.214496 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba49c2e-a9cc-4998-b8a1-c69dba8b4e26 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:00.216337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 79/158] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:36:59 2022] GET /identity/v3/users/34ee4c4ab8ea4807905f919862ea9620 => generated 247 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:00.218464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a499d9-738b-4812-bdea-ff098cee54f4 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:00.218925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a499d9-738b-4812-bdea-ff098cee54f4 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:00.219390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a499d9-738b-4812-bdea-ff098cee54f4 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:00.225064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 80/159] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:00.230687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e2647-c331-4715-bcfa-426f3c827a90 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:00.231198 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e2647-c331-4715-bcfa-426f3c827a90 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:00.231667 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e2647-c331-4715-bcfa-426f3c827a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:00.289789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-7b7e2647-c331-4715-bcfa-426f3c827a90 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:00.291305 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7b7e2647-c331-4715-bcfa-426f3c827a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:00.298820 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66137e5-c39a-405d-ae61-ffbdbd06fec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:00.300355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66137e5-c39a-405d-ae61-ffbdbd06fec3 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:00.345145 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:00.412825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 80/160] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:00.413860 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66137e5-c39a-405d-ae61-ffbdbd06fec3 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:00.457541 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 81/161] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:37:00.458897 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516c8c1-6553-4fe0-bddc-b3c2f093b326 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:00.459186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516c8c1-6553-4fe0-bddc-b3c2f093b326 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:00.459467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516c8c1-6553-4fe0-bddc-b3c2f093b326 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:00.464814 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 82/162] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:00.465606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516c8c1-6553-4fe0-bddc-b3c2f093b326 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:00.571381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66137e5-c39a-405d-ae61-ffbdbd06fec3 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:00.588915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:00.613995 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:00.619245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3bb98-75ab-4bae-b0e1-b614440d3133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:00.619901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3bb98-75ab-4bae-b0e1-b614440d3133 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:00.620215 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3bb98-75ab-4bae-b0e1-b614440d3133 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:00.620491 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3bb98-75ab-4bae-b0e1-b614440d3133 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:00.693634 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3bb98-75ab-4bae-b0e1-b614440d3133 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:00.695148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3bb98-75ab-4bae-b0e1-b614440d3133 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:00.705354 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516c8c1-6553-4fe0-bddc-b3c2f093b326 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:00.797358 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15233493-86cd-47ad-b33b-0d17b492a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:00.798586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15233493-86cd-47ad-b33b-0d17b492a236 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:00.799105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15233493-86cd-47ad-b33b-0d17b492a236 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:00.799637 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15233493-86cd-47ad-b33b-0d17b492a236 None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:00.802010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 81/163] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:00.802707 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15233493-86cd-47ad-b33b-0d17b492a236 None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:00.803345 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df84dc2-7238-4b04-ac97-27eb77875abb None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:00.803674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df84dc2-7238-4b04-ac97-27eb77875abb None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:00.803950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df84dc2-7238-4b04-ac97-27eb77875abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:00.804994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15233493-86cd-47ad-b33b-0d17b492a236 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:00.806933 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 83/164] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:00 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:00.807901 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15233493-86cd-47ad-b33b-0d17b492a236 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:00.831632 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-1df84dc2-7238-4b04-ac97-27eb77875abb None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:00.832836 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-1df84dc2-7238-4b04-ac97-27eb77875abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:00.860890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:00.910548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 82/165] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:00.911748 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df84dc2-7238-4b04-ac97-27eb77875abb None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:01.017547 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df84dc2-7238-4b04-ac97-27eb77875abb None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:01.052508 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15233493-86cd-47ad-b33b-0d17b492a236 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:01.054207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545df5a4-7208-49e9-95b4-bdcc467ab295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:01.055073 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545df5a4-7208-49e9-95b4-bdcc467ab295 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:01.055561 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545df5a4-7208-49e9-95b4-bdcc467ab295 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:01.056020 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545df5a4-7208-49e9-95b4-bdcc467ab295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:01.057287 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545df5a4-7208-49e9-95b4-bdcc467ab295 None admin] RBAC: Adding query filter params (role.id=4568d65f55c74c2bbc8265f34e62bbc4, scope.project.id=c4e4f97ef7884bcab434c35f9d529509, user.id=6b3f273238ff429fb6fd5818edbed0d6) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:01.058009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545df5a4-7208-49e9-95b4-bdcc467ab295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:01.059645 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545df5a4-7208-49e9-95b4-bdcc467ab295 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:01.066717 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 83/166] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:00 2022] GET /identity/v3/role_assignments?user.id=6b3f273238ff429fb6fd5818edbed0d6&scope.project.id=c4e4f97ef7884bcab434c35f9d529509&role.id=4568d65f55c74c2bbc8265f34e62bbc4 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:01.067745 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545df5a4-7208-49e9-95b4-bdcc467ab295 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:01.098232 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:01.115986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:01.146754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2c1d6-84ff-4cb1-9cda-c6e89e3a42b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:01.147819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c1d6-84ff-4cb1-9cda-c6e89e3a42b6 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:01.148237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c1d6-84ff-4cb1-9cda-c6e89e3a42b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:01.150268 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c1d6-84ff-4cb1-9cda-c6e89e3a42b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:01.181388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545df5a4-7208-49e9-95b4-bdcc467ab295 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:01.182523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2c1d6-84ff-4cb1-9cda-c6e89e3a42b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-a6d2c1d6-84ff-4cb1-9cda-c6e89e3a42b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:01.196675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:01.197834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:01.199013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:01.199013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:01.199013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:01.199013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:01.199013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:01.199013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:01.199013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:01.199013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:01.199013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:01.199013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:01.199013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:01.199013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:01.201550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 84/167] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:37:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:01.203620 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2c1d6-84ff-4cb1-9cda-c6e89e3a42b6 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:01.227492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87d90a-17e2-4d49-9ddc-1b15e731c9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:01.228422 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87d90a-17e2-4d49-9ddc-1b15e731c9ec None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:01.228773 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87d90a-17e2-4d49-9ddc-1b15e731c9ec None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:01.229048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87d90a-17e2-4d49-9ddc-1b15e731c9ec None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:01.232139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87d90a-17e2-4d49-9ddc-1b15e731c9ec None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:01.233658 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87d90a-17e2-4d49-9ddc-1b15e731c9ec None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:01.235476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 84/168] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:01 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:01.236293 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87d90a-17e2-4d49-9ddc-1b15e731c9ec None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:01.342910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:01.350492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87d90a-17e2-4d49-9ddc-1b15e731c9ec None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:01.386848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf37047-afeb-4332-ae9f-781360d552b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:01.387520 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf37047-afeb-4332-ae9f-781360d552b7 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:01.387799 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf37047-afeb-4332-ae9f-781360d552b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:01.388071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf37047-afeb-4332-ae9f-781360d552b7 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:01.388903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf37047-afeb-4332-ae9f-781360d552b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:01.389209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf37047-afeb-4332-ae9f-781360d552b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:01.390899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf37047-afeb-4332-ae9f-781360d552b7 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:01.406081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 85/169] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:01.406983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf37047-afeb-4332-ae9f-781360d552b7 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:01.435058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2c1d6-84ff-4cb1-9cda-c6e89e3a42b6 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:01.499702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9f8bb-cc0e-4be9-9fd2-b7c3c80bee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:01.500525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9f8bb-cc0e-4be9-9fd2-b7c3c80bee60 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:01.500822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9f8bb-cc0e-4be9-9fd2-b7c3c80bee60 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:01.501091 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9f8bb-cc0e-4be9-9fd2-b7c3c80bee60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:01.521411 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9f8bb-cc0e-4be9-9fd2-b7c3c80bee60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-0bb9f8bb-cc0e-4be9-9fd2-b7c3c80bee60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:01.530636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:01.531661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:01.532463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:01.532463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:01.532463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:01.532463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:01.532463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:01.532463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:01.532463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:01.532463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:01.532463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:01.532463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:01.532463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:01.532463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:01.532463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 85/170] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:01.533168 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9f8bb-cc0e-4be9-9fd2-b7c3c80bee60 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:01.587838 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:01.626772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf37047-afeb-4332-ae9f-781360d552b7 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:01.663193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9f8bb-cc0e-4be9-9fd2-b7c3c80bee60 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:01.703147 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac5fe7-cc2a-402d-a163-1b2918cc86c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:01.704174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac5fe7-cc2a-402d-a163-1b2918cc86c2 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:01.704727 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac5fe7-cc2a-402d-a163-1b2918cc86c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:01.705338 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac5fe7-cc2a-402d-a163-1b2918cc86c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:01.707002 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac5fe7-cc2a-402d-a163-1b2918cc86c2 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=c4e4f97ef7884bcab434c35f9d529509, user.id=34ee4c4ab8ea4807905f919862ea9620) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:01.707711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac5fe7-cc2a-402d-a163-1b2918cc86c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:01.710019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac5fe7-cc2a-402d-a163-1b2918cc86c2 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:01.721275 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 86/171] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:01 2022] GET /identity/v3/role_assignments?user.id=34ee4c4ab8ea4807905f919862ea9620&scope.project.id=c4e4f97ef7884bcab434c35f9d529509&role.id=6036efe96c1948fb98d01c8703a0561a => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:01.723770 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac5fe7-cc2a-402d-a163-1b2918cc86c2 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:01.729917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16e42d-68e8-4310-b590-0ab4a5fe4f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:01.731169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16e42d-68e8-4310-b590-0ab4a5fe4f32 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:01.731656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16e42d-68e8-4310-b590-0ab4a5fe4f32 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:01.732131 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16e42d-68e8-4310-b590-0ab4a5fe4f32 None admin] PATH_INFO: `/v3/users/6b3f273238ff429fb6fd5818edbed0d6` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:01.735849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16e42d-68e8-4310-b590-0ab4a5fe4f32 None admin] RBAC: Authorizing `identity:get_user(user_id=6b3f273238ff429fb6fd5818edbed0d6)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:01.742776 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16e42d-68e8-4310-b590-0ab4a5fe4f32 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:01.744995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 86/172] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:01 2022] GET /identity/v3/users/6b3f273238ff429fb6fd5818edbed0d6 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:01.751294 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16e42d-68e8-4310-b590-0ab4a5fe4f32 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:01.775056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:01.940669 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16e42d-68e8-4310-b590-0ab4a5fe4f32 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:01.954409 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:01.993472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef4ba8-0e21-450d-bbe6-6d9d33cf9152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:01.994263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef4ba8-0e21-450d-bbe6-6d9d33cf9152 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:01.994551 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef4ba8-0e21-450d-bbe6-6d9d33cf9152 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:01.994834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef4ba8-0e21-450d-bbe6-6d9d33cf9152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:02.020471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac5fe7-cc2a-402d-a163-1b2918cc86c2 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:02.085538 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6ee73-df0b-42f5-b2ba-2d804861b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:02.086563 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6ee73-df0b-42f5-b2ba-2d804861b9ff None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:02.087042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6ee73-df0b-42f5-b2ba-2d804861b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:02.087511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6ee73-df0b-42f5-b2ba-2d804861b9ff None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:02.088488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6ee73-df0b-42f5-b2ba-2d804861b9ff None admin] RBAC: Adding query filter params (name=member) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:02.089010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6ee73-df0b-42f5-b2ba-2d804861b9ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:02.090584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6ee73-df0b-42f5-b2ba-2d804861b9ff None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:02.092636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef4ba8-0e21-450d-bbe6-6d9d33cf9152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:02.098237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef4ba8-0e21-450d-bbe6-6d9d33cf9152 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:02.102364 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 87/173] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:02.108867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6ee73-df0b-42f5-b2ba-2d804861b9ff None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:02.208388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 87/174] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:02.213580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef4ba8-0e21-450d-bbe6-6d9d33cf9152 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:02.232709 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:02.244465 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:02.278552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6ee73-df0b-42f5-b2ba-2d804861b9ff None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:02.339872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803e8dc-d628-4aba-a9dc-1efdd304c0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:02.341150 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803e8dc-d628-4aba-a9dc-1efdd304c0da None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:02.342656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803e8dc-d628-4aba-a9dc-1efdd304c0da None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:02.343394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803e8dc-d628-4aba-a9dc-1efdd304c0da None admin] PATH_INFO: `/v3/users/6b3f273238ff429fb6fd5818edbed0d6` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:02.345953 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803e8dc-d628-4aba-a9dc-1efdd304c0da None admin] RBAC: Authorizing `identity:get_user(user_id=6b3f273238ff429fb6fd5818edbed0d6)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:02.347792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803e8dc-d628-4aba-a9dc-1efdd304c0da None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:02.351006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 88/175] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:02 2022] GET /identity/v3/users/6b3f273238ff429fb6fd5818edbed0d6 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:02.359522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803e8dc-d628-4aba-a9dc-1efdd304c0da None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:02.425470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef4ba8-0e21-450d-bbe6-6d9d33cf9152 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:02.507160 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00665006-68bb-445b-b8b1-7a91a0537937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:02.509137 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00665006-68bb-445b-b8b1-7a91a0537937 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:02.510155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00665006-68bb-445b-b8b1-7a91a0537937 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:02.510785 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00665006-68bb-445b-b8b1-7a91a0537937 None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:02.515018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00665006-68bb-445b-b8b1-7a91a0537937 None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:02.517037 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00665006-68bb-445b-b8b1-7a91a0537937 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:02.519978 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 88/176] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:02 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:02.526225 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00665006-68bb-445b-b8b1-7a91a0537937 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:02.597893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803e8dc-d628-4aba-a9dc-1efdd304c0da None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:02.686417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249063f-43df-443c-9ce6-1a98c492d9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:02.687660 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:02.688764 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249063f-43df-443c-9ce6-1a98c492d9ad None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:02.689252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249063f-43df-443c-9ce6-1a98c492d9ad None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:02.689739 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249063f-43df-443c-9ce6-1a98c492d9ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:02.709795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00665006-68bb-445b-b8b1-7a91a0537937 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:02.737348 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:02.747887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91be41-5b52-4d71-a525-c32d6726e6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:02.748546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91be41-5b52-4d71-a525-c32d6726e6d3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:02.749033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91be41-5b52-4d71-a525-c32d6726e6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:02.749316 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91be41-5b52-4d71-a525-c32d6726e6d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:02.750161 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91be41-5b52-4d71-a525-c32d6726e6d3 None admin] RBAC: Adding query filter params (role.id=aef73ff3b03c4ad0878a0dbb33fc285c, scope.project.id=c4e4f97ef7884bcab434c35f9d529509, user.id=6b3f273238ff429fb6fd5818edbed0d6) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:02.750470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91be41-5b52-4d71-a525-c32d6726e6d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:02.753374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91be41-5b52-4d71-a525-c32d6726e6d3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:02.765128 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 89/177] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:02 2022] GET /identity/v3/role_assignments?user.id=6b3f273238ff429fb6fd5818edbed0d6&scope.project.id=c4e4f97ef7884bcab434c35f9d529509&role.id=aef73ff3b03c4ad0878a0dbb33fc285c => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:02.766329 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2397c-f870-4216-8701-9ec287c5be06 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:02.766611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2397c-f870-4216-8701-9ec287c5be06 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:02.771542 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2397c-f870-4216-8701-9ec287c5be06 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:02.773051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 90/178] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:02.782789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a29e9-fd05-417c-9ad1-0dbd08a69ae9 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:02.783097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a29e9-fd05-417c-9ad1-0dbd08a69ae9 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:02.783337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a29e9-fd05-417c-9ad1-0dbd08a69ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:02.814027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-2e7a29e9-fd05-417c-9ad1-0dbd08a69ae9 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:02.815243 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2e7a29e9-fd05-417c-9ad1-0dbd08a69ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:02.849753 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249063f-43df-443c-9ce6-1a98c492d9ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:02.851228 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249063f-43df-443c-9ce6-1a98c492d9ad None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:02.895316 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 91/179] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:02.919392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a29e9-fd05-417c-9ad1-0dbd08a69ae9 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:02.997039 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:03.031765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a29e9-fd05-417c-9ad1-0dbd08a69ae9 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:03.071194 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d605a-cabc-4f86-bdfd-2f3a1e5afa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:03.072004 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d605a-cabc-4f86-bdfd-2f3a1e5afa96 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:03.072290 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d605a-cabc-4f86-bdfd-2f3a1e5afa96 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:03.072567 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d605a-cabc-4f86-bdfd-2f3a1e5afa96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:03.090221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d605a-cabc-4f86-bdfd-2f3a1e5afa96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:03.096393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 89/180] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:03.097859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520965d-8589-4284-b747-9dee254e32d8 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:03.098150 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520965d-8589-4284-b747-9dee254e32d8 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:03.098428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520965d-8589-4284-b747-9dee254e32d8 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:03.099804 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 90/181] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:03.105172 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0a3c0-ed32-4518-851a-3c63bd686579 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:03.105539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0a3c0-ed32-4518-851a-3c63bd686579 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:03.105734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0a3c0-ed32-4518-851a-3c63bd686579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-fe1d605a-cabc-4f86-bdfd-2f3a1e5afa96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:03.111134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:03.112553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:03.113419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:03.113419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:03.113419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:03.113419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:03.113419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:03.113419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:03.113419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:03.113419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:03.113419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:03.113419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:03.113419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:37:03.113419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:03.114040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 92/182] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:37:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:03.114787 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d605a-cabc-4f86-bdfd-2f3a1e5afa96 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:03.133548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b6b0a3c0-ed32-4518-851a-3c63bd686579 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:03.135133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b6b0a3c0-ed32-4518-851a-3c63bd686579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:03.228143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 91/183] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:37:03.229035 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0a3c0-ed32-4518-851a-3c63bd686579 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:03.232965 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:03.251456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d605a-cabc-4f86-bdfd-2f3a1e5afa96 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:03.296592 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:03.301271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c6a9f-7fa1-4ceb-9a00-80587c8f48bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:03.302145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c6a9f-7fa1-4ceb-9a00-80587c8f48bc None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:03.302436 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c6a9f-7fa1-4ceb-9a00-80587c8f48bc None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:03.302781 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c6a9f-7fa1-4ceb-9a00-80587c8f48bc None admin] PATH_INFO: `/v3/projects/717478031d394496bdf1a87cb5deb235` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:03.304007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c6a9f-7fa1-4ceb-9a00-80587c8f48bc None admin] RBAC: Authorizing `identity:get_project(project_id=717478031d394496bdf1a87cb5deb235)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:03.305482 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c6a9f-7fa1-4ceb-9a00-80587c8f48bc None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:03.307360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 93/184] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:03 2022] GET /identity/v3/projects/717478031d394496bdf1a87cb5deb235 => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:03.308546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172bc88-bc6e-4c53-a7b9-f32b99b644eb None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:03.314437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172bc88-bc6e-4c53-a7b9-f32b99b644eb None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:03.314437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172bc88-bc6e-4c53-a7b9-f32b99b644eb None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:03.314437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 94/185] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:03.314437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172bc88-bc6e-4c53-a7b9-f32b99b644eb None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:03.358691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0a3c0-ed32-4518-851a-3c63bd686579 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:03.392394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f6399-2eff-4ef5-8ce0-033962239150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:03.393092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f6399-2eff-4ef5-8ce0-033962239150 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:03.393374 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f6399-2eff-4ef5-8ce0-033962239150 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:03.393648 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f6399-2eff-4ef5-8ce0-033962239150 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:03.394402 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f6399-2eff-4ef5-8ce0-033962239150 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:03.394711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f6399-2eff-4ef5-8ce0-033962239150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:03.396077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f6399-2eff-4ef5-8ce0-033962239150 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:03.404086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 92/186] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:03.405435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f6399-2eff-4ef5-8ce0-033962239150 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:03.437546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172bc88-bc6e-4c53-a7b9-f32b99b644eb None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:03.451305 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:03.472738 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a952f99-c5ab-49c0-82b1-e22b1fbf240b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:03.473538 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a952f99-c5ab-49c0-82b1-e22b1fbf240b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:03.473821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a952f99-c5ab-49c0-82b1-e22b1fbf240b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:03.474096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a952f99-c5ab-49c0-82b1-e22b1fbf240b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:03.485254 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a952f99-c5ab-49c0-82b1-e22b1fbf240b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-1a952f99-c5ab-49c0-82b1-e22b1fbf240b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:03.493189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:03.494031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:03.494923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:03.494923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:03.494923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:03.494923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:03.494923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:03.494923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:03.494923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:03.494923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:03.494923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:03.494923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:03.494923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:03.494923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:03.494923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 95/187] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:37:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:03.495573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3c775-132f-44d2-a4f3-3155d1847e13 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:03.496361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3c775-132f-44d2-a4f3-3155d1847e13 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:03.496361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3c775-132f-44d2-a4f3-3155d1847e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:03.512349 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-80c3c775-132f-44d2-a4f3-3155d1847e13 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:03.513570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-80c3c775-132f-44d2-a4f3-3155d1847e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:03.513931 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f6399-2eff-4ef5-8ce0-033962239150 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:03.547502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f08c9-1171-4dfd-b1a6-a8ac1be60edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:03.548083 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f08c9-1171-4dfd-b1a6-a8ac1be60edf None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:03.548368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f08c9-1171-4dfd-b1a6-a8ac1be60edf None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:03.548658 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f08c9-1171-4dfd-b1a6-a8ac1be60edf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:03.549498 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f08c9-1171-4dfd-b1a6-a8ac1be60edf None admin] RBAC: Adding query filter params (role.id=4568d65f55c74c2bbc8265f34e62bbc4, scope.project.id=717478031d394496bdf1a87cb5deb235, user.id=6b3f273238ff429fb6fd5818edbed0d6) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:03.549809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f08c9-1171-4dfd-b1a6-a8ac1be60edf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:03.551245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f08c9-1171-4dfd-b1a6-a8ac1be60edf None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:03.557237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 93/188] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:03 2022] GET /identity/v3/role_assignments?user.id=6b3f273238ff429fb6fd5818edbed0d6&scope.project.id=717478031d394496bdf1a87cb5deb235&role.id=4568d65f55c74c2bbc8265f34e62bbc4 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:03.558016 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f08c9-1171-4dfd-b1a6-a8ac1be60edf None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:03.584945 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:03.597493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 96/189] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:03.599087 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946ac93-8372-470c-b0e0-38496f049d56 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:03.599403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946ac93-8372-470c-b0e0-38496f049d56 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:03.599706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946ac93-8372-470c-b0e0-38496f049d56 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:03.605026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 97/190] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:03.605026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946ac93-8372-470c-b0e0-38496f049d56 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:03.686280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f08c9-1171-4dfd-b1a6-a8ac1be60edf None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:03.694477 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:03.725010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946ac93-8372-470c-b0e0-38496f049d56 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:03.726893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b31c9e-1dd9-4674-8b19-13a2fc7587f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:03.728278 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b31c9e-1dd9-4674-8b19-13a2fc7587f5 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:03.728278 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b31c9e-1dd9-4674-8b19-13a2fc7587f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:03.728278 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b31c9e-1dd9-4674-8b19-13a2fc7587f5 None admin] PATH_INFO: `/v3/users/1711957004914be3af45e903eaa025c1` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:03.747776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b31c9e-1dd9-4674-8b19-13a2fc7587f5 None admin] RBAC: Authorizing `identity:get_user(user_id=1711957004914be3af45e903eaa025c1)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:03.747776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b31c9e-1dd9-4674-8b19-13a2fc7587f5 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:03.749475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 94/191] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:03 2022] GET /identity/v3/users/1711957004914be3af45e903eaa025c1 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:03.750482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714831d-a3ea-4a82-8362-8c8c3a07fd8e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:03.750766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714831d-a3ea-4a82-8362-8c8c3a07fd8e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:03.751042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714831d-a3ea-4a82-8362-8c8c3a07fd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:03.766655 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173869af-8a4f-4d64-b15a-c4fd12f99722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:03.767328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173869af-8a4f-4d64-b15a-c4fd12f99722 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:03.767612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173869af-8a4f-4d64-b15a-c4fd12f99722 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:03.767888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173869af-8a4f-4d64-b15a-c4fd12f99722 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:03.768667 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173869af-8a4f-4d64-b15a-c4fd12f99722 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:03.769037 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-0714831d-a3ea-4a82-8362-8c8c3a07fd8e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:03.769976 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173869af-8a4f-4d64-b15a-c4fd12f99722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:03.770229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0714831d-a3ea-4a82-8362-8c8c3a07fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:03.771354 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173869af-8a4f-4d64-b15a-c4fd12f99722 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:03.780773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 98/192] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:03.781459 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173869af-8a4f-4d64-b15a-c4fd12f99722 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:03.833447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:03.847250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 95/193] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:03.848323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714831d-a3ea-4a82-8362-8c8c3a07fd8e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:03.883809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173869af-8a4f-4d64-b15a-c4fd12f99722 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:03.918010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aaba1f-7a70-4851-bae1-89c64e6dd526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:03.918794 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaba1f-7a70-4851-bae1-89c64e6dd526 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:03.919075 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaba1f-7a70-4851-bae1-89c64e6dd526 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:03.919351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaba1f-7a70-4851-bae1-89c64e6dd526 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:03.920769 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aaba1f-7a70-4851-bae1-89c64e6dd526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:03.922300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aaba1f-7a70-4851-bae1-89c64e6dd526 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:03.923913 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 99/194] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:03.924687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aaba1f-7a70-4851-bae1-89c64e6dd526 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:03.941117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:03.947577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714831d-a3ea-4a82-8362-8c8c3a07fd8e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:03.981559 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89996719-f710-4ce4-bd87-036dbdb05c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:03.982206 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89996719-f710-4ce4-bd87-036dbdb05c58 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:03.982489 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89996719-f710-4ce4-bd87-036dbdb05c58 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:03.982770 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89996719-f710-4ce4-bd87-036dbdb05c58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:04.023377 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aaba1f-7a70-4851-bae1-89c64e6dd526 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:04.041998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:04.049790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89996719-f710-4ce4-bd87-036dbdb05c58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:04.051224 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89996719-f710-4ce4-bd87-036dbdb05c58 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:04.056312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa670760-063e-4be8-9a27-24249ace38a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:04.056312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa670760-063e-4be8-9a27-24249ace38a2 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:04.056509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa670760-063e-4be8-9a27-24249ace38a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:04.056820 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa670760-063e-4be8-9a27-24249ace38a2 None admin] PATH_INFO: `/v3/users/1711957004914be3af45e903eaa025c1` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:04.058009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa670760-063e-4be8-9a27-24249ace38a2 None admin] RBAC: Authorizing `identity:get_user(user_id=1711957004914be3af45e903eaa025c1)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:04.059421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa670760-063e-4be8-9a27-24249ace38a2 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:04.061610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 100/195] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:03 2022] GET /identity/v3/users/1711957004914be3af45e903eaa025c1 => generated 283 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:04.062351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa670760-063e-4be8-9a27-24249ace38a2 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:04.150635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:04.158431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 96/196] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:04.159220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89996719-f710-4ce4-bd87-036dbdb05c58 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:04.164989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa670760-063e-4be8-9a27-24249ace38a2 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:04.198283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4743fb-de84-4b6d-a55c-2ac164a30374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:04.199066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4743fb-de84-4b6d-a55c-2ac164a30374 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:04.199348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4743fb-de84-4b6d-a55c-2ac164a30374 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:04.199622 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4743fb-de84-4b6d-a55c-2ac164a30374 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:04.209831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4743fb-de84-4b6d-a55c-2ac164a30374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-6c4743fb-de84-4b6d-a55c-2ac164a30374 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:04.217917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:04.218844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:04.219645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:04.219645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:04.219645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:04.219645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:04.219645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:04.219645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:04.219645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:04.219645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:04.219645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:04.219645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:04.219645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:37:04.219645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:04.219645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 101/197] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:04.220300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4743fb-de84-4b6d-a55c-2ac164a30374 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:04.259549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89996719-f710-4ce4-bd87-036dbdb05c58 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:04.268899 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:04.292473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2af1a-1420-4f81-a668-8eb80205f522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:04.293162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2af1a-1420-4f81-a668-8eb80205f522 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:04.293444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2af1a-1420-4f81-a668-8eb80205f522 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:04.293717 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2af1a-1420-4f81-a668-8eb80205f522 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:04.294422 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2af1a-1420-4f81-a668-8eb80205f522 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:04.296492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2af1a-1420-4f81-a668-8eb80205f522 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:04.319676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4743fb-de84-4b6d-a55c-2ac164a30374 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:04.353196 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36626e-e459-4ce1-86cf-7f7b5784ced7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:04.353839 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36626e-e459-4ce1-86cf-7f7b5784ced7 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:04.354118 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36626e-e459-4ce1-86cf-7f7b5784ced7 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:04.354395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36626e-e459-4ce1-86cf-7f7b5784ced7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:04.384637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 97/198] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:37:04 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:37:04.398056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2af1a-1420-4f81-a668-8eb80205f522 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:04.428077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36626e-e459-4ce1-86cf-7f7b5784ced7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:04.429600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36626e-e459-4ce1-86cf-7f7b5784ced7 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:04.461159 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:04.485866 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:04.513809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2af1a-1420-4f81-a668-8eb80205f522 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:04.544449 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 102/199] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:04.545353 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36626e-e459-4ce1-86cf-7f7b5784ced7 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:04.554764 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e275c1-afcc-4d02-8a65-3d52ef06d2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:04.556233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e275c1-afcc-4d02-8a65-3d52ef06d2a9 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:04.556752 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e275c1-afcc-4d02-8a65-3d52ef06d2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:04.557182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e275c1-afcc-4d02-8a65-3d52ef06d2a9 None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:04.558400 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e275c1-afcc-4d02-8a65-3d52ef06d2a9 None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:04.559853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e275c1-afcc-4d02-8a65-3d52ef06d2a9 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:04.562157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 98/200] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:04 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:04.562488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e275c1-afcc-4d02-8a65-3d52ef06d2a9 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:04.676779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36626e-e459-4ce1-86cf-7f7b5784ced7 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:04.697174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e275c1-afcc-4d02-8a65-3d52ef06d2a9 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:04.716920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c9f78-97ed-46ad-ba96-e7296e2b53ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:04.718245 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c9f78-97ed-46ad-ba96-e7296e2b53ed None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:04.718527 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c9f78-97ed-46ad-ba96-e7296e2b53ed None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:04.718804 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c9f78-97ed-46ad-ba96-e7296e2b53ed None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:04.719561 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c9f78-97ed-46ad-ba96-e7296e2b53ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:04.719865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c9f78-97ed-46ad-ba96-e7296e2b53ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:04.721278 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c9f78-97ed-46ad-ba96-e7296e2b53ed None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:04.722177 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:04.733071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 103/201] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:04.734428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c9f78-97ed-46ad-ba96-e7296e2b53ed None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:04.740974 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ccc72-1438-4c16-bd1b-b9db48cf9ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:04.741847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ccc72-1438-4c16-bd1b-b9db48cf9ca7 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:04.742135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ccc72-1438-4c16-bd1b-b9db48cf9ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:04.742423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ccc72-1438-4c16-bd1b-b9db48cf9ca7 None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:04.743628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ccc72-1438-4c16-bd1b-b9db48cf9ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:04.745106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ccc72-1438-4c16-bd1b-b9db48cf9ca7 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:04.747119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 99/202] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:04 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:04.748049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ccc72-1438-4c16-bd1b-b9db48cf9ca7 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:04.755977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:04.851779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c9f78-97ed-46ad-ba96-e7296e2b53ed None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:04.863924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ccc72-1438-4c16-bd1b-b9db48cf9ca7 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:04.891269 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075228d-6646-4ac2-a203-56086ec18a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:04.892192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075228d-6646-4ac2-a203-56086ec18a1d None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:04.892477 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075228d-6646-4ac2-a203-56086ec18a1d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:04.892779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075228d-6646-4ac2-a203-56086ec18a1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:04.893791 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075228d-6646-4ac2-a203-56086ec18a1d None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=292b6b0d819648b58526d1dda82420c3, user.id=1711957004914be3af45e903eaa025c1) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:04.894425 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075228d-6646-4ac2-a203-56086ec18a1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:04.896113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075228d-6646-4ac2-a203-56086ec18a1d None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:04.902224 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23c695-f014-483c-94b3-7673d0a78151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:04.903232 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23c695-f014-483c-94b3-7673d0a78151 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:04.903402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 104/203] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:04 2022] GET /identity/v3/role_assignments?user.id=1711957004914be3af45e903eaa025c1&scope.project.id=292b6b0d819648b58526d1dda82420c3&role.id=6036efe96c1948fb98d01c8703a0561a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:04.904221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075228d-6646-4ac2-a203-56086ec18a1d None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:04.909067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23c695-f014-483c-94b3-7673d0a78151 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:04.909502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23c695-f014-483c-94b3-7673d0a78151 None admin] PATH_INFO: `/v3/users/8534baf0e398469eafbea89867013cec` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:04.914545 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23c695-f014-483c-94b3-7673d0a78151 None admin] RBAC: Authorizing `identity:get_user(user_id=8534baf0e398469eafbea89867013cec)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:04.916256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23c695-f014-483c-94b3-7673d0a78151 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:04.918853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 100/204] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:04 2022] GET /identity/v3/users/8534baf0e398469eafbea89867013cec => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:04.924630 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23c695-f014-483c-94b3-7673d0a78151 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:05.041129 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:05.067736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23c695-f014-483c-94b3-7673d0a78151 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:05.097780 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:05.126409 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075228d-6646-4ac2-a203-56086ec18a1d None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:05.143880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e616b-bfb3-480b-bf8a-6e139a9d49e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:05.144543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e616b-bfb3-480b-bf8a-6e139a9d49e6 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:05.144861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e616b-bfb3-480b-bf8a-6e139a9d49e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:05.146930 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e616b-bfb3-480b-bf8a-6e139a9d49e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:05.191638 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8072a24-d38f-4fd6-9569-cf8060d20e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:05.192308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8072a24-d38f-4fd6-9569-cf8060d20e56 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:05.192583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8072a24-d38f-4fd6-9569-cf8060d20e56 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:05.192889 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8072a24-d38f-4fd6-9569-cf8060d20e56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:05.193734 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8072a24-d38f-4fd6-9569-cf8060d20e56 None admin] RBAC: Adding query filter params (role.id=aef73ff3b03c4ad0878a0dbb33fc285c, scope.project.id=292b6b0d819648b58526d1dda82420c3, user.id=1711957004914be3af45e903eaa025c1) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:05.194050 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8072a24-d38f-4fd6-9569-cf8060d20e56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:05.195486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8072a24-d38f-4fd6-9569-cf8060d20e56 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:05.210467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 105/205] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:04 2022] GET /identity/v3/role_assignments?user.id=1711957004914be3af45e903eaa025c1&scope.project.id=292b6b0d819648b58526d1dda82420c3&role.id=aef73ff3b03c4ad0878a0dbb33fc285c => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:05.272596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e616b-bfb3-480b-bf8a-6e139a9d49e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:05.274105 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e616b-bfb3-480b-bf8a-6e139a9d49e6 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:05.352425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:05.402125 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 101/206] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:05.411889 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8072a24-d38f-4fd6-9569-cf8060d20e56 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:05.545536 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8072a24-d38f-4fd6-9569-cf8060d20e56 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:05.600404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd19792-d705-457a-8b85-ba138c78f51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:05.601287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd19792-d705-457a-8b85-ba138c78f51f None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:05.601570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd19792-d705-457a-8b85-ba138c78f51f None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:05.601845 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd19792-d705-457a-8b85-ba138c78f51f None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:05.603111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd19792-d705-457a-8b85-ba138c78f51f None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:05.604495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd19792-d705-457a-8b85-ba138c78f51f None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:05.606239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 106/207] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:05 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:05.612253 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e616b-bfb3-480b-bf8a-6e139a9d49e6 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:05.729384 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e616b-bfb3-480b-bf8a-6e139a9d49e6 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:05.767184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11dac8-221e-43b4-9cc9-d1a93edb1709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:05.767843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11dac8-221e-43b4-9cc9-d1a93edb1709 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:05.768128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11dac8-221e-43b4-9cc9-d1a93edb1709 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:05.768407 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11dac8-221e-43b4-9cc9-d1a93edb1709 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:05.769287 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11dac8-221e-43b4-9cc9-d1a93edb1709 None admin] RBAC: Adding query filter params (role.id=0896209e464b4256b7999b25e1972696, scope.project.id=c4e4f97ef7884bcab434c35f9d529509, user.id=8534baf0e398469eafbea89867013cec) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:05.769603 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11dac8-221e-43b4-9cc9-d1a93edb1709 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:05.771051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11dac8-221e-43b4-9cc9-d1a93edb1709 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:05.777476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 102/208] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:05 2022] GET /identity/v3/role_assignments?user.id=8534baf0e398469eafbea89867013cec&scope.project.id=c4e4f97ef7884bcab434c35f9d529509&role.id=0896209e464b4256b7999b25e1972696 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:06.746477 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd703823-4aa6-45bc-a17e-60728c8491f4 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:06.746996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd703823-4aa6-45bc-a17e-60728c8491f4 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:06.747073 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd703823-4aa6-45bc-a17e-60728c8491f4 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:06.748568 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 107/209] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:06.753856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9116007-d98d-440f-a77b-028d831c81a1 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:06.754310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9116007-d98d-440f-a77b-028d831c81a1 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:06.754398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9116007-d98d-440f-a77b-028d831c81a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:06.773180 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-d9116007-d98d-440f-a77b-028d831c81a1 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:06.774663 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-d9116007-d98d-440f-a77b-028d831c81a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:06.789336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:06.852939 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 103/210] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:06.870467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd703823-4aa6-45bc-a17e-60728c8491f4 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:06.880678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:06.970078 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f694dd0-503e-4851-a477-2b2c035d98e0 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:06.970396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f694dd0-503e-4851-a477-2b2c035d98e0 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:06.970642 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f694dd0-503e-4851-a477-2b2c035d98e0 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:06.972185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 104/211] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:06.977081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59efe6b-065a-46bf-bf8d-bf7104ea9663 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:06.977373 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59efe6b-065a-46bf-bf8d-bf7104ea9663 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:06.977687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59efe6b-065a-46bf-bf8d-bf7104ea9663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:06.979215 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd703823-4aa6-45bc-a17e-60728c8491f4 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:06.994662 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-c59efe6b-065a-46bf-bf8d-bf7104ea9663 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:06.995858 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-c59efe6b-065a-46bf-bf8d-bf7104ea9663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:07.015893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfe9aa-4331-4dc1-afee-52fff9084af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:07.016609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfe9aa-4331-4dc1-afee-52fff9084af1 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:07.016921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfe9aa-4331-4dc1-afee-52fff9084af1 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:07.017196 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfe9aa-4331-4dc1-afee-52fff9084af1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:07.027659 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfe9aa-4331-4dc1-afee-52fff9084af1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-31bfe9aa-4331-4dc1-afee-52fff9084af1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:07.035374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:07.036298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:07.037140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:07.037140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:07.037140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:07.037140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:07.037140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:07.037140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:07.037140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:07.037140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:07.037140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:07.037140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:07.037140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:07.037140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:07.037140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 108/212] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:07.043453 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfe9aa-4331-4dc1-afee-52fff9084af1 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:07.078169 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 105/213] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:07.103161 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59efe6b-065a-46bf-bf8d-bf7104ea9663 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:07.129392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:07.168066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfe9aa-4331-4dc1-afee-52fff9084af1 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:07.189562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:07.207338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea311a7-de35-419f-be1a-aa9c1386a67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:07.208269 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea311a7-de35-419f-be1a-aa9c1386a67d None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:07.208764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea311a7-de35-419f-be1a-aa9c1386a67d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:07.209214 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea311a7-de35-419f-be1a-aa9c1386a67d None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:07.210159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea311a7-de35-419f-be1a-aa9c1386a67d None admin] RBAC: Adding query filter params (name=member) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:07.210639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea311a7-de35-419f-be1a-aa9c1386a67d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:07.211333 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59efe6b-065a-46bf-bf8d-bf7104ea9663 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:07.212372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea311a7-de35-419f-be1a-aa9c1386a67d None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:07.221125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 109/214] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:07.222715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce535561-6737-4eba-b72c-96061093fb6a None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:07.223006 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce535561-6737-4eba-b72c-96061093fb6a None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:07.223287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce535561-6737-4eba-b72c-96061093fb6a None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:07.224518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 110/215] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:07.229896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3bb92-9749-40e0-82d5-2995d7e6e42d None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:07.230398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3bb92-9749-40e0-82d5-2995d7e6e42d None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:07.230849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3bb92-9749-40e0-82d5-2995d7e6e42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:07.248152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-93c3bb92-9749-40e0-82d5-2995d7e6e42d None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:07.250629 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-93c3bb92-9749-40e0-82d5-2995d7e6e42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:07.255281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d457f7f-e470-489e-847f-f0d3ead5e6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:07.256076 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d457f7f-e470-489e-847f-f0d3ead5e6c9 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:07.256401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d457f7f-e470-489e-847f-f0d3ead5e6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:07.256720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d457f7f-e470-489e-847f-f0d3ead5e6c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:07.257889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d457f7f-e470-489e-847f-f0d3ead5e6c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:07.259315 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d457f7f-e470-489e-847f-f0d3ead5e6c9 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:07.261135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 106/216] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:07.261740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d457f7f-e470-489e-847f-f0d3ead5e6c9 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:07.333212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 111/217] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:07.333212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3bb92-9749-40e0-82d5-2995d7e6e42d None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:07.374978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d457f7f-e470-489e-847f-f0d3ead5e6c9 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:07.399070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:07.410702 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13843a98-7ee1-4d25-a268-fe12af8a119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:07.411582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13843a98-7ee1-4d25-a268-fe12af8a119a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:07.411866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13843a98-7ee1-4d25-a268-fe12af8a119a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:07.412144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13843a98-7ee1-4d25-a268-fe12af8a119a None admin] PATH_INFO: `/v3/users/8628d11f792842c09b281436bccb4400` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:07.427577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13843a98-7ee1-4d25-a268-fe12af8a119a None admin] RBAC: Authorizing `identity:get_user(user_id=8628d11f792842c09b281436bccb4400)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:07.429069 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13843a98-7ee1-4d25-a268-fe12af8a119a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:07.430769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 107/218] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:07 2022] GET /identity/v3/users/8628d11f792842c09b281436bccb4400 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:07.431535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13843a98-7ee1-4d25-a268-fe12af8a119a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:07.436979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:07.446895 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3bb92-9749-40e0-82d5-2995d7e6e42d None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:07.481505 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4a772-110a-43b6-9119-9b8dec7b030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:07.482184 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4a772-110a-43b6-9119-9b8dec7b030c None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:07.482470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4a772-110a-43b6-9119-9b8dec7b030c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:07.482751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4a772-110a-43b6-9119-9b8dec7b030c None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:07.484004 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4a772-110a-43b6-9119-9b8dec7b030c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:07.485469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4a772-110a-43b6-9119-9b8dec7b030c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:07.535320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13843a98-7ee1-4d25-a268-fe12af8a119a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:07.568854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f5c25-dd85-465c-b5e9-f845d58e2e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:07.569634 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f5c25-dd85-465c-b5e9-f845d58e2e8b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:07.569911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f5c25-dd85-465c-b5e9-f845d58e2e8b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:07.570179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f5c25-dd85-465c-b5e9-f845d58e2e8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:07.580406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f5c25-dd85-465c-b5e9-f845d58e2e8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-269f5c25-dd85-465c-b5e9-f845d58e2e8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:07.587914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:07.588856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:07.589664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:07.589664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:07.589664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:07.589664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:07.589664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:07.589664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:07.589664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:07.589664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:07.589664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:07.589664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:07.589664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:37:07.589664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:07.589664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 108/219] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:37:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:07.590891 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f5c25-dd85-465c-b5e9-f845d58e2e8b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:07.599995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 112/220] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:37:07 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:37:07.600929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4a772-110a-43b6-9119-9b8dec7b030c None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:07.669531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:07.711874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f5c25-dd85-465c-b5e9-f845d58e2e8b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:07.718604 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4a772-110a-43b6-9119-9b8dec7b030c None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:07.734427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:07.748704 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ef10b-6e80-45a8-b504-1b4087769e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:07.749472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef10b-6e80-45a8-b504-1b4087769e14 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:07.749761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef10b-6e80-45a8-b504-1b4087769e14 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:07.750036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef10b-6e80-45a8-b504-1b4087769e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:07.757916 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e6ff1-2a6c-4aac-aa7f-e43b1c38dd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:07.758432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e6ff1-2a6c-4aac-aa7f-e43b1c38dd21 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:07.758432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e6ff1-2a6c-4aac-aa7f-e43b1c38dd21 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:07.758572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e6ff1-2a6c-4aac-aa7f-e43b1c38dd21 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:07.759264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e6ff1-2a6c-4aac-aa7f-e43b1c38dd21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:07.759567 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e6ff1-2a6c-4aac-aa7f-e43b1c38dd21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:07.760974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e6ff1-2a6c-4aac-aa7f-e43b1c38dd21 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:07.772150 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 113/221] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:07.773762 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab4385-1350-42b2-be01-7fc878408a07 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:07.774555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab4385-1350-42b2-be01-7fc878408a07 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:07.774555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab4385-1350-42b2-be01-7fc878408a07 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:07.775697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 114/222] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:07.777907 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab4385-1350-42b2-be01-7fc878408a07 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:07.835927 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ef10b-6e80-45a8-b504-1b4087769e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:07.837464 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ef10b-6e80-45a8-b504-1b4087769e14 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:07.900748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab4385-1350-42b2-be01-7fc878408a07 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:07.918043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:07.948360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fe874-0d86-4af2-9403-4e62f93e9a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:07.949276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fe874-0d86-4af2-9403-4e62f93e9a93 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:07.949655 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fe874-0d86-4af2-9403-4e62f93e9a93 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:07.950197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fe874-0d86-4af2-9403-4e62f93e9a93 None admin] PATH_INFO: `/v3/users/1711957004914be3af45e903eaa025c1` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:07.951413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fe874-0d86-4af2-9403-4e62f93e9a93 None admin] RBAC: Authorizing `identity:get_user(user_id=1711957004914be3af45e903eaa025c1)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:07.953529 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fe874-0d86-4af2-9403-4e62f93e9a93 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:07.955062 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 115/223] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:07 2022] GET /identity/v3/users/1711957004914be3af45e903eaa025c1 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:07.956107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131f3c-94e3-49d3-b388-29fe857b3fde None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:07.956665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131f3c-94e3-49d3-b388-29fe857b3fde None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:07.956958 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131f3c-94e3-49d3-b388-29fe857b3fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:07.973198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 109/224] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:07.974434 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ef10b-6e80-45a8-b504-1b4087769e14 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:07.974560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-ca131f3c-94e3-49d3-b388-29fe857b3fde None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:07.975715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-ca131f3c-94e3-49d3-b388-29fe857b3fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:08.033144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:08.069176 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 116/225] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:08.070287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca131f3c-94e3-49d3-b388-29fe857b3fde None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:08.095810 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ef10b-6e80-45a8-b504-1b4087769e14 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:08.139958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22e4ed-871c-4b4e-ae1f-95eed2930745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:08.141705 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22e4ed-871c-4b4e-ae1f-95eed2930745 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:08.142157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22e4ed-871c-4b4e-ae1f-95eed2930745 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:08.142660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22e4ed-871c-4b4e-ae1f-95eed2930745 None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:08.144016 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22e4ed-871c-4b4e-ae1f-95eed2930745 None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:08.145893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22e4ed-871c-4b4e-ae1f-95eed2930745 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:08.147891 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 110/226] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:07 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:08.148953 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22e4ed-871c-4b4e-ae1f-95eed2930745 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:08.183431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:08.189699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca131f3c-94e3-49d3-b388-29fe857b3fde None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:08.225396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47e72d-b129-49fc-b1ab-afb692ee596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:08.226288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47e72d-b129-49fc-b1ab-afb692ee596d None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:08.226570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47e72d-b129-49fc-b1ab-afb692ee596d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:08.226847 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47e72d-b129-49fc-b1ab-afb692ee596d None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:08.228349 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47e72d-b129-49fc-b1ab-afb692ee596d None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:08.230384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47e72d-b129-49fc-b1ab-afb692ee596d None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:08.231565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 117/227] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:08 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:08.232391 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47e72d-b129-49fc-b1ab-afb692ee596d None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:08.264778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22e4ed-871c-4b4e-ae1f-95eed2930745 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:08.278391 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:08.303145 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516fb76-9181-449e-bd6b-333d47598df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:08.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516fb76-9181-449e-bd6b-333d47598df7 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:08.304856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516fb76-9181-449e-bd6b-333d47598df7 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:08.305324 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516fb76-9181-449e-bd6b-333d47598df7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:08.317554 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516fb76-9181-449e-bd6b-333d47598df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-d516fb76-9181-449e-bd6b-333d47598df7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:08.327598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:08.328493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:08.329310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:08.329310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:08.329310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:08.329310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:08.329310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:08.329310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:08.329310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:08.329310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:08.329310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:08.329310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:08.329310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:08.329310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:08.331811 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 111/228] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:37:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:08.332949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516fb76-9181-449e-bd6b-333d47598df7 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:08.338135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47e72d-b129-49fc-b1ab-afb692ee596d None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:08.374573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5889fb1-5c2e-4c85-ac57-6539e034f1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:08.375479 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5889fb1-5c2e-4c85-ac57-6539e034f1eb None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:08.375761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5889fb1-5c2e-4c85-ac57-6539e034f1eb None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:08.376033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5889fb1-5c2e-4c85-ac57-6539e034f1eb None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3/users/1711957004914be3af45e903eaa025c1/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:08.378395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5889fb1-5c2e-4c85-ac57-6539e034f1eb None admin] RBAC: Authorizing `identity:create_grant(project_id=292b6b0d819648b58526d1dda82420c3, user_id=1711957004914be3af45e903eaa025c1, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:08.379888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5889fb1-5c2e-4c85-ac57-6539e034f1eb None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:08.436829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:08.445677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516fb76-9181-449e-bd6b-333d47598df7 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:08.464033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 118/229] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:37:08 2022] PUT /identity/v3/projects/292b6b0d819648b58526d1dda82420c3/users/1711957004914be3af45e903eaa025c1/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:37:08.465535 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5889fb1-5c2e-4c85-ac57-6539e034f1eb None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:08.505711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f2ff3-3979-4d55-b2a2-949dac607159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:08.506770 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f2ff3-3979-4d55-b2a2-949dac607159 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:08.508691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f2ff3-3979-4d55-b2a2-949dac607159 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:08.509428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f2ff3-3979-4d55-b2a2-949dac607159 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:08.511244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f2ff3-3979-4d55-b2a2-949dac607159 None admin] RBAC: Adding query filter params (role.id=4568d65f55c74c2bbc8265f34e62bbc4, scope.project.id=292b6b0d819648b58526d1dda82420c3, user.id=8628d11f792842c09b281436bccb4400) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:08.513584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f2ff3-3979-4d55-b2a2-949dac607159 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:08.516052 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f2ff3-3979-4d55-b2a2-949dac607159 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:08.532345 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 112/230] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:08 2022] GET /identity/v3/role_assignments?user.id=8628d11f792842c09b281436bccb4400&scope.project.id=292b6b0d819648b58526d1dda82420c3&role.id=4568d65f55c74c2bbc8265f34e62bbc4 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:08.651947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5889fb1-5c2e-4c85-ac57-6539e034f1eb None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:08.653588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:08.703457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd522c6c-d379-46d0-a2bf-c65405f622f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:08.704525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522c6c-d379-46d0-a2bf-c65405f622f8 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:08.705027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522c6c-d379-46d0-a2bf-c65405f622f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:08.705500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522c6c-d379-46d0-a2bf-c65405f622f8 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:08.706492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd522c6c-d379-46d0-a2bf-c65405f622f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:08.706994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd522c6c-d379-46d0-a2bf-c65405f622f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:08.708691 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd522c6c-d379-46d0-a2bf-c65405f622f8 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:08.720616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 119/231] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:08.725808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f2ff3-3979-4d55-b2a2-949dac607159 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:08.835815 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f2ff3-3979-4d55-b2a2-949dac607159 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:08.877369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cca2a-ddac-46dc-a1fb-a3653ad7cb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:08.879062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cca2a-ddac-46dc-a1fb-a3653ad7cb84 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:08.879540 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cca2a-ddac-46dc-a1fb-a3653ad7cb84 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:08.880005 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cca2a-ddac-46dc-a1fb-a3653ad7cb84 None admin] PATH_INFO: `/v3/users/1711957004914be3af45e903eaa025c1` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:08.882677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cca2a-ddac-46dc-a1fb-a3653ad7cb84 None admin] RBAC: Authorizing `identity:get_user(user_id=1711957004914be3af45e903eaa025c1)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:08.884371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cca2a-ddac-46dc-a1fb-a3653ad7cb84 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:08.887222 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 113/232] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:08 2022] GET /identity/v3/users/1711957004914be3af45e903eaa025c1 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:08.892811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd522c6c-d379-46d0-a2bf-c65405f622f8 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:09.049317 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd522c6c-d379-46d0-a2bf-c65405f622f8 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:09.112480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e8c20-57ff-4743-a68a-b9b1d3679eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:09.113369 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e8c20-57ff-4743-a68a-b9b1d3679eeb None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:09.113647 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e8c20-57ff-4743-a68a-b9b1d3679eeb None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:09.113915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e8c20-57ff-4743-a68a-b9b1d3679eeb None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:09.115100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e8c20-57ff-4743-a68a-b9b1d3679eeb None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:09.116543 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e8c20-57ff-4743-a68a-b9b1d3679eeb None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:09.118503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 120/233] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:08 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:09.126982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cca2a-ddac-46dc-a1fb-a3653ad7cb84 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:09.166803 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:09.248001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cca2a-ddac-46dc-a1fb-a3653ad7cb84 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:09.298749 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569f537-fa13-4ac8-ac3d-e24c028a275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:09.299696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569f537-fa13-4ac8-ac3d-e24c028a275c None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:09.299918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569f537-fa13-4ac8-ac3d-e24c028a275c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:09.300191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569f537-fa13-4ac8-ac3d-e24c028a275c None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3/users/1711957004914be3af45e903eaa025c1/roles/aef73ff3b03c4ad0878a0dbb33fc285c` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:09.306413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569f537-fa13-4ac8-ac3d-e24c028a275c None admin] RBAC: Authorizing `identity:create_grant(project_id=292b6b0d819648b58526d1dda82420c3, user_id=1711957004914be3af45e903eaa025c1, role_id=aef73ff3b03c4ad0878a0dbb33fc285c)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:09.307840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569f537-fa13-4ac8-ac3d-e24c028a275c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:09.428320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 114/234] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:37:09 2022] PUT /identity/v3/projects/292b6b0d819648b58526d1dda82420c3/users/1711957004914be3af45e903eaa025c1/roles/aef73ff3b03c4ad0878a0dbb33fc285c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:37:10.025149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937b1d2-b3a1-4054-9059-68101e38a78a None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:10.025671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937b1d2-b3a1-4054-9059-68101e38a78a None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:10.025671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937b1d2-b3a1-4054-9059-68101e38a78a None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:10.027071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 121/235] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:10.042230 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602bada-9ae5-4f73-9025-bff4345b7b0b None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:10.042716 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602bada-9ae5-4f73-9025-bff4345b7b0b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:10.042790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602bada-9ae5-4f73-9025-bff4345b7b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:10.065649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b602bada-9ae5-4f73-9025-bff4345b7b0b None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:10.066863 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b602bada-9ae5-4f73-9025-bff4345b7b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:10.162068 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 115/236] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:10.199124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937b1d2-b3a1-4054-9059-68101e38a78a None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:10.206091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eece454-ec66-4568-a109-5f206d40430c None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:10.206633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eece454-ec66-4568-a109-5f206d40430c None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:10.207110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eece454-ec66-4568-a109-5f206d40430c None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:10.208723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 116/237] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:10.213878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce68db-f697-419d-bd76-4cdf2e395ec7 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:10.214392 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce68db-f697-419d-bd76-4cdf2e395ec7 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:10.214868 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce68db-f697-419d-bd76-4cdf2e395ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:10.242959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-ccce68db-f697-419d-bd76-4cdf2e395ec7 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:10.244147 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ccce68db-f697-419d-bd76-4cdf2e395ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:10.247000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:10.263829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:10.364188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937b1d2-b3a1-4054-9059-68101e38a78a None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:10.366902 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 117/238] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:10.399928 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d08ce-0f48-4359-ba5c-b3fee44fea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:10.400765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d08ce-0f48-4359-ba5c-b3fee44fea5a None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:10.401341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d08ce-0f48-4359-ba5c-b3fee44fea5a None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:10.401715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d08ce-0f48-4359-ba5c-b3fee44fea5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:10.403066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d08ce-0f48-4359-ba5c-b3fee44fea5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:10.405242 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d08ce-0f48-4359-ba5c-b3fee44fea5a None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:10.407294 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 122/239] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:10.408737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce68db-f697-419d-bd76-4cdf2e395ec7 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:10.412517 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d08ce-0f48-4359-ba5c-b3fee44fea5a None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:10.557313 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d08ce-0f48-4359-ba5c-b3fee44fea5a None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:10.580999 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:10.598574 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ca952-275c-47c5-99d7-f537488f2464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:10.599253 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ca952-275c-47c5-99d7-f537488f2464 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:10.599536 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ca952-275c-47c5-99d7-f537488f2464 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:10.599813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ca952-275c-47c5-99d7-f537488f2464 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:10.600532 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ca952-275c-47c5-99d7-f537488f2464 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:10.602125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ca952-275c-47c5-99d7-f537488f2464 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:10.619718 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce68db-f697-419d-bd76-4cdf2e395ec7 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:10.656434 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2eecd-7cb7-4e6e-af79-572add9c2905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:10.657330 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2eecd-7cb7-4e6e-af79-572add9c2905 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:10.657613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2eecd-7cb7-4e6e-af79-572add9c2905 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:10.657977 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2eecd-7cb7-4e6e-af79-572add9c2905 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:10.668988 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2eecd-7cb7-4e6e-af79-572add9c2905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-9cb2eecd-7cb7-4e6e-af79-572add9c2905 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:10.678027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:10.679110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:10.680184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:10.680184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:10.680184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:10.680184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:10.680184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:10.680184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:10.680184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:10.680184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:10.680184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:10.680184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:10.680184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:37:10.680184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:10.680184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 118/240] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:10.684089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2eecd-7cb7-4e6e-af79-572add9c2905 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:10.690003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:10.696322 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 123/241] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:37:10 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:37:10.825213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2eecd-7cb7-4e6e-af79-572add9c2905 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:10.875853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8facc-eabf-4bcc-a5b0-d0db85a9e973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:10.876459 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8facc-eabf-4bcc-a5b0-d0db85a9e973 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:10.876770 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8facc-eabf-4bcc-a5b0-d0db85a9e973 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:10.877043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8facc-eabf-4bcc-a5b0-d0db85a9e973 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:10.878168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8facc-eabf-4bcc-a5b0-d0db85a9e973 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:10.878168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8facc-eabf-4bcc-a5b0-d0db85a9e973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:10.879767 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8facc-eabf-4bcc-a5b0-d0db85a9e973 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:10.894102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 119/242] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:10.900063 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ca952-275c-47c5-99d7-f537488f2464 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:11.041194 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ca952-275c-47c5-99d7-f537488f2464 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:11.080210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b6fbf-1a20-4dc3-a572-d90de04bb59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:11.081522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b6fbf-1a20-4dc3-a572-d90de04bb59e None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:11.082003 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b6fbf-1a20-4dc3-a572-d90de04bb59e None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:11.082472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b6fbf-1a20-4dc3-a572-d90de04bb59e None admin] PATH_INFO: `/v3/users/7bcb1fa9e2374b70a4b150501374d555` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:11.098002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b6fbf-1a20-4dc3-a572-d90de04bb59e None admin] RBAC: Authorizing `identity:get_user(user_id=7bcb1fa9e2374b70a4b150501374d555)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:11.101240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b6fbf-1a20-4dc3-a572-d90de04bb59e None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:11.101964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 124/243] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:10 2022] GET /identity/v3/users/7bcb1fa9e2374b70a4b150501374d555 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:11.112631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8facc-eabf-4bcc-a5b0-d0db85a9e973 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:11.117692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2815972-1bf6-40c3-9f5f-048fb4274cc8 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:11.117984 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2815972-1bf6-40c3-9f5f-048fb4274cc8 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:11.118263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2815972-1bf6-40c3-9f5f-048fb4274cc8 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:11.122687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 125/244] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:37:11.126511 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8c3e6-47a2-4b0b-a347-301375280c0d None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:11.126511 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8c3e6-47a2-4b0b-a347-301375280c0d None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:11.126691 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8c3e6-47a2-4b0b-a347-301375280c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:11.144410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-2ab8c3e6-47a2-4b0b-a347-301375280c0d None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:11.145731 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2ab8c3e6-47a2-4b0b-a347-301375280c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:11.157527 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:11.211038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:11.255363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 126/245] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:37:11.255363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90471bd-eb92-436a-9384-5ffca7b95bb0 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:11.255363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90471bd-eb92-436a-9384-5ffca7b95bb0 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:11.255363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90471bd-eb92-436a-9384-5ffca7b95bb0 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:11.255363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 127/246] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:11.261369 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f51d0-7fd0-418f-bb6d-805c841dc3d5 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:11.261658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f51d0-7fd0-418f-bb6d-805c841dc3d5 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:11.261944 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f51d0-7fd0-418f-bb6d-805c841dc3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:11.266749 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8facc-eabf-4bcc-a5b0-d0db85a9e973 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:11.284956 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-7f1f51d0-7fd0-418f-bb6d-805c841dc3d5 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:11.285923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7f1f51d0-7fd0-418f-bb6d-805c841dc3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:11.314291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf319fb-67f8-411d-81cc-b9912b4c5650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:11.314965 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf319fb-67f8-411d-81cc-b9912b4c5650 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:11.315251 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf319fb-67f8-411d-81cc-b9912b4c5650 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:11.315533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf319fb-67f8-411d-81cc-b9912b4c5650 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:11.363367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 128/247] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:11.364292 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f51d0-7fd0-418f-bb6d-805c841dc3d5 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:11.411594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf319fb-67f8-411d-81cc-b9912b4c5650 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:11.413080 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf319fb-67f8-411d-81cc-b9912b4c5650 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:11.469925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:11.487830 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:11.496986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f51d0-7fd0-418f-bb6d-805c841dc3d5 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:11.526472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 120/248] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:11.527408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf319fb-67f8-411d-81cc-b9912b4c5650 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:11.534558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a784ac6-d3c6-4de1-bfb3-3f3aea70aef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:11.535484 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a784ac6-d3c6-4de1-bfb3-3f3aea70aef0 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:11.535683 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a784ac6-d3c6-4de1-bfb3-3f3aea70aef0 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:11.535911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a784ac6-d3c6-4de1-bfb3-3f3aea70aef0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:11.546640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a784ac6-d3c6-4de1-bfb3-3f3aea70aef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-5a784ac6-d3c6-4de1-bfb3-3f3aea70aef0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:11.554393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:11.555271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:11.556092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:11.556092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:11.556092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:11.556092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:11.556092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:11.556092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:11.556092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:11.556092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:11.556092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:11.556092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:11.556092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:11.556092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:11.556092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 129/249] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:11.561295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a784ac6-d3c6-4de1-bfb3-3f3aea70aef0 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:11.635659 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf319fb-67f8-411d-81cc-b9912b4c5650 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:11.664471 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a784ac6-d3c6-4de1-bfb3-3f3aea70aef0 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:11.674102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3a56b-3514-48e1-80aa-5fdded277f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:11.674951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3a56b-3514-48e1-80aa-5fdded277f2b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:11.675236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3a56b-3514-48e1-80aa-5fdded277f2b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:11.675519 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3a56b-3514-48e1-80aa-5fdded277f2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:11.687842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3a56b-3514-48e1-80aa-5fdded277f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-37b3a56b-3514-48e1-80aa-5fdded277f2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:11.696265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:11.697321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:11.698277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:11.698277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:11.698277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:11.698277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:11.698277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:11.698277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:11.698277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:11.698277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:11.698277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:11.698277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:11.698277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:37:11.698277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:11.700718 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 121/250] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:37:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:11.702288 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3a56b-3514-48e1-80aa-5fdded277f2b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:11.706497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7e2f3-3e3c-4a19-b442-154c3fb60ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:11.707532 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7e2f3-3e3c-4a19-b442-154c3fb60ca3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:11.707951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7e2f3-3e3c-4a19-b442-154c3fb60ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:11.708387 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7e2f3-3e3c-4a19-b442-154c3fb60ca3 None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:11.709769 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7e2f3-3e3c-4a19-b442-154c3fb60ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:11.711379 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7e2f3-3e3c-4a19-b442-154c3fb60ca3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:11.713547 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 130/251] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:11 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:11.714605 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7e2f3-3e3c-4a19-b442-154c3fb60ca3 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:11.717633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:11.750536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:11.817906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7e2f3-3e3c-4a19-b442-154c3fb60ca3 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:11.828158 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3a56b-3514-48e1-80aa-5fdded277f2b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:11.882406 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899e61c-6da8-4db0-8b8a-4e03463b2a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:11.883116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e61c-6da8-4db0-8b8a-4e03463b2a9d None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:11.883399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e61c-6da8-4db0-8b8a-4e03463b2a9d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:11.883756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e61c-6da8-4db0-8b8a-4e03463b2a9d None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:11.884511 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899e61c-6da8-4db0-8b8a-4e03463b2a9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:11.884846 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899e61c-6da8-4db0-8b8a-4e03463b2a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:11.886265 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899e61c-6da8-4db0-8b8a-4e03463b2a9d None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:11.899112 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e576c8-9cdd-415c-bd37-3e1a49b05ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:11.899780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e576c8-9cdd-415c-bd37-3e1a49b05ebd None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:11.900102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e576c8-9cdd-415c-bd37-3e1a49b05ebd None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:11.900416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e576c8-9cdd-415c-bd37-3e1a49b05ebd None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:11.901237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e576c8-9cdd-415c-bd37-3e1a49b05ebd None admin] RBAC: Adding query filter params (name=member) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:11.901545 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e576c8-9cdd-415c-bd37-3e1a49b05ebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:11.902915 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e576c8-9cdd-415c-bd37-3e1a49b05ebd None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:11.915111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 131/252] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:11.915922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899e61c-6da8-4db0-8b8a-4e03463b2a9d None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:11.924015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 122/253] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:11.926572 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e576c8-9cdd-415c-bd37-3e1a49b05ebd None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:12.005058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:12.069228 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899e61c-6da8-4db0-8b8a-4e03463b2a9d None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:12.091842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:12.107029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e576c8-9cdd-415c-bd37-3e1a49b05ebd None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:12.123719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550f572-3811-4e05-a5a7-225f7f8cfb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:12.126049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550f572-3811-4e05-a5a7-225f7f8cfb02 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:12.126556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550f572-3811-4e05-a5a7-225f7f8cfb02 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:12.127005 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550f572-3811-4e05-a5a7-225f7f8cfb02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:12.128018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550f572-3811-4e05-a5a7-225f7f8cfb02 None admin] RBAC: Adding query filter params (role.id=0896209e464b4256b7999b25e1972696, scope.project.id=292b6b0d819648b58526d1dda82420c3, user.id=7bcb1fa9e2374b70a4b150501374d555) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:12.128939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550f572-3811-4e05-a5a7-225f7f8cfb02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:12.130204 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550f572-3811-4e05-a5a7-225f7f8cfb02 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:12.138502 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 132/254] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:11 2022] GET /identity/v3/role_assignments?user.id=7bcb1fa9e2374b70a4b150501374d555&scope.project.id=292b6b0d819648b58526d1dda82420c3&role.id=0896209e464b4256b7999b25e1972696 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:12.140399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550f572-3811-4e05-a5a7-225f7f8cfb02 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:12.158071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d3e50-32f4-4257-a657-6ff82c39cbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:12.158972 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d3e50-32f4-4257-a657-6ff82c39cbf3 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:12.159302 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d3e50-32f4-4257-a657-6ff82c39cbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:12.159582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d3e50-32f4-4257-a657-6ff82c39cbf3 None admin] PATH_INFO: `/v3/users/1711957004914be3af45e903eaa025c1` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:12.165642 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d3e50-32f4-4257-a657-6ff82c39cbf3 None admin] RBAC: Authorizing `identity:get_user(user_id=1711957004914be3af45e903eaa025c1)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:12.167064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d3e50-32f4-4257-a657-6ff82c39cbf3 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:12.168875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 123/255] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:11 2022] GET /identity/v3/users/1711957004914be3af45e903eaa025c1 => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:12.174166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e6ccf-52d4-4c3f-948d-1f1a46a437e7 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:12.174166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e6ccf-52d4-4c3f-948d-1f1a46a437e7 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:12.174166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e6ccf-52d4-4c3f-948d-1f1a46a437e7 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:12.181069 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 124/256] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:12 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:12.182569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e6ccf-52d4-4c3f-948d-1f1a46a437e7 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:12.308784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550f572-3811-4e05-a5a7-225f7f8cfb02 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:12.356616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:12.365856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7e2c6-bb35-4f27-8a7e-6e137654366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:12.366784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7e2c6-bb35-4f27-8a7e-6e137654366c None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:12.367064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7e2c6-bb35-4f27-8a7e-6e137654366c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:12.367337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7e2c6-bb35-4f27-8a7e-6e137654366c None admin] PATH_INFO: `/v3/users/8628d11f792842c09b281436bccb4400` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:12.374821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7e2c6-bb35-4f27-8a7e-6e137654366c None admin] RBAC: Authorizing `identity:get_user(user_id=8628d11f792842c09b281436bccb4400)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:12.374821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7e2c6-bb35-4f27-8a7e-6e137654366c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:12.375749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 133/257] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:12 2022] GET /identity/v3/users/8628d11f792842c09b281436bccb4400 => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:12.377000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40917a9-c1ae-42d0-8b96-be39c1ac0cf7 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:12.377284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40917a9-c1ae-42d0-8b96-be39c1ac0cf7 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:12.377555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40917a9-c1ae-42d0-8b96-be39c1ac0cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:12.394257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e6ccf-52d4-4c3f-948d-1f1a46a437e7 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:12.414972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d40917a9-c1ae-42d0-8b96-be39c1ac0cf7 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:12.416401 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d40917a9-c1ae-42d0-8b96-be39c1ac0cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:12.459269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d83ee-387b-47b1-9ad4-c0d58c722f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:12.459922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d83ee-387b-47b1-9ad4-c0d58c722f39 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:12.460199 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d83ee-387b-47b1-9ad4-c0d58c722f39 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:12.460474 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d83ee-387b-47b1-9ad4-c0d58c722f39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:12.506264 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:12.529722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 134/258] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:12.530666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40917a9-c1ae-42d0-8b96-be39c1ac0cf7 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:12.583219 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d83ee-387b-47b1-9ad4-c0d58c722f39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:12.584697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d83ee-387b-47b1-9ad4-c0d58c722f39 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:12.695070 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 125/259] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:12.695856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d83ee-387b-47b1-9ad4-c0d58c722f39 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:12.761015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:12.769962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40917a9-c1ae-42d0-8b96-be39c1ac0cf7 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:12.833005 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:12.839651 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d83ee-387b-47b1-9ad4-c0d58c722f39 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:12.852514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e13d1-06fc-45e9-a10f-f1d25b449490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:12.853406 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e13d1-06fc-45e9-a10f-f1d25b449490 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:12.853687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e13d1-06fc-45e9-a10f-f1d25b449490 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:12.853960 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e13d1-06fc-45e9-a10f-f1d25b449490 None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:12.855174 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e13d1-06fc-45e9-a10f-f1d25b449490 None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:12.856606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e13d1-06fc-45e9-a10f-f1d25b449490 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:12.858596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 135/260] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:12 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:12.859950 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e13d1-06fc-45e9-a10f-f1d25b449490 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:12.917581 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbebf7-bbc2-4faf-8c3d-fa8930ac5b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:12.918772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbebf7-bbc2-4faf-8c3d-fa8930ac5b9d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:12.919224 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbebf7-bbc2-4faf-8c3d-fa8930ac5b9d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:12.919733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbebf7-bbc2-4faf-8c3d-fa8930ac5b9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:12.945384 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbebf7-bbc2-4faf-8c3d-fa8930ac5b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-ebcbebf7-bbc2-4faf-8c3d-fa8930ac5b9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:12.954014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:12.954889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:12.955777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:12.955777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:12.955777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:12.955777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:12.955777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:12.955777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:12.955777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:12.955777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:12.955777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:12.955777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:12.955777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:12.955777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:12.970609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 126/261] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:37:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:12.971713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbebf7-bbc2-4faf-8c3d-fa8930ac5b9d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:13.030391 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e13d1-06fc-45e9-a10f-f1d25b449490 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:13.068938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39befa-8088-4304-8100-12ed0ed3121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:13.070030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39befa-8088-4304-8100-12ed0ed3121d None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:13.070889 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39befa-8088-4304-8100-12ed0ed3121d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:13.071300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39befa-8088-4304-8100-12ed0ed3121d None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:13.072690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39befa-8088-4304-8100-12ed0ed3121d None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:13.075103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39befa-8088-4304-8100-12ed0ed3121d None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:13.077690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 136/262] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:12 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:13.079117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39befa-8088-4304-8100-12ed0ed3121d None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:13.156568 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:13.189981 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39befa-8088-4304-8100-12ed0ed3121d None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:13.229821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889b67f-4075-419f-a754-3d5b89d8ae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:13.230762 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889b67f-4075-419f-a754-3d5b89d8ae56 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:13.231577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889b67f-4075-419f-a754-3d5b89d8ae56 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:13.232245 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889b67f-4075-419f-a754-3d5b89d8ae56 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:13.233865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889b67f-4075-419f-a754-3d5b89d8ae56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:13.234348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889b67f-4075-419f-a754-3d5b89d8ae56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:13.236128 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889b67f-4075-419f-a754-3d5b89d8ae56 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:13.245788 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 137/263] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:13.246857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889b67f-4075-419f-a754-3d5b89d8ae56 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:13.248088 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbebf7-bbc2-4faf-8c3d-fa8930ac5b9d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:13.290763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:13.337963 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f574082-b53d-4c02-bce4-d921967f335f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:13.338835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f574082-b53d-4c02-bce4-d921967f335f None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:13.339120 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f574082-b53d-4c02-bce4-d921967f335f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:13.339398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f574082-b53d-4c02-bce4-d921967f335f None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3/users/8628d11f792842c09b281436bccb4400/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:13.346034 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f574082-b53d-4c02-bce4-d921967f335f None admin] RBAC: Authorizing `identity:create_grant(project_id=292b6b0d819648b58526d1dda82420c3, user_id=8628d11f792842c09b281436bccb4400, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:13.347496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f574082-b53d-4c02-bce4-d921967f335f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:13.361269 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889b67f-4075-419f-a754-3d5b89d8ae56 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:13.386791 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:13.398239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366de6fd-c781-4561-9daf-4cb41b7eb572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:13.399398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366de6fd-c781-4561-9daf-4cb41b7eb572 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:13.399925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366de6fd-c781-4561-9daf-4cb41b7eb572 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:13.400392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366de6fd-c781-4561-9daf-4cb41b7eb572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:13.401447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366de6fd-c781-4561-9daf-4cb41b7eb572 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=292b6b0d819648b58526d1dda82420c3, user.id=1711957004914be3af45e903eaa025c1) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:13.401991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366de6fd-c781-4561-9daf-4cb41b7eb572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:13.403780 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366de6fd-c781-4561-9daf-4cb41b7eb572 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:13.410529 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 138/264] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:13 2022] GET /identity/v3/role_assignments?user.id=1711957004914be3af45e903eaa025c1&scope.project.id=292b6b0d819648b58526d1dda82420c3&role.id=6036efe96c1948fb98d01c8703a0561a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:13.411610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366de6fd-c781-4561-9daf-4cb41b7eb572 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:13.431032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 127/265] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:37:12 2022] PUT /identity/v3/projects/292b6b0d819648b58526d1dda82420c3/users/8628d11f792842c09b281436bccb4400/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:37:13.510408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b1503-e69d-440b-94c4-1d81c7caafd1 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:13.510716 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b1503-e69d-440b-94c4-1d81c7caafd1 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:13.510880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b1503-e69d-440b-94c4-1d81c7caafd1 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:13.512486 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 128/266] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:13.519224 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592a55d-5810-44ec-bf5a-5b2d3d904c27 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:13.519447 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592a55d-5810-44ec-bf5a-5b2d3d904c27 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:13.519688 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592a55d-5810-44ec-bf5a-5b2d3d904c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:13.534183 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366de6fd-c781-4561-9daf-4cb41b7eb572 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:13.557920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-4592a55d-5810-44ec-bf5a-5b2d3d904c27 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:13.559099 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-4592a55d-5810-44ec-bf5a-5b2d3d904c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:13.578045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48620f45-f4a4-4907-9d71-1e08685f7c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:13.579358 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48620f45-f4a4-4907-9d71-1e08685f7c09 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:13.579842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48620f45-f4a4-4907-9d71-1e08685f7c09 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:13.580333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48620f45-f4a4-4907-9d71-1e08685f7c09 None admin] PATH_INFO: `/v3/users/1711957004914be3af45e903eaa025c1` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:13.581936 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48620f45-f4a4-4907-9d71-1e08685f7c09 None admin] RBAC: Authorizing `identity:get_user(user_id=1711957004914be3af45e903eaa025c1)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:13.583635 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48620f45-f4a4-4907-9d71-1e08685f7c09 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:13.585954 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 139/267] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:13 2022] GET /identity/v3/users/1711957004914be3af45e903eaa025c1 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:13.594495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48620f45-f4a4-4907-9d71-1e08685f7c09 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:13.667262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:13.719357 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48620f45-f4a4-4907-9d71-1e08685f7c09 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:13.728248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 129/268] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:13.757479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592a55d-5810-44ec-bf5a-5b2d3d904c27 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:13.758370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b107966-f824-4f51-b1a1-14020f74d58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:13.759264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b107966-f824-4f51-b1a1-14020f74d58b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:13.759905 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b107966-f824-4f51-b1a1-14020f74d58b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:13.760392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b107966-f824-4f51-b1a1-14020f74d58b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:13.840549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b107966-f824-4f51-b1a1-14020f74d58b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:13.843224 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b107966-f824-4f51-b1a1-14020f74d58b None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:13.913025 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:13.967645 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592a55d-5810-44ec-bf5a-5b2d3d904c27 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:13.976129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 140/269] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:13.981729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b107966-f824-4f51-b1a1-14020f74d58b None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:13.988267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:14.030233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c14c26-cbb5-4c32-8461-498f1dcce31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:14.031237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c14c26-cbb5-4c32-8461-498f1dcce31e None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:14.032369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c14c26-cbb5-4c32-8461-498f1dcce31e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:14.032674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c14c26-cbb5-4c32-8461-498f1dcce31e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:14.046001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c14c26-cbb5-4c32-8461-498f1dcce31e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-f9c14c26-cbb5-4c32-8461-498f1dcce31e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:14.057855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:14.058796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:14.060495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:14.060495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:14.060495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:14.060495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:14.060495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:14.060495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:14.060495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:14.060495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:14.060495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:14.060495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:14.060495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:14.060495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:14.060495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 130/270] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:14.066769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad1b2c-9aa7-4d80-a71b-3d6e96208cd6 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:14.066769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad1b2c-9aa7-4d80-a71b-3d6e96208cd6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:14.066769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad1b2c-9aa7-4d80-a71b-3d6e96208cd6 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:14.068418 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 131/271] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:14.073479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad1b2c-9aa7-4d80-a71b-3d6e96208cd6 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:14.116843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b107966-f824-4f51-b1a1-14020f74d58b None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:14.153859 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1aba8-0296-446f-b646-0b45ef40dfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:14.154759 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1aba8-0296-446f-b646-0b45ef40dfcd None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:14.155039 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1aba8-0296-446f-b646-0b45ef40dfcd None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:14.155316 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1aba8-0296-446f-b646-0b45ef40dfcd None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:14.156654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1aba8-0296-446f-b646-0b45ef40dfcd None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:14.158318 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1aba8-0296-446f-b646-0b45ef40dfcd None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:14.160397 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 141/272] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:13 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:14.161596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a690a-6815-4a56-861a-1e81c69d0142 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:14.161881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a690a-6815-4a56-861a-1e81c69d0142 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:14.162162 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a690a-6815-4a56-861a-1e81c69d0142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:14.180369 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-c03a690a-6815-4a56-861a-1e81c69d0142 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:14.181695 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-c03a690a-6815-4a56-861a-1e81c69d0142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:14.194901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad1b2c-9aa7-4d80-a71b-3d6e96208cd6 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:14.209099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:14.230953 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031583ae-d9c7-430c-b2f4-3d09ad4eff17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:14.231684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031583ae-d9c7-430c-b2f4-3d09ad4eff17 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:14.231971 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031583ae-d9c7-430c-b2f4-3d09ad4eff17 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:14.232248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031583ae-d9c7-430c-b2f4-3d09ad4eff17 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:14.233660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031583ae-d9c7-430c-b2f4-3d09ad4eff17 None admin] RBAC: Adding query filter params (name=member) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:14.234179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031583ae-d9c7-430c-b2f4-3d09ad4eff17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:14.235569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031583ae-d9c7-430c-b2f4-3d09ad4eff17 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:14.249942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 132/273] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:14.250840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031583ae-d9c7-430c-b2f4-3d09ad4eff17 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:14.257156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 142/274] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:14.258107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a690a-6815-4a56-861a-1e81c69d0142 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:14.296773 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:14.366030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a690a-6815-4a56-861a-1e81c69d0142 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:14.379123 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031583ae-d9c7-430c-b2f4-3d09ad4eff17 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:14.402736 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7f9fc-4cb6-44aa-a486-a74678dbdc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:14.403942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7f9fc-4cb6-44aa-a486-a74678dbdc19 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:14.404445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7f9fc-4cb6-44aa-a486-a74678dbdc19 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:14.405045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7f9fc-4cb6-44aa-a486-a74678dbdc19 None admin] PATH_INFO: `/v3/users/82a75b2a33de4a2d99a71046b370c4da` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:14.414036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1174b1-add1-4cc0-9c4b-9ce9fd9ca60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:14.414693 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1174b1-add1-4cc0-9c4b-9ce9fd9ca60a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:14.415033 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1174b1-add1-4cc0-9c4b-9ce9fd9ca60a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:14.415344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1174b1-add1-4cc0-9c4b-9ce9fd9ca60a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:14.416203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1174b1-add1-4cc0-9c4b-9ce9fd9ca60a None admin] RBAC: Adding query filter params (role.id=aef73ff3b03c4ad0878a0dbb33fc285c, scope.project.id=292b6b0d819648b58526d1dda82420c3, user.id=1711957004914be3af45e903eaa025c1) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:14.416497 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1174b1-add1-4cc0-9c4b-9ce9fd9ca60a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:14.417989 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1174b1-add1-4cc0-9c4b-9ce9fd9ca60a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:14.422070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7f9fc-4cb6-44aa-a486-a74678dbdc19 None admin] RBAC: Authorizing `identity:get_user(user_id=82a75b2a33de4a2d99a71046b370c4da)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:14.423717 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7f9fc-4cb6-44aa-a486-a74678dbdc19 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:14.425089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 133/275] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:14 2022] GET /identity/v3/role_assignments?user.id=1711957004914be3af45e903eaa025c1&scope.project.id=292b6b0d819648b58526d1dda82420c3&role.id=aef73ff3b03c4ad0878a0dbb33fc285c => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:14.426000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1174b1-add1-4cc0-9c4b-9ce9fd9ca60a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:14.426389 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 143/276] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:14 2022] GET /identity/v3/users/82a75b2a33de4a2d99a71046b370c4da => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:14.432004 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7f9fc-4cb6-44aa-a486-a74678dbdc19 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:14.453883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:14.550736 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7f9fc-4cb6-44aa-a486-a74678dbdc19 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:14.592693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a8bff-cf5e-44c9-b60a-cae9b3cca136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:14.593795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a8bff-cf5e-44c9-b60a-cae9b3cca136 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:14.594343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a8bff-cf5e-44c9-b60a-cae9b3cca136 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:14.594806 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a8bff-cf5e-44c9-b60a-cae9b3cca136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:14.596833 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a8bff-cf5e-44c9-b60a-cae9b3cca136 None admin] RBAC: Adding query filter params (role.id=4568d65f55c74c2bbc8265f34e62bbc4, user.id=82a75b2a33de4a2d99a71046b370c4da, scope.system=all) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:14.597402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a8bff-cf5e-44c9-b60a-cae9b3cca136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:14.599024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a8bff-cf5e-44c9-b60a-cae9b3cca136 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:14.608617 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 144/277] 10.222.0.44 () {56 vars in 1308 bytes} [Mon Jun 27 14:37:14 2022] GET /identity/v3/role_assignments?user.id=82a75b2a33de4a2d99a71046b370c4da&scope.system=all&role.id=4568d65f55c74c2bbc8265f34e62bbc4 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:14.615323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:14.630321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1174b1-add1-4cc0-9c4b-9ce9fd9ca60a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:14.675293 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c4d03-e627-4531-b351-4ec0e7d8b878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:14.676101 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c4d03-e627-4531-b351-4ec0e7d8b878 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:14.676383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c4d03-e627-4531-b351-4ec0e7d8b878 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:14.676672 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c4d03-e627-4531-b351-4ec0e7d8b878 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:14.677917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c4d03-e627-4531-b351-4ec0e7d8b878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:14.679361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c4d03-e627-4531-b351-4ec0e7d8b878 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:14.681092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 134/278] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:14.687184 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a8bff-cf5e-44c9-b60a-cae9b3cca136 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:14.772312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:14.785889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cf51e-dc38-4d05-8550-f0d84012c2b7 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:14.786179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cf51e-dc38-4d05-8550-f0d84012c2b7 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:14.786436 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cf51e-dc38-4d05-8550-f0d84012c2b7 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:14.788005 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 135/279] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:14.793429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e49a8-fc64-4e88-ae42-1087bc4ea6f6 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:14.793716 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e49a8-fc64-4e88-ae42-1087bc4ea6f6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:14.793994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e49a8-fc64-4e88-ae42-1087bc4ea6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:14.803695 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a8bff-cf5e-44c9-b60a-cae9b3cca136 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:14.812795 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-349e49a8-fc64-4e88-ae42-1087bc4ea6f6 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:14.814468 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-349e49a8-fc64-4e88-ae42-1087bc4ea6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:14.852605 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e61976-3c54-431e-919a-10d53197cbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:14.853738 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e61976-3c54-431e-919a-10d53197cbed None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:14.854023 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e61976-3c54-431e-919a-10d53197cbed None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:14.854298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e61976-3c54-431e-919a-10d53197cbed None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:14.856406 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e61976-3c54-431e-919a-10d53197cbed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:14.856495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e61976-3c54-431e-919a-10d53197cbed None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:14.890640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 136/280] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:14.913172 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e49a8-fc64-4e88-ae42-1087bc4ea6f6 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:14.984320 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 145/281] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:37:14 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:37:15.023878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:15.035168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e49a8-fc64-4e88-ae42-1087bc4ea6f6 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:15.073353 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84aad10-185d-4a7b-af8f-ec782ac52725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:15.074157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84aad10-185d-4a7b-af8f-ec782ac52725 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:15.074437 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84aad10-185d-4a7b-af8f-ec782ac52725 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:15.074955 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84aad10-185d-4a7b-af8f-ec782ac52725 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:15.091502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84aad10-185d-4a7b-af8f-ec782ac52725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-a84aad10-185d-4a7b-af8f-ec782ac52725 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:15.100582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:15.101548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:15.102334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:15.102334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:15.102334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:15.102334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:15.102334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:15.102334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:15.102334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:15.102334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:15.102334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:15.102334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:15.102334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:37:15.102334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:15.102334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 137/282] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:37:15.109243 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e61976-3c54-431e-919a-10d53197cbed None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:15.219045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e61976-3c54-431e-919a-10d53197cbed None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:15.251426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:15.256666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1b77b-1d19-442f-b2a1-c976f5def249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:15.257558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1b77b-1d19-442f-b2a1-c976f5def249 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:15.258033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1b77b-1d19-442f-b2a1-c976f5def249 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:15.258516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1b77b-1d19-442f-b2a1-c976f5def249 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:15.259450 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1b77b-1d19-442f-b2a1-c976f5def249 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:15.259999 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1b77b-1d19-442f-b2a1-c976f5def249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:15.261575 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1b77b-1d19-442f-b2a1-c976f5def249 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:15.271454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 146/283] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:15.277015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84aad10-185d-4a7b-af8f-ec782ac52725 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:15.394280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84aad10-185d-4a7b-af8f-ec782ac52725 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:15.432090 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acb9db-2643-4dbc-a281-eeafce3178b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:15.433003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acb9db-2643-4dbc-a281-eeafce3178b7 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:15.433287 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acb9db-2643-4dbc-a281-eeafce3178b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:15.433563 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acb9db-2643-4dbc-a281-eeafce3178b7 None admin] PATH_INFO: `/v3/users/7bcb1fa9e2374b70a4b150501374d555` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:15.434790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acb9db-2643-4dbc-a281-eeafce3178b7 None admin] RBAC: Authorizing `identity:get_user(user_id=7bcb1fa9e2374b70a4b150501374d555)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:15.436828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acb9db-2643-4dbc-a281-eeafce3178b7 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:15.443175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 138/284] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:15 2022] GET /identity/v3/users/7bcb1fa9e2374b70a4b150501374d555 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:15.445283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1b77b-1d19-442f-b2a1-c976f5def249 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:15.559224 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1b77b-1d19-442f-b2a1-c976f5def249 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:15.619900 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953768e-8f3c-4c5c-a7d7-ddea1014388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:15.620794 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953768e-8f3c-4c5c-a7d7-ddea1014388b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:15.621081 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953768e-8f3c-4c5c-a7d7-ddea1014388b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:15.621358 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953768e-8f3c-4c5c-a7d7-ddea1014388b None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:15.625625 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953768e-8f3c-4c5c-a7d7-ddea1014388b None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:15.627296 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953768e-8f3c-4c5c-a7d7-ddea1014388b None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:15.630468 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 147/285] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:15 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:15.637565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acb9db-2643-4dbc-a281-eeafce3178b7 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:15.684675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:15.787035 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acb9db-2643-4dbc-a281-eeafce3178b7 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:15.846298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3319a0-b468-4579-bb73-a99cb3fd8059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:15.847121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3319a0-b468-4579-bb73-a99cb3fd8059 None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:15.847395 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3319a0-b468-4579-bb73-a99cb3fd8059 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:15.847673 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3319a0-b468-4579-bb73-a99cb3fd8059 None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3/users/7bcb1fa9e2374b70a4b150501374d555/roles/0896209e464b4256b7999b25e1972696` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:15.854121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3319a0-b468-4579-bb73-a99cb3fd8059 None admin] RBAC: Authorizing `identity:create_grant(project_id=292b6b0d819648b58526d1dda82420c3, user_id=7bcb1fa9e2374b70a4b150501374d555, role_id=0896209e464b4256b7999b25e1972696)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:15.855661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3319a0-b468-4579-bb73-a99cb3fd8059 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:15.935269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 139/286] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:37:15 2022] PUT /identity/v3/projects/292b6b0d819648b58526d1dda82420c3/users/7bcb1fa9e2374b70a4b150501374d555/roles/0896209e464b4256b7999b25e1972696 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:37:16.112904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d0326-66eb-4894-bf01-eb359d7f9120 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:16.113221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d0326-66eb-4894-bf01-eb359d7f9120 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:16.113467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d0326-66eb-4894-bf01-eb359d7f9120 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:16.114853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 148/287] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:37:16.120604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36b61e-cb06-4ac1-a3a0-f205b5286949 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:16.120911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36b61e-cb06-4ac1-a3a0-f205b5286949 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:16.121194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36b61e-cb06-4ac1-a3a0-f205b5286949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:16.139387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-6d36b61e-cb06-4ac1-a3a0-f205b5286949 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:16.140804 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6d36b61e-cb06-4ac1-a3a0-f205b5286949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:16.240224 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 140/288] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:16.271628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d0326-66eb-4894-bf01-eb359d7f9120 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:16.347686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:16.391240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d0326-66eb-4894-bf01-eb359d7f9120 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:16.429778 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc54c7-90bf-401d-94fd-73a177c56898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:16.430808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc54c7-90bf-401d-94fd-73a177c56898 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:16.431230 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc54c7-90bf-401d-94fd-73a177c56898 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:16.431663 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc54c7-90bf-401d-94fd-73a177c56898 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:16.443659 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc54c7-90bf-401d-94fd-73a177c56898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-afbc54c7-90bf-401d-94fd-73a177c56898 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:16.452524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:16.453600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:16.454586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:16.454586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:16.454586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:16.454586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:16.454586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:16.454586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:16.454586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:16.454586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:16.454586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:16.454586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:16.454586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:16.454586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:16.460742 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 149/289] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:16.462853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36b61e-cb06-4ac1-a3a0-f205b5286949 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:16.476998 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:16.586381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36b61e-cb06-4ac1-a3a0-f205b5286949 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:16.632208 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cac747-37c1-4a7f-92ab-112f7f4d709a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:16.632931 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cac747-37c1-4a7f-92ab-112f7f4d709a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:16.633219 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cac747-37c1-4a7f-92ab-112f7f4d709a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:16.633498 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cac747-37c1-4a7f-92ab-112f7f4d709a None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:16.634267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cac747-37c1-4a7f-92ab-112f7f4d709a None admin] RBAC: Adding query filter params (name=member) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:16.634577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cac747-37c1-4a7f-92ab-112f7f4d709a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:16.635957 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cac747-37c1-4a7f-92ab-112f7f4d709a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:16.645859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 141/290] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:16.651384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc54c7-90bf-401d-94fd-73a177c56898 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:16.788564 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc54c7-90bf-401d-94fd-73a177c56898 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:16.812744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:16.824525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65326d63-f608-40ed-8ec7-b903cd7a2763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:16.825967 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65326d63-f608-40ed-8ec7-b903cd7a2763 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:16.826500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65326d63-f608-40ed-8ec7-b903cd7a2763 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:16.826968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65326d63-f608-40ed-8ec7-b903cd7a2763 None admin] PATH_INFO: `/v3/users/8628d11f792842c09b281436bccb4400` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:16.828360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65326d63-f608-40ed-8ec7-b903cd7a2763 None admin] RBAC: Authorizing `identity:get_user(user_id=8628d11f792842c09b281436bccb4400)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:16.829963 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65326d63-f608-40ed-8ec7-b903cd7a2763 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:16.831750 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 150/291] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:16 2022] GET /identity/v3/users/8628d11f792842c09b281436bccb4400 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:16.843100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cac747-37c1-4a7f-92ab-112f7f4d709a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:16.948856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:16.999158 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cac747-37c1-4a7f-92ab-112f7f4d709a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:17.047134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3edb52-1ec0-470e-a3d7-5ff2762af420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:17.047790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3edb52-1ec0-470e-a3d7-5ff2762af420 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:17.048069 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3edb52-1ec0-470e-a3d7-5ff2762af420 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:17.048415 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3edb52-1ec0-470e-a3d7-5ff2762af420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:17.095565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f0dc8-26e7-4d45-aae3-9dc4a7f91157 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:17.096175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f0dc8-26e7-4d45-aae3-9dc4a7f91157 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:17.096684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f0dc8-26e7-4d45-aae3-9dc4a7f91157 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:17.098258 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 151/292] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:17.103614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a0a6c-f2af-48ae-b267-fbda9acc9735 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:17.104555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a0a6c-f2af-48ae-b267-fbda9acc9735 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:17.104857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a0a6c-f2af-48ae-b267-fbda9acc9735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:17.133236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-0e7a0a6c-f2af-48ae-b267-fbda9acc9735 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:17.137124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-0e7a0a6c-f2af-48ae-b267-fbda9acc9735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:17.164248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3edb52-1ec0-470e-a3d7-5ff2762af420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:17.165965 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3edb52-1ec0-470e-a3d7-5ff2762af420 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:17.252121 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 152/293] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:37:17.288853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a0a6c-f2af-48ae-b267-fbda9acc9735 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:17.319419 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:17.379535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 142/294] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:17.385053 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3edb52-1ec0-470e-a3d7-5ff2762af420 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:17.467927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a0a6c-f2af-48ae-b267-fbda9acc9735 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:17.509237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:17.535599 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac58a2-b701-485f-957e-f68a8df58ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:17.536411 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac58a2-b701-485f-957e-f68a8df58ee7 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:17.536716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac58a2-b701-485f-957e-f68a8df58ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:17.536998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac58a2-b701-485f-957e-f68a8df58ee7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:17.547924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3edb52-1ec0-470e-a3d7-5ff2762af420 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:17.560484 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac58a2-b701-485f-957e-f68a8df58ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-e5ac58a2-b701-485f-957e-f68a8df58ee7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:17.568807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:17.569686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:17.570497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:17.570497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:17.570497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:17.570497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:17.570497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:17.570497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:17.570497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:17.570497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:17.570497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:17.570497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:17.570497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:17.570497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:17.572261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 153/295] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:17.579289 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac58a2-b701-485f-957e-f68a8df58ee7 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:17.610230 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8168fa2-dee5-4091-8897-11d15f702a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:17.611410 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8168fa2-dee5-4091-8897-11d15f702a5f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:17.611880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8168fa2-dee5-4091-8897-11d15f702a5f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:17.612326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8168fa2-dee5-4091-8897-11d15f702a5f None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:17.613711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8168fa2-dee5-4091-8897-11d15f702a5f None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:17.615320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8168fa2-dee5-4091-8897-11d15f702a5f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:17.617520 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 143/296] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:17 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:17.618966 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef924f-2a87-4107-bfc4-ec94855b9a30 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:17.619411 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef924f-2a87-4107-bfc4-ec94855b9a30 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:17.619842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef924f-2a87-4107-bfc4-ec94855b9a30 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:17.621512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 144/297] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:17.624792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef924f-2a87-4107-bfc4-ec94855b9a30 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:17.679133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:17.730740 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac58a2-b701-485f-957e-f68a8df58ee7 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:17.748670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef924f-2a87-4107-bfc4-ec94855b9a30 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:17.776192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a0cc7-62bf-4d28-941e-3a43cac84c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:17.776889 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a0cc7-62bf-4d28-941e-3a43cac84c1c None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:17.777675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a0cc7-62bf-4d28-941e-3a43cac84c1c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:17.778018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a0cc7-62bf-4d28-941e-3a43cac84c1c None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:17.779140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a0cc7-62bf-4d28-941e-3a43cac84c1c None admin] RBAC: Adding query filter params (name=member) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:17.780040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a0cc7-62bf-4d28-941e-3a43cac84c1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:17.782151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a0cc7-62bf-4d28-941e-3a43cac84c1c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:17.786589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71822dcb-ba44-4171-b02b-80211cea201a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:17.787472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71822dcb-ba44-4171-b02b-80211cea201a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:17.787932 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71822dcb-ba44-4171-b02b-80211cea201a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:17.788398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71822dcb-ba44-4171-b02b-80211cea201a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:17.789365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71822dcb-ba44-4171-b02b-80211cea201a None admin] RBAC: Adding query filter params (role.id=4568d65f55c74c2bbc8265f34e62bbc4, scope.project.id=292b6b0d819648b58526d1dda82420c3, user.id=8628d11f792842c09b281436bccb4400) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:17.789878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71822dcb-ba44-4171-b02b-80211cea201a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:17.791481 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71822dcb-ba44-4171-b02b-80211cea201a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:17.797049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 154/298] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:17.797049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71feca-7093-4977-9dce-8b568155b2e9 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:17.797049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71feca-7093-4977-9dce-8b568155b2e9 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:17.797049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71feca-7093-4977-9dce-8b568155b2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:17.810272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 145/299] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:17 2022] GET /identity/v3/role_assignments?user.id=8628d11f792842c09b281436bccb4400&scope.project.id=292b6b0d819648b58526d1dda82420c3&role.id=4568d65f55c74c2bbc8265f34e62bbc4 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:17.810272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71822dcb-ba44-4171-b02b-80211cea201a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:17.831510 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-3e71feca-7093-4977-9dce-8b568155b2e9 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:17.832947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-3e71feca-7093-4977-9dce-8b568155b2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:17.911826 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:17.958462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 155/300] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:17.960180 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d93cd-a07d-40ab-94d2-dfa73e4b9073 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:17.960637 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d93cd-a07d-40ab-94d2-dfa73e4b9073 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:17.961104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d93cd-a07d-40ab-94d2-dfa73e4b9073 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:17.962561 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 156/301] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:17.974732 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb5108-08e7-48fb-bc76-248a12e71f84 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:17.975198 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb5108-08e7-48fb-bc76-248a12e71f84 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:17.975404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb5108-08e7-48fb-bc76-248a12e71f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:17.981275 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71822dcb-ba44-4171-b02b-80211cea201a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:17.982864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:17.994118 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-65bb5108-08e7-48fb-bc76-248a12e71f84 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:17.995328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-65bb5108-08e7-48fb-bc76-248a12e71f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:18.022350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91dbed-814a-47da-b964-0fe2ada8ce1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:18.023248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91dbed-814a-47da-b964-0fe2ada8ce1d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:18.023534 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91dbed-814a-47da-b964-0fe2ada8ce1d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:18.023817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91dbed-814a-47da-b964-0fe2ada8ce1d None admin] PATH_INFO: `/v3/users/82a75b2a33de4a2d99a71046b370c4da` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:18.025771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91dbed-814a-47da-b964-0fe2ada8ce1d None admin] RBAC: Authorizing `identity:get_user(user_id=82a75b2a33de4a2d99a71046b370c4da)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:18.028044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91dbed-814a-47da-b964-0fe2ada8ce1d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:18.030523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 146/302] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:17 2022] GET /identity/v3/users/82a75b2a33de4a2d99a71046b370c4da => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:18.031132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91dbed-814a-47da-b964-0fe2ada8ce1d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:18.082138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 157/303] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:37:18.084907 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb5108-08e7-48fb-bc76-248a12e71f84 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:18.148601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91dbed-814a-47da-b964-0fe2ada8ce1d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:18.186397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e09fb-f366-4ea0-a73b-214f94d4ff89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:18.187540 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e09fb-f366-4ea0-a73b-214f94d4ff89 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:18.187977 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e09fb-f366-4ea0-a73b-214f94d4ff89 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:18.188255 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e09fb-f366-4ea0-a73b-214f94d4ff89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:18.199321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e09fb-f366-4ea0-a73b-214f94d4ff89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:18.206166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb5108-08e7-48fb-bc76-248a12e71f84 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-083e09fb-f366-4ea0-a73b-214f94d4ff89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:18.207761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:18.208853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:18.209843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:18.209843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:18.209843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:18.209843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:18.209843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:18.209843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:18.209843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:18.209843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:18.209843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:18.209843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:18.209843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:37:18.209843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:18.210468 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:18.212994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 147/304] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:18.214045 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e09fb-f366-4ea0-a73b-214f94d4ff89 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:18.246069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6e2e3-ef85-4be3-9098-562d25aa7ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:18.246952 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6e2e3-ef85-4be3-9098-562d25aa7ef2 None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:18.247233 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6e2e3-ef85-4be3-9098-562d25aa7ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:18.247333 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:18.247506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6e2e3-ef85-4be3-9098-562d25aa7ef2 None admin] PATH_INFO: `/v3/system/users/82a75b2a33de4a2d99a71046b370c4da/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:18.249779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6e2e3-ef85-4be3-9098-562d25aa7ef2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=82a75b2a33de4a2d99a71046b370c4da, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:18.251163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6e2e3-ef85-4be3-9098-562d25aa7ef2 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:18.320227 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e09fb-f366-4ea0-a73b-214f94d4ff89 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:18.331287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 158/305] 10.222.0.44 () {58 vars in 1334 bytes} [Mon Jun 27 14:37:18 2022] PUT /identity/v3/system/users/82a75b2a33de4a2d99a71046b370c4da/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:37:18.333325 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6e2e3-ef85-4be3-9098-562d25aa7ef2 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:18.357322 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84571ec-cdf3-4dc4-b87a-12d6a48216e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:18.358587 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84571ec-cdf3-4dc4-b87a-12d6a48216e4 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:18.358877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84571ec-cdf3-4dc4-b87a-12d6a48216e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:18.359152 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84571ec-cdf3-4dc4-b87a-12d6a48216e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:18.360417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84571ec-cdf3-4dc4-b87a-12d6a48216e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:18.361948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84571ec-cdf3-4dc4-b87a-12d6a48216e4 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:18.363745 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 148/306] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:18.369592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84571ec-cdf3-4dc4-b87a-12d6a48216e4 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:18.485033 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:18.490659 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84571ec-cdf3-4dc4-b87a-12d6a48216e4 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:18.498839 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6e2e3-ef85-4be3-9098-562d25aa7ef2 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:18.538461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974df7e1-4c75-4a52-9a5c-68798bc96cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:18.539138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974df7e1-4c75-4a52-9a5c-68798bc96cd6 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:18.539423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974df7e1-4c75-4a52-9a5c-68798bc96cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:18.539706 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974df7e1-4c75-4a52-9a5c-68798bc96cd6 None admin] PATH_INFO: `/v3/groups` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:18.540405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974df7e1-4c75-4a52-9a5c-68798bc96cd6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:18.542139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974df7e1-4c75-4a52-9a5c-68798bc96cd6 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:18.543528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ccfab-544b-465e-acb6-151116789994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:18.544388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ccfab-544b-465e-acb6-151116789994 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:18.544905 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ccfab-544b-465e-acb6-151116789994 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:18.545376 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ccfab-544b-465e-acb6-151116789994 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:18.546433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ccfab-544b-465e-acb6-151116789994 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:18.546917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ccfab-544b-465e-acb6-151116789994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:18.548474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ccfab-544b-465e-acb6-151116789994 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:18.558186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 159/307] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:18.564733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ccfab-544b-465e-acb6-151116789994 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:18.596932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:18.613093 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 149/308] 10.222.0.44 () {60 vars in 1134 bytes} [Mon Jun 27 14:37:18 2022] POST /identity/v3/groups => generated 229 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:37:18.690294 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ccfab-544b-465e-acb6-151116789994 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:18.704532 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37490db3-b740-4355-8b52-9d8933408118 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:18.704862 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37490db3-b740-4355-8b52-9d8933408118 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:18.705145 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37490db3-b740-4355-8b52-9d8933408118 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:18.706688 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 150/309] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:37:18.711991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd70c8-83f8-4997-a3da-da13ccd353b0 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:18.712268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd70c8-83f8-4997-a3da-da13ccd353b0 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:18.712544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd70c8-83f8-4997-a3da-da13ccd353b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:18.730910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-1ffd70c8-83f8-4997-a3da-da13ccd353b0 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:18.731448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ad0d9-0169-45a0-a2aa-f052a5110c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:18.732122 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-1ffd70c8-83f8-4997-a3da-da13ccd353b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:18.732339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ad0d9-0169-45a0-a2aa-f052a5110c7d None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:18.732698 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ad0d9-0169-45a0-a2aa-f052a5110c7d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:18.733262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ad0d9-0169-45a0-a2aa-f052a5110c7d None admin] PATH_INFO: `/v3/users/1f04760c1c544c47ad6464cd53cba193` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:18.753469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ad0d9-0169-45a0-a2aa-f052a5110c7d None admin] RBAC: Authorizing `identity:get_user(user_id=1f04760c1c544c47ad6464cd53cba193)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:18.754950 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ad0d9-0169-45a0-a2aa-f052a5110c7d None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:18.757060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 160/310] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:18 2022] GET /identity/v3/users/1f04760c1c544c47ad6464cd53cba193 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:18.765331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ad0d9-0169-45a0-a2aa-f052a5110c7d None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:18.823690 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 151/311] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:37:18.852581 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd70c8-83f8-4997-a3da-da13ccd353b0 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:18.864849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:18.881079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ad0d9-0169-45a0-a2aa-f052a5110c7d None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:18.921752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a1351-9abf-497a-bc95-d7d117c1fa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:18.926922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a1351-9abf-497a-bc95-d7d117c1fa01 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:18.926922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a1351-9abf-497a-bc95-d7d117c1fa01 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:18.926922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a1351-9abf-497a-bc95-d7d117c1fa01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:18.926922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a1351-9abf-497a-bc95-d7d117c1fa01 None admin] RBAC: Adding query filter params (role.id=0896209e464b4256b7999b25e1972696, user.id=1f04760c1c544c47ad6464cd53cba193, scope.system=all) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:18.926922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a1351-9abf-497a-bc95-d7d117c1fa01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:18.926922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a1351-9abf-497a-bc95-d7d117c1fa01 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:18.939456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 161/312] 10.222.0.44 () {56 vars in 1308 bytes} [Mon Jun 27 14:37:18 2022] GET /identity/v3/role_assignments?user.id=1f04760c1c544c47ad6464cd53cba193&scope.system=all&role.id=0896209e464b4256b7999b25e1972696 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:18.941824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:18.955894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd70c8-83f8-4997-a3da-da13ccd353b0 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:18.995577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c183a-a4ef-4cac-830c-0efde46dd073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:18.996794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c183a-a4ef-4cac-830c-0efde46dd073 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:18.997304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c183a-a4ef-4cac-830c-0efde46dd073 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:18.997779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c183a-a4ef-4cac-830c-0efde46dd073 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:19.010693 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c183a-a4ef-4cac-830c-0efde46dd073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-e31c183a-a4ef-4cac-830c-0efde46dd073 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:19.020009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:19.021018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:19.021796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:19.021796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:19.021796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:19.021796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:19.021796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:19.021796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:19.021796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:19.021796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:19.021796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:19.021796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:19.021796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:37:19.021796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:19.028783 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 152/313] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:37:19.031106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a1351-9abf-497a-bc95-d7d117c1fa01 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:19.149139 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a1351-9abf-497a-bc95-d7d117c1fa01 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:19.187612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a4245-29bb-47d5-a5e7-dd9480493dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:19.188285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a4245-29bb-47d5-a5e7-dd9480493dea None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:19.188569 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a4245-29bb-47d5-a5e7-dd9480493dea None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:19.188870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a4245-29bb-47d5-a5e7-dd9480493dea None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:19.189622 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a4245-29bb-47d5-a5e7-dd9480493dea None admin] RBAC: Adding query filter params (name=reader) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:19.189929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a4245-29bb-47d5-a5e7-dd9480493dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:19.191277 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a4245-29bb-47d5-a5e7-dd9480493dea None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:19.200593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 162/314] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:19.206396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c183a-a4ef-4cac-830c-0efde46dd073 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:19.313171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c183a-a4ef-4cac-830c-0efde46dd073 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:19.348739 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db4f1f-8eee-4f6a-bd90-3561229399c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:19.349605 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db4f1f-8eee-4f6a-bd90-3561229399c4 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:19.349884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db4f1f-8eee-4f6a-bd90-3561229399c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:19.350157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db4f1f-8eee-4f6a-bd90-3561229399c4 None admin] PATH_INFO: `/v3/users/7bcb1fa9e2374b70a4b150501374d555` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:19.351341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db4f1f-8eee-4f6a-bd90-3561229399c4 None admin] RBAC: Authorizing `identity:get_user(user_id=7bcb1fa9e2374b70a4b150501374d555)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:19.352799 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db4f1f-8eee-4f6a-bd90-3561229399c4 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:19.354698 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 153/315] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:19 2022] GET /identity/v3/users/7bcb1fa9e2374b70a4b150501374d555 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:19.360464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a4245-29bb-47d5-a5e7-dd9480493dea None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:19.380459 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:19.473665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a4245-29bb-47d5-a5e7-dd9480493dea None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:19.513066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd7f45-b971-4db6-9c2b-a08eb7395152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:19.514275 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd7f45-b971-4db6-9c2b-a08eb7395152 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:19.514587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd7f45-b971-4db6-9c2b-a08eb7395152 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:19.514928 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd7f45-b971-4db6-9c2b-a08eb7395152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:19.587143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd7f45-b971-4db6-9c2b-a08eb7395152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:19.588594 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd7f45-b971-4db6-9c2b-a08eb7395152 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:19.603012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:19.696112 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 163/316] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:19.702799 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db4f1f-8eee-4f6a-bd90-3561229399c4 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:19.729950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:19.812628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db4f1f-8eee-4f6a-bd90-3561229399c4 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:19.848708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392656e-cf79-4c10-ab23-adce165ffb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:19.849831 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392656e-cf79-4c10-ab23-adce165ffb88 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:19.850255 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392656e-cf79-4c10-ab23-adce165ffb88 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:19.850666 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392656e-cf79-4c10-ab23-adce165ffb88 None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:19.851983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392656e-cf79-4c10-ab23-adce165ffb88 None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:19.853764 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392656e-cf79-4c10-ab23-adce165ffb88 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:19.855898 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 154/317] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:19 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:19.862101 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd7f45-b971-4db6-9c2b-a08eb7395152 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:19.964707 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd7f45-b971-4db6-9c2b-a08eb7395152 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:19.987155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:20.007563 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a4946-c26f-4b14-a585-64b7d7158909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:20.008454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4946-c26f-4b14-a585-64b7d7158909 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:20.008916 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4946-c26f-4b14-a585-64b7d7158909 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:20.009365 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4946-c26f-4b14-a585-64b7d7158909 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:20.010347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a4946-c26f-4b14-a585-64b7d7158909 None admin] RBAC: Adding query filter params (role.id=0896209e464b4256b7999b25e1972696, scope.project.id=292b6b0d819648b58526d1dda82420c3, user.id=7bcb1fa9e2374b70a4b150501374d555) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:20.010834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a4946-c26f-4b14-a585-64b7d7158909 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:20.012427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a4946-c26f-4b14-a585-64b7d7158909 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:20.020044 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 164/318] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:19 2022] GET /identity/v3/role_assignments?user.id=7bcb1fa9e2374b70a4b150501374d555&scope.project.id=292b6b0d819648b58526d1dda82420c3&role.id=0896209e464b4256b7999b25e1972696 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:20.535131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360afc5-3ef4-4da2-aafd-9692bc54c79a None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:20.535417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360afc5-3ef4-4da2-aafd-9692bc54c79a None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:20.535877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360afc5-3ef4-4da2-aafd-9692bc54c79a None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:20.537420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 155/319] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:20.542577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d470979-f795-4b1a-b972-e248de1d0d22 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:20.543345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d470979-f795-4b1a-b972-e248de1d0d22 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:20.543785 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d470979-f795-4b1a-b972-e248de1d0d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:20.561168 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-3d470979-f795-4b1a-b972-e248de1d0d22 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:20.562602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-3d470979-f795-4b1a-b972-e248de1d0d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:20.630702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 165/320] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:20.655845 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360afc5-3ef4-4da2-aafd-9692bc54c79a None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:20.746030 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:20.748631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad3a90-bb7b-4ea9-a35f-a0b76c9e1cf8 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:20.748969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad3a90-bb7b-4ea9-a35f-a0b76c9e1cf8 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:20.749203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad3a90-bb7b-4ea9-a35f-a0b76c9e1cf8 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:20.750744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 166/321] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:20.755523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f539b-5b27-4afd-81dc-b70c9d1de2f5 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:20.755813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f539b-5b27-4afd-81dc-b70c9d1de2f5 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:20.756089 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f539b-5b27-4afd-81dc-b70c9d1de2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:20.764687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360afc5-3ef4-4da2-aafd-9692bc54c79a None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:20.772513 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-5d2f539b-5b27-4afd-81dc-b70c9d1de2f5 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:20.773704 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-5d2f539b-5b27-4afd-81dc-b70c9d1de2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:20.802638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871c29a-c067-4959-b941-1a9336bd1da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:20.803664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871c29a-c067-4959-b941-1a9336bd1da9 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:20.803998 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871c29a-c067-4959-b941-1a9336bd1da9 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:20.804211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871c29a-c067-4959-b941-1a9336bd1da9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:20.814901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871c29a-c067-4959-b941-1a9336bd1da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-a871c29a-c067-4959-b941-1a9336bd1da9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:20.822819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:20.823711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:20.824522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:20.824522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:20.824522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:20.824522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:20.824522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:20.824522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:20.824522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:20.824522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:20.824522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:20.824522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:20.824522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:20.824522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:20.824522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 156/322] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:20.830421 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871c29a-c067-4959-b941-1a9336bd1da9 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:20.849748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 167/323] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:37:20.872402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f539b-5b27-4afd-81dc-b70c9d1de2f5 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:20.911176 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:20.942488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871c29a-c067-4959-b941-1a9336bd1da9 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:20.980610 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc9436-f440-4d33-b5d9-9f7c4f2f9234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:20.981232 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc9436-f440-4d33-b5d9-9f7c4f2f9234 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:20.981518 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc9436-f440-4d33-b5d9-9f7c4f2f9234 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:20.981916 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc9436-f440-4d33-b5d9-9f7c4f2f9234 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:20.982679 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc9436-f440-4d33-b5d9-9f7c4f2f9234 None admin] RBAC: Adding query filter params (name=member) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:20.983225 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc9436-f440-4d33-b5d9-9f7c4f2f9234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:20.984621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc9436-f440-4d33-b5d9-9f7c4f2f9234 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:20.984858 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f539b-5b27-4afd-81dc-b70c9d1de2f5 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:20.993145 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 157/324] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:20.999126 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc9436-f440-4d33-b5d9-9f7c4f2f9234 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:21.010601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:21.024680 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac98fd2-114d-4dde-a066-a05845d730fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:21.025479 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac98fd2-114d-4dde-a066-a05845d730fa None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:21.025764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac98fd2-114d-4dde-a066-a05845d730fa None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:21.026056 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac98fd2-114d-4dde-a066-a05845d730fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:21.027237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac98fd2-114d-4dde-a066-a05845d730fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:21.028826 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac98fd2-114d-4dde-a066-a05845d730fa None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:21.031690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 168/325] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:21.037334 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac98fd2-114d-4dde-a066-a05845d730fa None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:21.107926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc9436-f440-4d33-b5d9-9f7c4f2f9234 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:21.140543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374acbee-4bb0-4eb1-90d4-d7f27047f5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:21.141429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374acbee-4bb0-4eb1-90d4-d7f27047f5aa None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:21.141708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374acbee-4bb0-4eb1-90d4-d7f27047f5aa None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:21.141979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374acbee-4bb0-4eb1-90d4-d7f27047f5aa None admin] PATH_INFO: `/v3/users/82a75b2a33de4a2d99a71046b370c4da` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:21.142229 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac98fd2-114d-4dde-a066-a05845d730fa None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:21.143149 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374acbee-4bb0-4eb1-90d4-d7f27047f5aa None admin] RBAC: Authorizing `identity:get_user(user_id=82a75b2a33de4a2d99a71046b370c4da)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:21.145075 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:21.145185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374acbee-4bb0-4eb1-90d4-d7f27047f5aa None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:21.146185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 158/326] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:20 2022] GET /identity/v3/users/82a75b2a33de4a2d99a71046b370c4da => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:21.147344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b90b1a-b5ff-46d2-9138-c4d03dcde91c None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:21.147624 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b90b1a-b5ff-46d2-9138-c4d03dcde91c None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:21.147895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b90b1a-b5ff-46d2-9138-c4d03dcde91c None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:21.149310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 159/327] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:21.153921 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b90b1a-b5ff-46d2-9138-c4d03dcde91c None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:21.177179 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557e257-c36c-430f-ba5e-07a9e0f6c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:21.177845 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557e257-c36c-430f-ba5e-07a9e0f6c2c2 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:21.178128 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557e257-c36c-430f-ba5e-07a9e0f6c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:21.178408 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557e257-c36c-430f-ba5e-07a9e0f6c2c2 None admin] PATH_INFO: `/v3/groups` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:21.179100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557e257-c36c-430f-ba5e-07a9e0f6c2c2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:21.180530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557e257-c36c-430f-ba5e-07a9e0f6c2c2 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:21.230467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:21.244548 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 169/328] 10.222.0.44 () {60 vars in 1134 bytes} [Mon Jun 27 14:37:21 2022] POST /identity/v3/groups => generated 226 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:37:21.246088 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903c502-a286-41cb-953f-931880d3ca12 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:21.246534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903c502-a286-41cb-953f-931880d3ca12 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:21.247047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903c502-a286-41cb-953f-931880d3ca12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:21.256972 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b90b1a-b5ff-46d2-9138-c4d03dcde91c None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:21.269790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1903c502-a286-41cb-953f-931880d3ca12 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:21.272045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1903c502-a286-41cb-953f-931880d3ca12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:21.297934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bb0b3-5f5b-4b76-a217-ad673699fa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:21.298668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bb0b3-5f5b-4b76-a217-ad673699fa83 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:21.298953 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bb0b3-5f5b-4b76-a217-ad673699fa83 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:21.299279 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bb0b3-5f5b-4b76-a217-ad673699fa83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:21.300282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bb0b3-5f5b-4b76-a217-ad673699fa83 None admin] RBAC: Adding query filter params (role.id=4568d65f55c74c2bbc8265f34e62bbc4, user.id=82a75b2a33de4a2d99a71046b370c4da, scope.system=all) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:21.300604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bb0b3-5f5b-4b76-a217-ad673699fa83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:21.302251 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bb0b3-5f5b-4b76-a217-ad673699fa83 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:21.317857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 160/329] 10.222.0.44 () {56 vars in 1308 bytes} [Mon Jun 27 14:37:21 2022] GET /identity/v3/role_assignments?user.id=82a75b2a33de4a2d99a71046b370c4da&scope.system=all&role.id=4568d65f55c74c2bbc8265f34e62bbc4 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:21.352528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 170/330] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:21.376393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bb0b3-5f5b-4b76-a217-ad673699fa83 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:21.492265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bb0b3-5f5b-4b76-a217-ad673699fa83 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:21.528790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:21.531076 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44242507-b08e-40d2-bc57-0347d639c9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:21.531880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44242507-b08e-40d2-bc57-0347d639c9b2 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:21.532223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44242507-b08e-40d2-bc57-0347d639c9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:21.532532 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44242507-b08e-40d2-bc57-0347d639c9b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:21.543498 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44242507-b08e-40d2-bc57-0347d639c9b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-44242507-b08e-40d2-bc57-0347d639c9b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:21.551369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:21.552350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:21.553426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:21.553426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:21.553426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:21.553426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:21.553426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:21.553426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:21.553426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:21.553426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:21.553426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:21.553426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:21.553426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:37:21.553426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:21.553426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 161/331] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:21.558906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903c502-a286-41cb-953f-931880d3ca12 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:21.661577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:21.668477 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903c502-a286-41cb-953f-931880d3ca12 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:21.709986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e804c2-7fb1-49e8-98b6-d69f19cd0f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:21.710664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e804c2-7fb1-49e8-98b6-d69f19cd0f97 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:21.710947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e804c2-7fb1-49e8-98b6-d69f19cd0f97 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:21.711226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e804c2-7fb1-49e8-98b6-d69f19cd0f97 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:21.712062 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e804c2-7fb1-49e8-98b6-d69f19cd0f97 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:21.712367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e804c2-7fb1-49e8-98b6-d69f19cd0f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:21.713840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e804c2-7fb1-49e8-98b6-d69f19cd0f97 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:21.724705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 171/332] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:21.730489 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44242507-b08e-40d2-bc57-0347d639c9b2 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:21.844205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44242507-b08e-40d2-bc57-0347d639c9b2 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:21.889091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f915e8-91bd-4c0f-9c00-1927ab98c4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:21.890443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f915e8-91bd-4c0f-9c00-1927ab98c4e7 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:21.890936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f915e8-91bd-4c0f-9c00-1927ab98c4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:21.891504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f915e8-91bd-4c0f-9c00-1927ab98c4e7 None admin] PATH_INFO: `/v3/users/1f04760c1c544c47ad6464cd53cba193` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:21.893090 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f915e8-91bd-4c0f-9c00-1927ab98c4e7 None admin] RBAC: Authorizing `identity:get_user(user_id=1f04760c1c544c47ad6464cd53cba193)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:21.894729 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f915e8-91bd-4c0f-9c00-1927ab98c4e7 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:21.899409 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 162/333] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:21 2022] GET /identity/v3/users/1f04760c1c544c47ad6464cd53cba193 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:21.902882 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e804c2-7fb1-49e8-98b6-d69f19cd0f97 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:22.023224 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e804c2-7fb1-49e8-98b6-d69f19cd0f97 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:22.059263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c723e51-abec-42ce-b26b-0d7005204d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:22.061093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c723e51-abec-42ce-b26b-0d7005204d4c None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:22.061574 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c723e51-abec-42ce-b26b-0d7005204d4c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:22.062039 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c723e51-abec-42ce-b26b-0d7005204d4c None admin] PATH_INFO: `/v3/system/users/1f04760c1c544c47ad6464cd53cba193/roles/0896209e464b4256b7999b25e1972696` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:22.063758 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c723e51-abec-42ce-b26b-0d7005204d4c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1f04760c1c544c47ad6464cd53cba193, role_id=0896209e464b4256b7999b25e1972696)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:22.065361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c723e51-abec-42ce-b26b-0d7005204d4c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:22.136953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 172/334] 10.222.0.44 () {58 vars in 1334 bytes} [Mon Jun 27 14:37:21 2022] PUT /identity/v3/system/users/1f04760c1c544c47ad6464cd53cba193/roles/0896209e464b4256b7999b25e1972696 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:37:23.981096 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafbb8a-b9eb-4efd-934d-30403eab7d5c None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:23.982111 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafbb8a-b9eb-4efd-934d-30403eab7d5c None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:23.983136 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafbb8a-b9eb-4efd-934d-30403eab7d5c None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:23.985135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 163/335] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:23.991276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e59c86-4ee6-4e04-a9b2-a8fac6aee3e4 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:23.992144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e59c86-4ee6-4e04-a9b2-a8fac6aee3e4 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:23.992620 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e59c86-4ee6-4e04-a9b2-a8fac6aee3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:24.013656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-87e59c86-4ee6-4e04-a9b2-a8fac6aee3e4 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:24.015174 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-87e59c86-4ee6-4e04-a9b2-a8fac6aee3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:24.035358 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:24.067716 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64b3dd-ad69-4a45-9217-85494b3536bf None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:24.068050 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64b3dd-ad69-4a45-9217-85494b3536bf None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:24.068273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64b3dd-ad69-4a45-9217-85494b3536bf None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:24.070061 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 164/336] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:24.076864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3807-e39d-41d3-a946-36492543d4f1 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:24.077168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3807-e39d-41d3-a946-36492543d4f1 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:24.077428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3807-e39d-41d3-a946-36492543d4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:24.105954 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-54db3807-e39d-41d3-a946-36492543d4f1 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:24.106974 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-54db3807-e39d-41d3-a946-36492543d4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:24.125797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 173/337] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:24.166838 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e59c86-4ee6-4e04-a9b2-a8fac6aee3e4 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:24.214462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:24.239312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 165/338] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:24.285142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db3807-e39d-41d3-a946-36492543d4f1 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:24.356479 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e59c86-4ee6-4e04-a9b2-a8fac6aee3e4 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:24.454262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaaa41-122a-42ad-b9ea-b0a326acd855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:24.455071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaaa41-122a-42ad-b9ea-b0a326acd855 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:24.455351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaaa41-122a-42ad-b9ea-b0a326acd855 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:24.455624 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaaa41-122a-42ad-b9ea-b0a326acd855 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:24.493655 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaaa41-122a-42ad-b9ea-b0a326acd855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:24.504416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db3807-e39d-41d3-a946-36492543d4f1 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-43aaaa41-122a-42ad-b9ea-b0a326acd855 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:24.505836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:24.506675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:24.507458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:24.507458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:24.507458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:24.507458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:24.507458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:24.507458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:24.507458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:24.507458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:24.507458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:24.507458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:24.507458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:24.507458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:24.507458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 174/339] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:37:24.520625 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaaa41-122a-42ad-b9ea-b0a326acd855 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:24.548994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:24.582569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dc246-095d-482f-a9f2-33539a570a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:24.583549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dc246-095d-482f-a9f2-33539a570a4e None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:24.583834 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dc246-095d-482f-a9f2-33539a570a4e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:24.584112 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dc246-095d-482f-a9f2-33539a570a4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:24.605867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dc246-095d-482f-a9f2-33539a570a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-5c1dc246-095d-482f-a9f2-33539a570a4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:24.615737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:24.616608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:24.617469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:24.617469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:24.617469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:24.617469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:24.617469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:24.617469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:24.617469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:24.617469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:24.617469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:24.617469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:24.617469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:24.617469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:24.621742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 166/340] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:37:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:37:24.629081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dc246-095d-482f-a9f2-33539a570a4e None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:24.729004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:24.746548 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaaa41-122a-42ad-b9ea-b0a326acd855 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:24.787420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dc246-095d-482f-a9f2-33539a570a4e None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:24.789353 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f8cab-813e-40ef-b26a-fb341e248c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:24.790353 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f8cab-813e-40ef-b26a-fb341e248c4f None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:24.790869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f8cab-813e-40ef-b26a-fb341e248c4f None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:24.791333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f8cab-813e-40ef-b26a-fb341e248c4f None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:24.792291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f8cab-813e-40ef-b26a-fb341e248c4f None admin] RBAC: Adding query filter params (name=member) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:24.792825 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f8cab-813e-40ef-b26a-fb341e248c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:24.794394 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f8cab-813e-40ef-b26a-fb341e248c4f None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:24.805940 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 175/341] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:24.809273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4036968-a84f-4f47-930b-025ea5cbe3c6 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:24.809891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4036968-a84f-4f47-930b-025ea5cbe3c6 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:24.811011 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4036968-a84f-4f47-930b-025ea5cbe3c6 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:24.812665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 176/342] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:24.813645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4036968-a84f-4f47-930b-025ea5cbe3c6 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:24.830600 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a3ac4-1198-4c37-886d-f27b3f9c17ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:24.831698 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a3ac4-1198-4c37-886d-f27b3f9c17ac None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:24.832174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a3ac4-1198-4c37-886d-f27b3f9c17ac None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:24.832637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a3ac4-1198-4c37-886d-f27b3f9c17ac None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:24.833900 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a3ac4-1198-4c37-886d-f27b3f9c17ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:24.834399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a3ac4-1198-4c37-886d-f27b3f9c17ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:24.835981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a3ac4-1198-4c37-886d-f27b3f9c17ac None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:24.851853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 167/343] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:24.853570 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c76882-6993-44f8-b154-58c63a236181 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:24.854017 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c76882-6993-44f8-b154-58c63a236181 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:24.854449 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c76882-6993-44f8-b154-58c63a236181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:24.883507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-65c76882-6993-44f8-b154-58c63a236181 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:24.883507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-65c76882-6993-44f8-b154-58c63a236181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:24.923347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:24.999161 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4036968-a84f-4f47-930b-025ea5cbe3c6 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:25.066670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 168/344] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:25.068693 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c76882-6993-44f8-b154-58c63a236181 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:25.095560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d5736-fbd9-46d2-9933-beb213b3da21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:25.096318 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d5736-fbd9-46d2-9933-beb213b3da21 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:25.096610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d5736-fbd9-46d2-9933-beb213b3da21 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:25.096916 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d5736-fbd9-46d2-9933-beb213b3da21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:25.170473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:25.205338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d5736-fbd9-46d2-9933-beb213b3da21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:25.206856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d5736-fbd9-46d2-9933-beb213b3da21 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:25.284220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:25.294655 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c76882-6993-44f8-b154-58c63a236181 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:25.319700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 177/345] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:25.321265 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d5736-fbd9-46d2-9933-beb213b3da21 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:25.372369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547faa6-d39a-4a30-803a-1edfeee98d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:25.375596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547faa6-d39a-4a30-803a-1edfeee98d76 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:25.379524 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547faa6-d39a-4a30-803a-1edfeee98d76 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:25.380076 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547faa6-d39a-4a30-803a-1edfeee98d76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:25.442507 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d5736-fbd9-46d2-9933-beb213b3da21 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:25.496937 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc8586-256a-47d5-ae2d-6295f4c56b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:25.497795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8586-256a-47d5-ae2d-6295f4c56b43 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:25.498135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8586-256a-47d5-ae2d-6295f4c56b43 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:25.498625 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8586-256a-47d5-ae2d-6295f4c56b43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:25.518931 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc8586-256a-47d5-ae2d-6295f4c56b43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-82cc8586-256a-47d5-ae2d-6295f4c56b43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:25.527093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:25.528099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:25.528983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:25.528983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:25.528983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:25.528983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:25.528983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:25.528983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:25.528983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:25.528983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:25.528983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:25.528983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:25.528983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:25.528983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:25.528983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 178/346] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:25.530354 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa0254-4561-4dc0-9fde-325cc4023470 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:25.531346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa0254-4561-4dc0-9fde-325cc4023470 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:25.531346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa0254-4561-4dc0-9fde-325cc4023470 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:25.532516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 179/347] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:25.535815 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa0254-4561-4dc0-9fde-325cc4023470 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:25.539646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547faa6-d39a-4a30-803a-1edfeee98d76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:25.541479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547faa6-d39a-4a30-803a-1edfeee98d76 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:25.582898 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:25.597879 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:25.663293 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa0254-4561-4dc0-9fde-325cc4023470 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:25.665280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 169/348] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:25.666604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291e6a3-e268-43f4-89af-4e706d103adb None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:25.666889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291e6a3-e268-43f4-89af-4e706d103adb None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:25.667602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291e6a3-e268-43f4-89af-4e706d103adb None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:25.668673 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 170/349] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:25.674280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291e6a3-e268-43f4-89af-4e706d103adb None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:25.710483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0a1d8-a9f9-430f-a25b-32365b3e526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:25.711346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0a1d8-a9f9-430f-a25b-32365b3e526e None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:25.711631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0a1d8-a9f9-430f-a25b-32365b3e526e None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:25.711909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0a1d8-a9f9-430f-a25b-32365b3e526e None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:25.714078 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0a1d8-a9f9-430f-a25b-32365b3e526e None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:25.715506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0a1d8-a9f9-430f-a25b-32365b3e526e None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:25.717981 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 180/350] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:25 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:25.719162 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e9d34-35a8-46ad-88df-17ec49ec3e54 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:25.719450 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e9d34-35a8-46ad-88df-17ec49ec3e54 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:25.719731 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e9d34-35a8-46ad-88df-17ec49ec3e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:25.737680 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-7c1e9d34-35a8-46ad-88df-17ec49ec3e54 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:25.738876 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7c1e9d34-35a8-46ad-88df-17ec49ec3e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:25.798263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291e6a3-e268-43f4-89af-4e706d103adb None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:25.819792 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 181/351] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:25.821022 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500dba4-9cc5-47b4-b139-6cc713bc2fad None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:25.821318 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500dba4-9cc5-47b4-b139-6cc713bc2fad None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:25.821575 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500dba4-9cc5-47b4-b139-6cc713bc2fad None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:25.822946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 182/352] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:25.823513 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500dba4-9cc5-47b4-b139-6cc713bc2fad None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:25.840625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d0357-63c2-47a7-8c72-3513aebcc057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:25.842196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d0357-63c2-47a7-8c72-3513aebcc057 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:25.842681 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d0357-63c2-47a7-8c72-3513aebcc057 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:25.843154 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d0357-63c2-47a7-8c72-3513aebcc057 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:25.844105 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d0357-63c2-47a7-8c72-3513aebcc057 None admin] RBAC: Adding query filter params (name=member) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:25.844672 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d0357-63c2-47a7-8c72-3513aebcc057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:25.846181 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d0357-63c2-47a7-8c72-3513aebcc057 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:25.855593 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 171/353] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:25.856006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cd433-6241-498c-b353-56d1342e5fd7 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:25.856356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cd433-6241-498c-b353-56d1342e5fd7 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:25.856670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cd433-6241-498c-b353-56d1342e5fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:25.863809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:25.869432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:25.874858 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-284cd433-6241-498c-b353-56d1342e5fd7 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:25.876464 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-284cd433-6241-498c-b353-56d1342e5fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:25.956624 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500dba4-9cc5-47b4-b139-6cc713bc2fad None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:25.957055 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 172/354] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:25.958163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cd433-6241-498c-b353-56d1342e5fd7 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:25.997173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e319b-3efa-4e61-b145-41491c486887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:25.998059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e319b-3efa-4e61-b145-41491c486887 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:25.998336 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e319b-3efa-4e61-b145-41491c486887 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:25.998603 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e319b-3efa-4e61-b145-41491c486887 None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:26.001904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e319b-3efa-4e61-b145-41491c486887 None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:26.003495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e319b-3efa-4e61-b145-41491c486887 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:26.005421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 183/355] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:25 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:26.006619 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00804484-524b-4054-b548-f4ad2328c196 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:26.006886 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00804484-524b-4054-b548-f4ad2328c196 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:26.007164 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00804484-524b-4054-b548-f4ad2328c196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:26.026508 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-00804484-524b-4054-b548-f4ad2328c196 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:26.027722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-00804484-524b-4054-b548-f4ad2328c196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:26.073866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cd433-6241-498c-b353-56d1342e5fd7 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:26.116852 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c199c-c189-4100-919e-9bcfe44caeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:26.117708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c199c-c189-4100-919e-9bcfe44caeea None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:26.117978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c199c-c189-4100-919e-9bcfe44caeea None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:26.118254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c199c-c189-4100-919e-9bcfe44caeea None admin] PATH_INFO: `/v3/groups/93917be20e754474af0b8ac38c49f957` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:26.120753 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:26.126074 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 184/356] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:26.126546 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c199c-c189-4100-919e-9bcfe44caeea None admin] RBAC: Authorizing `identity:get_group(group_id=93917be20e754474af0b8ac38c49f957)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:26.127341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00804484-524b-4054-b548-f4ad2328c196 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:26.128179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c199c-c189-4100-919e-9bcfe44caeea None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:26.130002 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 173/357] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Jun 27 14:37:25 2022] GET /identity/v3/groups/93917be20e754474af0b8ac38c49f957 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:26.133502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c199c-c189-4100-919e-9bcfe44caeea None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:26.162150 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:26.251700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00804484-524b-4054-b548-f4ad2328c196 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:26.252047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c199c-c189-4100-919e-9bcfe44caeea None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:26.291613 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af85388-71a6-4af3-8032-2707ef5a9f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:26.292720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af85388-71a6-4af3-8032-2707ef5a9f0f None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:26.293154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af85388-71a6-4af3-8032-2707ef5a9f0f None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:26.293427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af85388-71a6-4af3-8032-2707ef5a9f0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:26.295699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2acbd1-d79c-4362-866e-93274002ccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:26.296538 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2acbd1-d79c-4362-866e-93274002ccfa None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:26.296842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2acbd1-d79c-4362-866e-93274002ccfa None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:26.297114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2acbd1-d79c-4362-866e-93274002ccfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:26.306901 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af85388-71a6-4af3-8032-2707ef5a9f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-6af85388-71a6-4af3-8032-2707ef5a9f0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:26.315165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:26.316093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:26.317381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:26.317381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:26.317381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:26.317381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:26.317381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:26.317381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:26.317381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:26.317381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:26.317381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:26.317381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:26.317381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 14:37:26.317381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:26.317381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 185/358] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:26.318221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af85388-71a6-4af3-8032-2707ef5a9f0f None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:26.382948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:26.386282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2acbd1-d79c-4362-866e-93274002ccfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:26.388099 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2acbd1-d79c-4362-866e-93274002ccfa None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:26.424455 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:26.439011 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af85388-71a6-4af3-8032-2707ef5a9f0f None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:26.479880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cf6e6-cefc-414a-94a7-87df47b89b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:26.480696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cf6e6-cefc-414a-94a7-87df47b89b52 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:26.480986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cf6e6-cefc-414a-94a7-87df47b89b52 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:26.481262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cf6e6-cefc-414a-94a7-87df47b89b52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:26.494001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cf6e6-cefc-414a-94a7-87df47b89b52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-206cf6e6-cefc-414a-94a7-87df47b89b52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:26.502650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:26.503618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:26.504414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:26.504414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:26.504414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:26.504414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:26.504414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:26.504414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:26.504414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:26.504414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:26.504414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:26.504414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:26.504414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:37:26.504414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:26.504414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 186/359] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:37:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:26.505131 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cf6e6-cefc-414a-94a7-87df47b89b52 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:26.512429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 174/360] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:26.514132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2acbd1-d79c-4362-866e-93274002ccfa None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:26.628547 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:26.633251 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2acbd1-d79c-4362-866e-93274002ccfa None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:26.633535 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cf6e6-cefc-414a-94a7-87df47b89b52 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:26.673788 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253eff23-45be-45f3-a80e-a6104b33eeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:26.674560 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253eff23-45be-45f3-a80e-a6104b33eeb8 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:26.674852 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253eff23-45be-45f3-a80e-a6104b33eeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:26.675130 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253eff23-45be-45f3-a80e-a6104b33eeb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:26.675647 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3230e2e-25b8-4205-92d7-29bf6f615dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:26.675969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253eff23-45be-45f3-a80e-a6104b33eeb8 None admin] RBAC: Adding query filter params (group.id=93917be20e754474af0b8ac38c49f957, role.id=4568d65f55c74c2bbc8265f34e62bbc4, scope.project.id=c4e4f97ef7884bcab434c35f9d529509) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:26.676284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253eff23-45be-45f3-a80e-a6104b33eeb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:26.676499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3230e2e-25b8-4205-92d7-29bf6f615dc5 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:26.676808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3230e2e-25b8-4205-92d7-29bf6f615dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:26.677137 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3230e2e-25b8-4205-92d7-29bf6f615dc5 None admin] PATH_INFO: `/v3/groups/93917be20e754474af0b8ac38c49f957` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:26.677768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253eff23-45be-45f3-a80e-a6104b33eeb8 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:26.678322 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3230e2e-25b8-4205-92d7-29bf6f615dc5 None admin] RBAC: Authorizing `identity:get_group(group_id=93917be20e754474af0b8ac38c49f957)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:26.679747 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3230e2e-25b8-4205-92d7-29bf6f615dc5 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:26.681822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 187/361] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Jun 27 14:37:26 2022] GET /identity/v3/groups/93917be20e754474af0b8ac38c49f957 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:26.682499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3230e2e-25b8-4205-92d7-29bf6f615dc5 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:26.689865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 175/362] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Jun 27 14:37:26 2022] GET /identity/v3/role_assignments?group.id=93917be20e754474af0b8ac38c49f957&scope.project.id=c4e4f97ef7884bcab434c35f9d529509&role.id=4568d65f55c74c2bbc8265f34e62bbc4 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:26.691133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253eff23-45be-45f3-a80e-a6104b33eeb8 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:26.708338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:26.833311 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3230e2e-25b8-4205-92d7-29bf6f615dc5 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:26.836740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253eff23-45be-45f3-a80e-a6104b33eeb8 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:26.878312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce78746-ac0a-4209-84a2-32a336ad89c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:26.879120 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce78746-ac0a-4209-84a2-32a336ad89c2 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:26.879296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce78746-ac0a-4209-84a2-32a336ad89c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:26.879515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce78746-ac0a-4209-84a2-32a336ad89c2 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:26.880271 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce78746-ac0a-4209-84a2-32a336ad89c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:26.880580 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce78746-ac0a-4209-84a2-32a336ad89c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:26.881978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce78746-ac0a-4209-84a2-32a336ad89c2 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:26.883655 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89e00b-928d-4318-94bb-dbc36a98ccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:26.885870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89e00b-928d-4318-94bb-dbc36a98ccbd None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:26.885870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89e00b-928d-4318-94bb-dbc36a98ccbd None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:26.886104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89e00b-928d-4318-94bb-dbc36a98ccbd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:26.893689 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 176/363] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:26.894631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce78746-ac0a-4209-84a2-32a336ad89c2 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:26.901174 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89e00b-928d-4318-94bb-dbc36a98ccbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-ef89e00b-928d-4318-94bb-dbc36a98ccbd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:26.910982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:26.911871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:26.912962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:26.912962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:26.912962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:26.912962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:26.912962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:26.912962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:26.912962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:26.912962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:26.912962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:26.912962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:26.912962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:26.912962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:26.912962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 188/364] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:37:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:26.913884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89e00b-928d-4318-94bb-dbc36a98ccbd None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:26.932421 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:26.997203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:27.020746 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89e00b-928d-4318-94bb-dbc36a98ccbd None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:27.021366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce78746-ac0a-4209-84a2-32a336ad89c2 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:27.054493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2588c-183e-4522-94b4-b48c04dab7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:27.055347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2588c-183e-4522-94b4-b48c04dab7cb None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:27.055635 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2588c-183e-4522-94b4-b48c04dab7cb None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:27.055908 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2588c-183e-4522-94b4-b48c04dab7cb None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:27.057116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2588c-183e-4522-94b4-b48c04dab7cb None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:27.057479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302775e-1306-425c-abd0-4d0fd628a20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:27.058148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302775e-1306-425c-abd0-4d0fd628a20e None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:27.058436 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302775e-1306-425c-abd0-4d0fd628a20e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:27.058540 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2588c-183e-4522-94b4-b48c04dab7cb None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:27.058716 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302775e-1306-425c-abd0-4d0fd628a20e None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:27.059471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302775e-1306-425c-abd0-4d0fd628a20e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:27.059781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302775e-1306-425c-abd0-4d0fd628a20e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:27.064974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 189/365] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:26 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:27.065117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302775e-1306-425c-abd0-4d0fd628a20e None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:27.065195 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2588c-183e-4522-94b4-b48c04dab7cb None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:27.072949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 177/366] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:27.073692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302775e-1306-425c-abd0-4d0fd628a20e None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:27.177560 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:27.185048 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2588c-183e-4522-94b4-b48c04dab7cb None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:27.193923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302775e-1306-425c-abd0-4d0fd628a20e None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:27.225163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4909b-4c37-402e-8878-483a7ace5fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:27.225740 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4909b-4c37-402e-8878-483a7ace5fe8 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:27.226024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4909b-4c37-402e-8878-483a7ace5fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:27.226459 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4909b-4c37-402e-8878-483a7ace5fe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:27.227135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4909b-4c37-402e-8878-483a7ace5fe8 None admin] RBAC: Adding query filter params (group.id=93917be20e754474af0b8ac38c49f957, role.id=aef73ff3b03c4ad0878a0dbb33fc285c, scope.project.id=c4e4f97ef7884bcab434c35f9d529509) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:27.227445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4909b-4c37-402e-8878-483a7ace5fe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:27.228884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4909b-4c37-402e-8878-483a7ace5fe8 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:27.231413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf751d-3464-495e-9921-23ac1690c494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:27.232424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf751d-3464-495e-9921-23ac1690c494 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:27.232976 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf751d-3464-495e-9921-23ac1690c494 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:27.233276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf751d-3464-495e-9921-23ac1690c494 None admin] PATH_INFO: `/v3/users/1f04760c1c544c47ad6464cd53cba193` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:27.234479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf751d-3464-495e-9921-23ac1690c494 None admin] RBAC: Authorizing `identity:get_user(user_id=1f04760c1c544c47ad6464cd53cba193)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:27.244864 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 190/367] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Jun 27 14:37:27 2022] GET /identity/v3/role_assignments?group.id=93917be20e754474af0b8ac38c49f957&scope.project.id=c4e4f97ef7884bcab434c35f9d529509&role.id=aef73ff3b03c4ad0878a0dbb33fc285c => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:27.244864 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4909b-4c37-402e-8878-483a7ace5fe8 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:27.245114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf751d-3464-495e-9921-23ac1690c494 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:27.245114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 178/368] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:37:27 2022] GET /identity/v3/users/1f04760c1c544c47ad6464cd53cba193 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:27.245114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf751d-3464-495e-9921-23ac1690c494 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:27.258456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:27.380567 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf751d-3464-495e-9921-23ac1690c494 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:27.381076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4909b-4c37-402e-8878-483a7ace5fe8 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:27.424681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae27c0-82b0-406d-8dcf-419a347a83a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:27.425517 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae27c0-82b0-406d-8dcf-419a347a83a3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:27.425813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae27c0-82b0-406d-8dcf-419a347a83a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:27.426096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae27c0-82b0-406d-8dcf-419a347a83a3 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:27.426710 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d43b9d-8550-4831-b71f-afd91c5dee1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:27.426897 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae27c0-82b0-406d-8dcf-419a347a83a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:27.427178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae27c0-82b0-406d-8dcf-419a347a83a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:27.428201 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d43b9d-8550-4831-b71f-afd91c5dee1f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:27.428690 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d43b9d-8550-4831-b71f-afd91c5dee1f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:27.428790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae27c0-82b0-406d-8dcf-419a347a83a3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:27.429246 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d43b9d-8550-4831-b71f-afd91c5dee1f None admin] PATH_INFO: `/v3/groups/93917be20e754474af0b8ac38c49f957` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:27.431337 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d43b9d-8550-4831-b71f-afd91c5dee1f None admin] RBAC: Authorizing `identity:get_group(group_id=93917be20e754474af0b8ac38c49f957)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:27.433049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d43b9d-8550-4831-b71f-afd91c5dee1f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:27.435768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 179/369] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Jun 27 14:37:27 2022] GET /identity/v3/groups/93917be20e754474af0b8ac38c49f957 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:27.436786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d43b9d-8550-4831-b71f-afd91c5dee1f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:27.438008 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 191/370] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:27.438714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae27c0-82b0-406d-8dcf-419a347a83a3 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:27.471318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:27.522610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:27.557274 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae27c0-82b0-406d-8dcf-419a347a83a3 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:27.582349 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d43b9d-8550-4831-b71f-afd91c5dee1f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:27.600368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c255c70-d2bb-4fa3-b5f5-a99bed069b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:27.601079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c255c70-d2bb-4fa3-b5f5-a99bed069b9c None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:27.601360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c255c70-d2bb-4fa3-b5f5-a99bed069b9c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:27.601643 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c255c70-d2bb-4fa3-b5f5-a99bed069b9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:27.602488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c255c70-d2bb-4fa3-b5f5-a99bed069b9c None admin] RBAC: Adding query filter params (role.id=0896209e464b4256b7999b25e1972696, user.id=1f04760c1c544c47ad6464cd53cba193, scope.system=all) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:27.602803 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c255c70-d2bb-4fa3-b5f5-a99bed069b9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:27.604237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c255c70-d2bb-4fa3-b5f5-a99bed069b9c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:27.617501 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 192/371] 10.222.0.44 () {56 vars in 1308 bytes} [Mon Jun 27 14:37:27 2022] GET /identity/v3/role_assignments?user.id=1f04760c1c544c47ad6464cd53cba193&scope.system=all&role.id=0896209e464b4256b7999b25e1972696 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:27.618401 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c255c70-d2bb-4fa3-b5f5-a99bed069b9c None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:27.629850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06f8e7-34b4-4d8a-9045-2d5e0fe108de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:27.631323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06f8e7-34b4-4d8a-9045-2d5e0fe108de None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:27.631875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06f8e7-34b4-4d8a-9045-2d5e0fe108de None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:27.632793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06f8e7-34b4-4d8a-9045-2d5e0fe108de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:27.774219 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06f8e7-34b4-4d8a-9045-2d5e0fe108de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:27.775613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06f8e7-34b4-4d8a-9045-2d5e0fe108de None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:27.809627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c255c70-d2bb-4fa3-b5f5-a99bed069b9c None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:27.827423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:27.852250 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:27.863923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce56dcb-ddcb-4dee-baa5-cb0f06cf12c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:27.863923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce56dcb-ddcb-4dee-baa5-cb0f06cf12c0 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:27.864225 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce56dcb-ddcb-4dee-baa5-cb0f06cf12c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:27.864548 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce56dcb-ddcb-4dee-baa5-cb0f06cf12c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:27.866541 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce56dcb-ddcb-4dee-baa5-cb0f06cf12c0 None admin] RBAC: Adding query filter params (group.id=93917be20e754474af0b8ac38c49f957, role.id=4568d65f55c74c2bbc8265f34e62bbc4, scope.project.id=292b6b0d819648b58526d1dda82420c3) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:27.867045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce56dcb-ddcb-4dee-baa5-cb0f06cf12c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:27.868288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce56dcb-ddcb-4dee-baa5-cb0f06cf12c0 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:27.875693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 193/372] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Jun 27 14:37:27 2022] GET /identity/v3/role_assignments?group.id=93917be20e754474af0b8ac38c49f957&scope.project.id=292b6b0d819648b58526d1dda82420c3&role.id=4568d65f55c74c2bbc8265f34e62bbc4 => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:27.876676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce56dcb-ddcb-4dee-baa5-cb0f06cf12c0 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:27.976244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 180/373] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:27.983730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06f8e7-34b4-4d8a-9045-2d5e0fe108de None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:28.092667 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce56dcb-ddcb-4dee-baa5-cb0f06cf12c0 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:28.146288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e18acb-9dae-4fba-9a22-d73f3d072064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:28.147319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18acb-9dae-4fba-9a22-d73f3d072064 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:28.147802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18acb-9dae-4fba-9a22-d73f3d072064 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:28.148275 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18acb-9dae-4fba-9a22-d73f3d072064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:28.158334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06f8e7-34b4-4d8a-9045-2d5e0fe108de None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:28.183889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:28.196724 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efcd2c-8823-47ed-a871-1c8a47fd7d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:28.197583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efcd2c-8823-47ed-a871-1c8a47fd7d78 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:28.198108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efcd2c-8823-47ed-a871-1c8a47fd7d78 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:28.198216 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efcd2c-8823-47ed-a871-1c8a47fd7d78 None admin] PATH_INFO: `/v3/projects/782bd5d4029d44cc9364a47cef782a05` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:28.199644 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efcd2c-8823-47ed-a871-1c8a47fd7d78 None admin] RBAC: Authorizing `identity:get_project(project_id=782bd5d4029d44cc9364a47cef782a05)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:28.201195 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efcd2c-8823-47ed-a871-1c8a47fd7d78 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:28.208668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 181/374] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:27 2022] GET /identity/v3/projects/782bd5d4029d44cc9364a47cef782a05 => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:28.217754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efcd2c-8823-47ed-a871-1c8a47fd7d78 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:28.223457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:28.234771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e18acb-9dae-4fba-9a22-d73f3d072064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:28.236122 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e18acb-9dae-4fba-9a22-d73f3d072064 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:28.371565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efcd2c-8823-47ed-a871-1c8a47fd7d78 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:28.406119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 194/375] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:28.410036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e18acb-9dae-4fba-9a22-d73f3d072064 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:28.457172 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9149f-2475-41e7-b6c5-cdbe995a859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:28.458034 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9149f-2475-41e7-b6c5-cdbe995a859f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:28.458316 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9149f-2475-41e7-b6c5-cdbe995a859f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:28.458592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9149f-2475-41e7-b6c5-cdbe995a859f None admin] PATH_INFO: `/v3/groups/4952f6fdf3084213815328069568809e` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:28.471081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9149f-2475-41e7-b6c5-cdbe995a859f None admin] RBAC: Authorizing `identity:get_group(group_id=4952f6fdf3084213815328069568809e)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:28.472564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9149f-2475-41e7-b6c5-cdbe995a859f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:28.474323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 182/376] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Jun 27 14:37:28 2022] GET /identity/v3/groups/4952f6fdf3084213815328069568809e => generated 229 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:28.480266 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9149f-2475-41e7-b6c5-cdbe995a859f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:28.596010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:28.596885 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:28.613268 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e18acb-9dae-4fba-9a22-d73f3d072064 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:28.653837 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9149f-2475-41e7-b6c5-cdbe995a859f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:28.663172 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71327da4-e7ee-4335-874f-c184112e74ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:28.664697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71327da4-e7ee-4335-874f-c184112e74ec None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:28.665142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71327da4-e7ee-4335-874f-c184112e74ec None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:28.665572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71327da4-e7ee-4335-874f-c184112e74ec None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:28.667549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71327da4-e7ee-4335-874f-c184112e74ec None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:28.669942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71327da4-e7ee-4335-874f-c184112e74ec None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:28.673635 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 195/377] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:28 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:28.677901 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71327da4-e7ee-4335-874f-c184112e74ec None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:28.711314 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8364823-fbc2-436c-8cf5-941cbc969eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:28.712605 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8364823-fbc2-436c-8cf5-941cbc969eff None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:28.713148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8364823-fbc2-436c-8cf5-941cbc969eff None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:28.713906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8364823-fbc2-436c-8cf5-941cbc969eff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:28.715654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8364823-fbc2-436c-8cf5-941cbc969eff None admin] RBAC: Adding query filter params (group.id=4952f6fdf3084213815328069568809e, role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=782bd5d4029d44cc9364a47cef782a05) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:28.716167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8364823-fbc2-436c-8cf5-941cbc969eff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:28.720044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8364823-fbc2-436c-8cf5-941cbc969eff None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:28.726502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 183/378] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Jun 27 14:37:28 2022] GET /identity/v3/role_assignments?group.id=4952f6fdf3084213815328069568809e&scope.project.id=782bd5d4029d44cc9364a47cef782a05&role.id=6036efe96c1948fb98d01c8703a0561a => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:28.823679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71327da4-e7ee-4335-874f-c184112e74ec None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:28.866506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830a90c-d962-4a65-996e-6012dc9ee038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:28.868671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830a90c-d962-4a65-996e-6012dc9ee038 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:28.869135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830a90c-d962-4a65-996e-6012dc9ee038 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:28.869564 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830a90c-d962-4a65-996e-6012dc9ee038 None admin] PATH_INFO: `/v3/groups/93917be20e754474af0b8ac38c49f957` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:28.871079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830a90c-d962-4a65-996e-6012dc9ee038 None admin] RBAC: Authorizing `identity:get_group(group_id=93917be20e754474af0b8ac38c49f957)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:28.872860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830a90c-d962-4a65-996e-6012dc9ee038 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:28.877843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 196/379] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Jun 27 14:37:28 2022] GET /identity/v3/groups/93917be20e754474af0b8ac38c49f957 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:28.881641 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8364823-fbc2-436c-8cf5-941cbc969eff None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:28.992375 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8aecd-21d9-49f2-8e3b-fa0cb9c1f2db None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:28.992988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8aecd-21d9-49f2-8e3b-fa0cb9c1f2db None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:28.993498 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8aecd-21d9-49f2-8e3b-fa0cb9c1f2db None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:28.994489 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8364823-fbc2-436c-8cf5-941cbc969eff None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:28.995598 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 197/380] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:37:29.006904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc641a-df66-4b72-8576-d6ef795525b2 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:29.007555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc641a-df66-4b72-8576-d6ef795525b2 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:29.008045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc641a-df66-4b72-8576-d6ef795525b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:29.021470 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:29.036144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92beb695-2c76-42f3-9674-e134f3897c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:29.036844 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beb695-2c76-42f3-9674-e134f3897c8a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:29.037134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beb695-2c76-42f3-9674-e134f3897c8a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:29.037419 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beb695-2c76-42f3-9674-e134f3897c8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:29.038263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92beb695-2c76-42f3-9674-e134f3897c8a None admin] RBAC: Adding query filter params (group.id=93917be20e754474af0b8ac38c49f957, role.id=aef73ff3b03c4ad0878a0dbb33fc285c, scope.project.id=292b6b0d819648b58526d1dda82420c3) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:29.038574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92beb695-2c76-42f3-9674-e134f3897c8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:29.040669 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92beb695-2c76-42f3-9674-e134f3897c8a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:29.042813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-3bbc641a-df66-4b72-8576-d6ef795525b2 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:29.044229 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-3bbc641a-df66-4b72-8576-d6ef795525b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:29.046965 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 184/381] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Jun 27 14:37:28 2022] GET /identity/v3/role_assignments?group.id=93917be20e754474af0b8ac38c49f957&scope.project.id=292b6b0d819648b58526d1dda82420c3&role.id=aef73ff3b03c4ad0878a0dbb33fc285c => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:29.075976 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:29.156361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 198/382] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:29.186546 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92beb695-2c76-42f3-9674-e134f3897c8a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:29.316341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92beb695-2c76-42f3-9674-e134f3897c8a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:29.355588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18c227-f688-4552-adfb-10b30ef3e151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:29.356396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18c227-f688-4552-adfb-10b30ef3e151 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:29.356705 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18c227-f688-4552-adfb-10b30ef3e151 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:29.357027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18c227-f688-4552-adfb-10b30ef3e151 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:29.371580 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18c227-f688-4552-adfb-10b30ef3e151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-dc18c227-f688-4552-adfb-10b30ef3e151 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:29.379515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:29.380576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:29.381442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:29.381442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:29.381442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:29.381442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:29.381442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:29.381442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:29.381442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:29.381442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:29.381442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:29.381442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:29.381442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:29.381442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:29.381442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 185/383] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:29.387483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc641a-df66-4b72-8576-d6ef795525b2 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:29.584563 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc641a-df66-4b72-8576-d6ef795525b2 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:29.634608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5084f-4ddc-402a-b8df-aecac1de79ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:29.635673 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5084f-4ddc-402a-b8df-aecac1de79ba None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:29.636167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5084f-4ddc-402a-b8df-aecac1de79ba None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:29.636677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5084f-4ddc-402a-b8df-aecac1de79ba None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:29.637649 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5084f-4ddc-402a-b8df-aecac1de79ba None admin] RBAC: Adding query filter params (name=member) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:29.638184 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5084f-4ddc-402a-b8df-aecac1de79ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:29.640403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5084f-4ddc-402a-b8df-aecac1de79ba None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:29.649524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 199/384] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:29.655194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18c227-f688-4552-adfb-10b30ef3e151 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:29.740627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:29.805607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ab8d6-4b84-4fcf-822b-9d2b812a3f42 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:29.806235 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ab8d6-4b84-4fcf-822b-9d2b812a3f42 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:29.806734 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ab8d6-4b84-4fcf-822b-9d2b812a3f42 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:29.808531 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 200/385] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:29.818413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4635fb-c4d9-4b5c-b5ba-688034f14cf7 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:29.818980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4635fb-c4d9-4b5c-b5ba-688034f14cf7 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:29.819452 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4635fb-c4d9-4b5c-b5ba-688034f14cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:29.820247 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18c227-f688-4552-adfb-10b30ef3e151 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:29.854001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-fe4635fb-c4d9-4b5c-b5ba-688034f14cf7 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:29.856177 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-fe4635fb-c4d9-4b5c-b5ba-688034f14cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:29.874934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9fbd6-1941-4b41-821e-0d11fb7f0df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:29.876111 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9fbd6-1941-4b41-821e-0d11fb7f0df1 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:29.876590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9fbd6-1941-4b41-821e-0d11fb7f0df1 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:29.877084 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9fbd6-1941-4b41-821e-0d11fb7f0df1 None admin] PATH_INFO: `/v3/groups/93917be20e754474af0b8ac38c49f957` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:29.878622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9fbd6-1941-4b41-821e-0d11fb7f0df1 None admin] RBAC: Authorizing `identity:get_group(group_id=93917be20e754474af0b8ac38c49f957)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:29.880256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9fbd6-1941-4b41-821e-0d11fb7f0df1 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:29.884680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 186/386] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Jun 27 14:37:29 2022] GET /identity/v3/groups/93917be20e754474af0b8ac38c49f957 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:29.884992 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:29.890256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9fbd6-1941-4b41-821e-0d11fb7f0df1 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:29.981579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 201/387] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:30.029150 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4635fb-c4d9-4b5c-b5ba-688034f14cf7 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:30.059178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9fbd6-1941-4b41-821e-0d11fb7f0df1 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:30.076133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:30.134967 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4132a-db06-4424-a385-44726b52039b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:30.134967 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4132a-db06-4424-a385-44726b52039b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:30.135263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4132a-db06-4424-a385-44726b52039b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:30.135481 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4132a-db06-4424-a385-44726b52039b None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:30.138047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4132a-db06-4424-a385-44726b52039b None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:30.139872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4132a-db06-4424-a385-44726b52039b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:30.142042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 187/388] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:29 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:30.149420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4132a-db06-4424-a385-44726b52039b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:30.180726 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4635fb-c4d9-4b5c-b5ba-688034f14cf7 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:30.255778 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e870b7f-d377-4b39-b4d9-b83254913ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:30.256777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e870b7f-d377-4b39-b4d9-b83254913ad5 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:30.257064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e870b7f-d377-4b39-b4d9-b83254913ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:30.257347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e870b7f-d377-4b39-b4d9-b83254913ad5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:30.285590 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e870b7f-d377-4b39-b4d9-b83254913ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-9e870b7f-d377-4b39-b4d9-b83254913ad5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:30.302052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:30.302991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:30.303823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:30.303823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:30.303823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:30.303823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:30.303823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:30.303823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:30.303823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:30.303823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:30.303823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:30.303823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:30.303823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:30.303823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:30.303823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 202/389] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:37:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:37:30.312599 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e870b7f-d377-4b39-b4d9-b83254913ad5 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:30.313289 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4132a-db06-4424-a385-44726b52039b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:30.343032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:30.352019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f37a0-d3a1-438c-a0bc-dca5c8fd916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:30.353212 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f37a0-d3a1-438c-a0bc-dca5c8fd916f None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:30.353589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f37a0-d3a1-438c-a0bc-dca5c8fd916f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:30.353985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f37a0-d3a1-438c-a0bc-dca5c8fd916f None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509/groups/93917be20e754474af0b8ac38c49f957/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:30.356407 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f37a0-d3a1-438c-a0bc-dca5c8fd916f None admin] RBAC: Authorizing `identity:create_grant(project_id=c4e4f97ef7884bcab434c35f9d529509, group_id=93917be20e754474af0b8ac38c49f957, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:30.359037 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f37a0-d3a1-438c-a0bc-dca5c8fd916f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:30.444734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 188/390] 10.222.0.44 () {58 vars in 1442 bytes} [Mon Jun 27 14:37:30 2022] PUT /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509/groups/93917be20e754474af0b8ac38c49f957/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:37:30.474808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e870b7f-d377-4b39-b4d9-b83254913ad5 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:30.530909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06721a-87bd-4aff-a8dc-0b2071e2a362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:30.531623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06721a-87bd-4aff-a8dc-0b2071e2a362 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:30.531907 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06721a-87bd-4aff-a8dc-0b2071e2a362 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:30.532186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06721a-87bd-4aff-a8dc-0b2071e2a362 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:30.533005 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06721a-87bd-4aff-a8dc-0b2071e2a362 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:30.533316 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06721a-87bd-4aff-a8dc-0b2071e2a362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:30.534715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06721a-87bd-4aff-a8dc-0b2071e2a362 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:30.547575 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 203/391] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:30.553575 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f37a0-d3a1-438c-a0bc-dca5c8fd916f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:30.565002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e95b0-7840-4269-8c73-4fe319fceb96 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:30.565330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e95b0-7840-4269-8c73-4fe319fceb96 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:30.565563 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e95b0-7840-4269-8c73-4fe319fceb96 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:30.567166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 204/392] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:30.574042 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75b77c-fb46-4b63-80eb-81084e6ed4de None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:30.574624 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75b77c-fb46-4b63-80eb-81084e6ed4de None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:30.574856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75b77c-fb46-4b63-80eb-81084e6ed4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:30.596686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-cf75b77c-fb46-4b63-80eb-81084e6ed4de None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:30.597952 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-cf75b77c-fb46-4b63-80eb-81084e6ed4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:30.669058 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:30.682704 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 205/393] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:30.707143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75b77c-fb46-4b63-80eb-81084e6ed4de None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:30.709620 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:30.727963 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f37a0-d3a1-438c-a0bc-dca5c8fd916f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:30.766148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02db974-87d1-429a-b57f-80c530a26103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:30.767106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02db974-87d1-429a-b57f-80c530a26103 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:30.767496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02db974-87d1-429a-b57f-80c530a26103 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:30.767779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02db974-87d1-429a-b57f-80c530a26103 None admin] PATH_INFO: `/v3/groups/93917be20e754474af0b8ac38c49f957` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:30.769086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02db974-87d1-429a-b57f-80c530a26103 None admin] RBAC: Authorizing `identity:get_group(group_id=93917be20e754474af0b8ac38c49f957)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:30.770799 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02db974-87d1-429a-b57f-80c530a26103 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:30.772812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 189/394] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Jun 27 14:37:30 2022] GET /identity/v3/groups/93917be20e754474af0b8ac38c49f957 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:30.777968 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02db974-87d1-429a-b57f-80c530a26103 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:30.858176 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75b77c-fb46-4b63-80eb-81084e6ed4de None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:30.896596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02db974-87d1-429a-b57f-80c530a26103 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:30.905437 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:30.935612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca164ae-6e78-4b65-b83e-81f55c7ba796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:30.936118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc8b79-5c6a-4302-8bee-fd5535361098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:30.936502 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca164ae-6e78-4b65-b83e-81f55c7ba796 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:30.936811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca164ae-6e78-4b65-b83e-81f55c7ba796 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:30.937013 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc8b79-5c6a-4302-8bee-fd5535361098 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:30.937124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca164ae-6e78-4b65-b83e-81f55c7ba796 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:30.937880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc8b79-5c6a-4302-8bee-fd5535361098 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:30.938168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc8b79-5c6a-4302-8bee-fd5535361098 None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:30.939895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc8b79-5c6a-4302-8bee-fd5535361098 None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:30.941673 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc8b79-5c6a-4302-8bee-fd5535361098 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:30.943705 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 190/395] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:30 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:30.949640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc8b79-5c6a-4302-8bee-fd5535361098 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:30.961699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca164ae-6e78-4b65-b83e-81f55c7ba796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-bca164ae-6e78-4b65-b83e-81f55c7ba796 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:30.971145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:30.972069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:30.972968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:30.972968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:30.972968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:30.972968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:30.972968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:30.972968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:30.972968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:30.972968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:30.972968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:30.972968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:30.972968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:30.972968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:30.975445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 206/396] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:37:30.985739 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca164ae-6e78-4b65-b83e-81f55c7ba796 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:31.070067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc8b79-5c6a-4302-8bee-fd5535361098 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:31.116248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391cb89-aa1f-4132-aed3-e19b6b101e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:31.117576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391cb89-aa1f-4132-aed3-e19b6b101e2e None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:31.119207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391cb89-aa1f-4132-aed3-e19b6b101e2e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:31.119688 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391cb89-aa1f-4132-aed3-e19b6b101e2e None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509/groups/93917be20e754474af0b8ac38c49f957/roles/aef73ff3b03c4ad0878a0dbb33fc285c` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:31.124218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391cb89-aa1f-4132-aed3-e19b6b101e2e None admin] RBAC: Authorizing `identity:create_grant(project_id=c4e4f97ef7884bcab434c35f9d529509, group_id=93917be20e754474af0b8ac38c49f957, role_id=aef73ff3b03c4ad0878a0dbb33fc285c)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:31.126055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:31.127365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391cb89-aa1f-4132-aed3-e19b6b101e2e None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:31.173628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca164ae-6e78-4b65-b83e-81f55c7ba796 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:31.209472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1a4b5-9b81-4a02-9076-bba0cedc5bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:31.210089 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1a4b5-9b81-4a02-9076-bba0cedc5bde None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:31.210334 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1a4b5-9b81-4a02-9076-bba0cedc5bde None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:31.210619 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1a4b5-9b81-4a02-9076-bba0cedc5bde None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:31.211375 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1a4b5-9b81-4a02-9076-bba0cedc5bde None admin] RBAC: Adding query filter params (name=member) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:31.211687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1a4b5-9b81-4a02-9076-bba0cedc5bde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:31.213115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1a4b5-9b81-4a02-9076-bba0cedc5bde None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:31.223433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 207/397] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:31.229038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1a4b5-9b81-4a02-9076-bba0cedc5bde None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:31.235562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 191/398] 10.222.0.44 () {58 vars in 1442 bytes} [Mon Jun 27 14:37:30 2022] PUT /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509/groups/93917be20e754474af0b8ac38c49f957/roles/aef73ff3b03c4ad0878a0dbb33fc285c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:37:31.356055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1a4b5-9b81-4a02-9076-bba0cedc5bde None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:31.362655 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4124af3-6f90-4cea-afa2-fc7560c953d7 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:31.363653 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4124af3-6f90-4cea-afa2-fc7560c953d7 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:31.364154 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4124af3-6f90-4cea-afa2-fc7560c953d7 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:31.366189 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 192/399] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:31.371668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e3ee-b505-45da-94aa-051897814607 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:31.371956 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e3ee-b505-45da-94aa-051897814607 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:31.372236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e3ee-b505-45da-94aa-051897814607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:31.399938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:31.407086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b4f3e3ee-b505-45da-94aa-051897814607 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:31.408336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b4f3e3ee-b505-45da-94aa-051897814607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:31.425937 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba3896-92c8-4694-a89f-e0a72d05cfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:31.426819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba3896-92c8-4694-a89f-e0a72d05cfaf None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:31.427106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba3896-92c8-4694-a89f-e0a72d05cfaf None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:31.427371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba3896-92c8-4694-a89f-e0a72d05cfaf None admin] PATH_INFO: `/v3/groups/93917be20e754474af0b8ac38c49f957` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:31.429415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba3896-92c8-4694-a89f-e0a72d05cfaf None admin] RBAC: Authorizing `identity:get_group(group_id=93917be20e754474af0b8ac38c49f957)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:31.432190 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba3896-92c8-4694-a89f-e0a72d05cfaf None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:31.434690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 208/400] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Jun 27 14:37:31 2022] GET /identity/v3/groups/93917be20e754474af0b8ac38c49f957 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:31.441065 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba3896-92c8-4694-a89f-e0a72d05cfaf None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:31.473135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:31.536765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 193/401] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:37:31.553973 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3e3ee-b505-45da-94aa-051897814607 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:31.594810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba3896-92c8-4694-a89f-e0a72d05cfaf None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:31.660840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c457-0165-4b30-a40c-2671c4837879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:31.661711 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c457-0165-4b30-a40c-2671c4837879 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:31.661988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c457-0165-4b30-a40c-2671c4837879 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:31.662257 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c457-0165-4b30-a40c-2671c4837879 None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:31.665424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92c457-0165-4b30-a40c-2671c4837879 None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:31.667080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92c457-0165-4b30-a40c-2671c4837879 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:31.669352 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 209/402] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:31 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:31.671156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43644c42-bf0c-49e3-b408-48071b960981 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:31.671650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43644c42-bf0c-49e3-b408-48071b960981 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:31.672132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43644c42-bf0c-49e3-b408-48071b960981 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:31.673911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 210/403] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:31.678893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43644c42-bf0c-49e3-b408-48071b960981 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:31.699214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3e3ee-b505-45da-94aa-051897814607 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:31.736045 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff4861-bf6c-4db1-b7a9-99a5d1f00975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:31.736804 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff4861-bf6c-4db1-b7a9-99a5d1f00975 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:31.737091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff4861-bf6c-4db1-b7a9-99a5d1f00975 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:31.737368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff4861-bf6c-4db1-b7a9-99a5d1f00975 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:31.742879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:31.752820 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff4861-bf6c-4db1-b7a9-99a5d1f00975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-86ff4861-bf6c-4db1-b7a9-99a5d1f00975 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:31.763117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:31.764601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:31.765426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:31.765426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:31.765426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:31.765426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:31.765426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:31.765426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:31.765426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:31.765426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:31.765426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:31.765426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:31.765426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:37:31.765426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:31.768531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 194/404] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:37:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:37:31.771439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5c55d-43e5-4a44-ab5f-e5320d787357 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:31.772015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5c55d-43e5-4a44-ab5f-e5320d787357 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:31.772436 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5c55d-43e5-4a44-ab5f-e5320d787357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:31.796024 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f5c5c55d-43e5-4a44-ab5f-e5320d787357 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:31.797244 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43644c42-bf0c-49e3-b408-48071b960981 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:31.797765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f5c5c55d-43e5-4a44-ab5f-e5320d787357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:31.821614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:31.845590 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cbc12-03b8-4443-83a0-c527d89fe773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:31.846556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cbc12-03b8-4443-83a0-c527d89fe773 None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:31.846998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cbc12-03b8-4443-83a0-c527d89fe773 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:31.847403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cbc12-03b8-4443-83a0-c527d89fe773 None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3/groups/93917be20e754474af0b8ac38c49f957/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:31.854095 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cbc12-03b8-4443-83a0-c527d89fe773 None admin] RBAC: Authorizing `identity:create_grant(project_id=292b6b0d819648b58526d1dda82420c3, group_id=93917be20e754474af0b8ac38c49f957, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:31.856436 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cbc12-03b8-4443-83a0-c527d89fe773 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:31.890760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 195/405] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:31.890760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5c55d-43e5-4a44-ab5f-e5320d787357 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:31.952555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 211/406] 10.222.0.44 () {58 vars in 1442 bytes} [Mon Jun 27 14:37:31 2022] PUT /identity/v3/projects/292b6b0d819648b58526d1dda82420c3/groups/93917be20e754474af0b8ac38c49f957/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:37:31.954935 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cbc12-03b8-4443-83a0-c527d89fe773 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:32.027229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5c55d-43e5-4a44-ab5f-e5320d787357 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:32.069178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cbc12-03b8-4443-83a0-c527d89fe773 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:32.078777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9a69-492e-4dd6-a628-c4d98591c60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:32.079758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9a69-492e-4dd6-a628-c4d98591c60f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:32.080618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9a69-492e-4dd6-a628-c4d98591c60f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:32.081113 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9a69-492e-4dd6-a628-c4d98591c60f None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:32.082627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e9a69-492e-4dd6-a628-c4d98591c60f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:32.083222 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e9a69-492e-4dd6-a628-c4d98591c60f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:32.085302 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e9a69-492e-4dd6-a628-c4d98591c60f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:32.093632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:32.098926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 196/407] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:32.107839 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9a69-492e-4dd6-a628-c4d98591c60f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:32.136249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:32.177473 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44f87c-5218-43fc-8b88-8c8164b34e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:32.178302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44f87c-5218-43fc-8b88-8c8164b34e0b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:32.178578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44f87c-5218-43fc-8b88-8c8164b34e0b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:32.178848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44f87c-5218-43fc-8b88-8c8164b34e0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:32.200346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44f87c-5218-43fc-8b88-8c8164b34e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-2e44f87c-5218-43fc-8b88-8c8164b34e0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:32.208355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:32.209319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:32.210552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:32.210552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:32.210552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:32.210552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:32.210552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:32.210552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:32.210552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:32.210552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:32.210552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:32.210552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:32.210552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:32.210552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:32.210552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 212/408] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:37:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:32.217710 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44f87c-5218-43fc-8b88-8c8164b34e0b None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:32.247251 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9a69-492e-4dd6-a628-c4d98591c60f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:32.288160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe808ca3-0dbc-48b0-808e-418b9e8ba617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:32.288974 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe808ca3-0dbc-48b0-808e-418b9e8ba617 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:32.289253 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe808ca3-0dbc-48b0-808e-418b9e8ba617 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:32.289530 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe808ca3-0dbc-48b0-808e-418b9e8ba617 None admin] PATH_INFO: `/v3/groups/4952f6fdf3084213815328069568809e` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:32.290819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe808ca3-0dbc-48b0-808e-418b9e8ba617 None admin] RBAC: Authorizing `identity:get_group(group_id=4952f6fdf3084213815328069568809e)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:32.292308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe808ca3-0dbc-48b0-808e-418b9e8ba617 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:32.295966 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 197/409] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Jun 27 14:37:32 2022] GET /identity/v3/groups/4952f6fdf3084213815328069568809e => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:32.301241 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe808ca3-0dbc-48b0-808e-418b9e8ba617 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:32.373266 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44f87c-5218-43fc-8b88-8c8164b34e0b None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:32.418245 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12109c1d-a6d2-4e1a-8524-4b37d6d60204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:32.418921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12109c1d-a6d2-4e1a-8524-4b37d6d60204 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:32.419208 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12109c1d-a6d2-4e1a-8524-4b37d6d60204 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:32.419535 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12109c1d-a6d2-4e1a-8524-4b37d6d60204 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:32.420578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12109c1d-a6d2-4e1a-8524-4b37d6d60204 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:32.420914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12109c1d-a6d2-4e1a-8524-4b37d6d60204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:32.422287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12109c1d-a6d2-4e1a-8524-4b37d6d60204 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:32.440396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 213/410] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:32.446112 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12109c1d-a6d2-4e1a-8524-4b37d6d60204 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:32.453496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:32.490827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe808ca3-0dbc-48b0-808e-418b9e8ba617 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:32.503867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:32.581247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12109c1d-a6d2-4e1a-8524-4b37d6d60204 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:32.583276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10197da-14e4-4bc9-b708-36b26eb1dd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:32.584147 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10197da-14e4-4bc9-b708-36b26eb1dd79 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:32.584428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10197da-14e4-4bc9-b708-36b26eb1dd79 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:32.584723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10197da-14e4-4bc9-b708-36b26eb1dd79 None admin] PATH_INFO: `/v3/projects/782bd5d4029d44cc9364a47cef782a05` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:32.585952 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10197da-14e4-4bc9-b708-36b26eb1dd79 None admin] RBAC: Authorizing `identity:get_project(project_id=782bd5d4029d44cc9364a47cef782a05)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:32.587398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10197da-14e4-4bc9-b708-36b26eb1dd79 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:32.589466 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 198/411] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:32 2022] GET /identity/v3/projects/782bd5d4029d44cc9364a47cef782a05 => generated 344 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:32.600404 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10197da-14e4-4bc9-b708-36b26eb1dd79 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:32.643370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057404d4-c7ba-49aa-a97d-2c1585f796ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:32.644663 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057404d4-c7ba-49aa-a97d-2c1585f796ac None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:32.645171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057404d4-c7ba-49aa-a97d-2c1585f796ac None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:32.645635 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057404d4-c7ba-49aa-a97d-2c1585f796ac None admin] PATH_INFO: `/v3/groups/93917be20e754474af0b8ac38c49f957` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:32.646991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057404d4-c7ba-49aa-a97d-2c1585f796ac None admin] RBAC: Authorizing `identity:get_group(group_id=93917be20e754474af0b8ac38c49f957)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:32.648753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057404d4-c7ba-49aa-a97d-2c1585f796ac None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:32.650700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 214/412] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Jun 27 14:37:32 2022] GET /identity/v3/groups/93917be20e754474af0b8ac38c49f957 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:32.674664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057404d4-c7ba-49aa-a97d-2c1585f796ac None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:32.768416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10197da-14e4-4bc9-b708-36b26eb1dd79 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:32.819528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057404d4-c7ba-49aa-a97d-2c1585f796ac None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:32.824999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d0ca6-3caa-4fc7-8390-87702f89a5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:32.826834 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d0ca6-3caa-4fc7-8390-87702f89a5c9 None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:32.827438 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d0ca6-3caa-4fc7-8390-87702f89a5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:32.827902 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d0ca6-3caa-4fc7-8390-87702f89a5c9 None admin] PATH_INFO: `/v3/projects/782bd5d4029d44cc9364a47cef782a05/groups/4952f6fdf3084213815328069568809e/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:32.833410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:32.836076 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d0ca6-3caa-4fc7-8390-87702f89a5c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=782bd5d4029d44cc9364a47cef782a05, group_id=4952f6fdf3084213815328069568809e, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:32.837821 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d0ca6-3caa-4fc7-8390-87702f89a5c9 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:32.854621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1c161-c4bc-4eb9-8042-b3fec525f574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:32.855479 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1c161-c4bc-4eb9-8042-b3fec525f574 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:32.855759 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1c161-c4bc-4eb9-8042-b3fec525f574 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:32.856035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1c161-c4bc-4eb9-8042-b3fec525f574 None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:32.857528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1c161-c4bc-4eb9-8042-b3fec525f574 None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:32.859066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1c161-c4bc-4eb9-8042-b3fec525f574 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:32.861152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 215/413] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:32 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:32.866505 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1c161-c4bc-4eb9-8042-b3fec525f574 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:32.946464 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 199/414] 10.222.0.44 () {58 vars in 1442 bytes} [Mon Jun 27 14:37:32 2022] PUT /identity/v3/projects/782bd5d4029d44cc9364a47cef782a05/groups/4952f6fdf3084213815328069568809e/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:37:32.977036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1c161-c4bc-4eb9-8042-b3fec525f574 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:33.008180 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0963-53f3-4bce-989e-bdb7f776fbf1 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:33.008499 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0963-53f3-4bce-989e-bdb7f776fbf1 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:33.008754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0963-53f3-4bce-989e-bdb7f776fbf1 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:33.010245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 200/415] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:37:33.017340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3159833-115c-49ce-8b01-d1840ff028d6 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:33.017635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3159833-115c-49ce-8b01-d1840ff028d6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:33.017914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3159833-115c-49ce-8b01-d1840ff028d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:33.033266 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73828679-f56c-423c-81ba-2d2d949a73ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:33.034644 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73828679-f56c-423c-81ba-2d2d949a73ab None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:33.035312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73828679-f56c-423c-81ba-2d2d949a73ab None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:33.035793 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73828679-f56c-423c-81ba-2d2d949a73ab None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3/groups/93917be20e754474af0b8ac38c49f957/roles/aef73ff3b03c4ad0878a0dbb33fc285c` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:33.042653 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73828679-f56c-423c-81ba-2d2d949a73ab None admin] RBAC: Authorizing `identity:create_grant(project_id=292b6b0d819648b58526d1dda82420c3, group_id=93917be20e754474af0b8ac38c49f957, role_id=aef73ff3b03c4ad0878a0dbb33fc285c)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:33.045677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73828679-f56c-423c-81ba-2d2d949a73ab None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:33.056740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b3159833-115c-49ce-8b01-d1840ff028d6 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:33.058422 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b3159833-115c-49ce-8b01-d1840ff028d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:33.067925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:33.141461 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 216/416] 10.222.0.44 () {58 vars in 1442 bytes} [Mon Jun 27 14:37:32 2022] PUT /identity/v3/projects/292b6b0d819648b58526d1dda82420c3/groups/93917be20e754474af0b8ac38c49f957/roles/aef73ff3b03c4ad0878a0dbb33fc285c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:37:33.159734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 201/417] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:33.187299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73828679-f56c-423c-81ba-2d2d949a73ab None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:33.237674 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:33.320772 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73828679-f56c-423c-81ba-2d2d949a73ab None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:33.362545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b852a-c413-45b5-9ebc-5cb4480aeb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:33.363663 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b852a-c413-45b5-9ebc-5cb4480aeb0b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:33.364141 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b852a-c413-45b5-9ebc-5cb4480aeb0b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:33.364628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b852a-c413-45b5-9ebc-5cb4480aeb0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:33.376302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b852a-c413-45b5-9ebc-5cb4480aeb0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-5d7b852a-c413-45b5-9ebc-5cb4480aeb0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:33.384428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:33.385364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:33.386192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:33.386192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:33.386192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:33.386192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:33.386192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:33.386192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:33.386192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:33.386192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:33.386192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:33.386192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:33.386192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:33.386192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:33.389288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 217/418] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:33.395179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3159833-115c-49ce-8b01-d1840ff028d6 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:33.502804 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3159833-115c-49ce-8b01-d1840ff028d6 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:33.540635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0832a1-c68f-475c-9a99-4900af3c52c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:33.541668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0832a1-c68f-475c-9a99-4900af3c52c8 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:33.542171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0832a1-c68f-475c-9a99-4900af3c52c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:33.542654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0832a1-c68f-475c-9a99-4900af3c52c8 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:33.543609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0832a1-c68f-475c-9a99-4900af3c52c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:33.544139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0832a1-c68f-475c-9a99-4900af3c52c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:33.545798 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0832a1-c68f-475c-9a99-4900af3c52c8 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:33.555081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 202/419] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:33.561903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b852a-c413-45b5-9ebc-5cb4480aeb0b None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:33.628086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6621158-55e0-459d-b3a5-dbfbc7a5f00b None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:33.628729 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6621158-55e0-459d-b3a5-dbfbc7a5f00b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:33.629221 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6621158-55e0-459d-b3a5-dbfbc7a5f00b None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:33.631114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 203/420] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:33.636458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9547a9-e036-4308-937b-81f219bdb692 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:33.636982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9547a9-e036-4308-937b-81f219bdb692 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:33.637455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9547a9-e036-4308-937b-81f219bdb692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:33.645063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:33.656989 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-3f9547a9-e036-4308-937b-81f219bdb692 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:33.658386 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-3f9547a9-e036-4308-937b-81f219bdb692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:33.730558 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 204/421] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:37:33.751874 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:33.755711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9547a9-e036-4308-937b-81f219bdb692 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:33.758045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b852a-c413-45b5-9ebc-5cb4480aeb0b None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:33.839260 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb62c59-3eff-4308-80e7-9cd2242e3162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:33.839914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb62c59-3eff-4308-80e7-9cd2242e3162 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:33.840200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb62c59-3eff-4308-80e7-9cd2242e3162 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:33.840479 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb62c59-3eff-4308-80e7-9cd2242e3162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:33.871715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9547a9-e036-4308-937b-81f219bdb692 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:33.939451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb62c59-3eff-4308-80e7-9cd2242e3162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:33.940933 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb62c59-3eff-4308-80e7-9cd2242e3162 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:33.956207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e3aa-9798-49b7-becb-6ee6bc50fddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:33.957055 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e3aa-9798-49b7-becb-6ee6bc50fddd None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:33.957335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e3aa-9798-49b7-becb-6ee6bc50fddd None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:33.957613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e3aa-9798-49b7-becb-6ee6bc50fddd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:33.962420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:33.989567 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027e3aa-9798-49b7-becb-6ee6bc50fddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-6027e3aa-9798-49b7-becb-6ee6bc50fddd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:34.009462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:34.010771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:34.011691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:34.011691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:34.011691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:34.011691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:34.011691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:34.011691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:34.011691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:34.011691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:34.011691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:34.011691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:34.011691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:34.011691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:34.011691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 205/422] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:37:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:34.021559 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e3aa-9798-49b7-becb-6ee6bc50fddd None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:34.059056 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:34.065335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 218/423] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 14:37:34.071559 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb62c59-3eff-4308-80e7-9cd2242e3162 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:34.189603 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e3aa-9798-49b7-becb-6ee6bc50fddd None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:34.227364 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8099b89-4b6b-4cba-8fc3-9b4e9e964b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:34.228147 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8099b89-4b6b-4cba-8fc3-9b4e9e964b21 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:34.228439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8099b89-4b6b-4cba-8fc3-9b4e9e964b21 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:34.228742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8099b89-4b6b-4cba-8fc3-9b4e9e964b21 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:34.229504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8099b89-4b6b-4cba-8fc3-9b4e9e964b21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:34.229814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8099b89-4b6b-4cba-8fc3-9b4e9e964b21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:34.231177 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8099b89-4b6b-4cba-8fc3-9b4e9e964b21 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:34.241361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 206/424] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:34.246890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8099b89-4b6b-4cba-8fc3-9b4e9e964b21 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:34.310870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:34.332442 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb62c59-3eff-4308-80e7-9cd2242e3162 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:34.362032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8099b89-4b6b-4cba-8fc3-9b4e9e964b21 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:34.399287 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748df64f-e741-4b8c-bda6-aff4cc49f346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:34.400058 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748df64f-e741-4b8c-bda6-aff4cc49f346 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:34.400350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748df64f-e741-4b8c-bda6-aff4cc49f346 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:34.400633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748df64f-e741-4b8c-bda6-aff4cc49f346 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:34.417367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af15ae8-0b6d-4dbe-8457-a8d9b4e467c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:34.418238 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af15ae8-0b6d-4dbe-8457-a8d9b4e467c3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:34.418528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af15ae8-0b6d-4dbe-8457-a8d9b4e467c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:34.418806 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af15ae8-0b6d-4dbe-8457-a8d9b4e467c3 None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:34.425454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af15ae8-0b6d-4dbe-8457-a8d9b4e467c3 None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:34.426913 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af15ae8-0b6d-4dbe-8457-a8d9b4e467c3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:34.429009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 219/425] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:34 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:34.441816 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af15ae8-0b6d-4dbe-8457-a8d9b4e467c3 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:34.485462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748df64f-e741-4b8c-bda6-aff4cc49f346 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:34.493067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748df64f-e741-4b8c-bda6-aff4cc49f346 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:34.539543 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:34.550520 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:34.577693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af15ae8-0b6d-4dbe-8457-a8d9b4e467c3 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:34.599884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 207/426] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:34.609728 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748df64f-e741-4b8c-bda6-aff4cc49f346 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:34.616743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a5da0-ed32-4103-bdb2-e2f0e141e8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:34.617986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a5da0-ed32-4103-bdb2-e2f0e141e8c6 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:34.618541 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a5da0-ed32-4103-bdb2-e2f0e141e8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:34.619017 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a5da0-ed32-4103-bdb2-e2f0e141e8c6 None admin] PATH_INFO: `/v3/groups/93917be20e754474af0b8ac38c49f957` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:34.626365 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a5da0-ed32-4103-bdb2-e2f0e141e8c6 None admin] RBAC: Authorizing `identity:get_group(group_id=93917be20e754474af0b8ac38c49f957)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:34.634372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a5da0-ed32-4103-bdb2-e2f0e141e8c6 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:34.636328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 220/427] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Jun 27 14:37:34 2022] GET /identity/v3/groups/93917be20e754474af0b8ac38c49f957 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:34.642203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a5da0-ed32-4103-bdb2-e2f0e141e8c6 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:34.742078 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748df64f-e741-4b8c-bda6-aff4cc49f346 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:34.785870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a5da0-ed32-4103-bdb2-e2f0e141e8c6 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:34.794691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d685322-e216-4bdd-871c-944015050b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:34.796176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d685322-e216-4bdd-871c-944015050b1d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:34.796752 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d685322-e216-4bdd-871c-944015050b1d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:34.797444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d685322-e216-4bdd-871c-944015050b1d None admin] PATH_INFO: `/v3/projects/c4e4f97ef7884bcab434c35f9d529509` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:34.799071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d685322-e216-4bdd-871c-944015050b1d None admin] RBAC: Authorizing `identity:get_project(project_id=c4e4f97ef7884bcab434c35f9d529509)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:34.801422 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d685322-e216-4bdd-871c-944015050b1d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:34.804442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 208/428] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:34 2022] GET /identity/v3/projects/c4e4f97ef7884bcab434c35f9d529509 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:34.805851 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec83a4-c669-4d05-962a-d3e9544eb767 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:34.806277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec83a4-c669-4d05-962a-d3e9544eb767 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:34.806680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec83a4-c669-4d05-962a-d3e9544eb767 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:34.809000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 209/429] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:34.810420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec83a4-c669-4d05-962a-d3e9544eb767 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:34.828501 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe07ca-29c8-4ce5-97d0-8214d59edf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:34.829323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe07ca-29c8-4ce5-97d0-8214d59edf44 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:34.829803 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe07ca-29c8-4ce5-97d0-8214d59edf44 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:34.830200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe07ca-29c8-4ce5-97d0-8214d59edf44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:34.831245 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe07ca-29c8-4ce5-97d0-8214d59edf44 None admin] RBAC: Adding query filter params (group.id=93917be20e754474af0b8ac38c49f957, role.id=4568d65f55c74c2bbc8265f34e62bbc4, scope.project.id=c4e4f97ef7884bcab434c35f9d529509) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:34.831659 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe07ca-29c8-4ce5-97d0-8214d59edf44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:34.833320 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe07ca-29c8-4ce5-97d0-8214d59edf44 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:34.835559 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:34.840472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 221/430] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Jun 27 14:37:34 2022] GET /identity/v3/role_assignments?group.id=93917be20e754474af0b8ac38c49f957&scope.project.id=c4e4f97ef7884bcab434c35f9d529509&role.id=4568d65f55c74c2bbc8265f34e62bbc4 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:34.842132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663a881-17c6-4751-8249-b455024de43a None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:34.842622 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663a881-17c6-4751-8249-b455024de43a None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:34.843002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663a881-17c6-4751-8249-b455024de43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:34.843882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:34.887469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d663a881-17c6-4751-8249-b455024de43a None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:34.889549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d663a881-17c6-4751-8249-b455024de43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:35.026511 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 222/431] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:35.027041 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec83a4-c669-4d05-962a-d3e9544eb767 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:35.053233 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663a881-17c6-4751-8249-b455024de43a None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:35.069954 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5fb6e-fdda-4663-ae05-aaa2ad5bbf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:35.070866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5fb6e-fdda-4663-ae05-aaa2ad5bbf6d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:35.071143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5fb6e-fdda-4663-ae05-aaa2ad5bbf6d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:35.071423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5fb6e-fdda-4663-ae05-aaa2ad5bbf6d None admin] PATH_INFO: `/v3/groups/93917be20e754474af0b8ac38c49f957` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:35.072627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5fb6e-fdda-4663-ae05-aaa2ad5bbf6d None admin] RBAC: Authorizing `identity:get_group(group_id=93917be20e754474af0b8ac38c49f957)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:35.074205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5fb6e-fdda-4663-ae05-aaa2ad5bbf6d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:35.076498 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 210/432] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Jun 27 14:37:34 2022] GET /identity/v3/groups/93917be20e754474af0b8ac38c49f957 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:35.082567 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5fb6e-fdda-4663-ae05-aaa2ad5bbf6d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:35.173784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663a881-17c6-4751-8249-b455024de43a None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:35.188581 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:35.200594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5fb6e-fdda-4663-ae05-aaa2ad5bbf6d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:35.205840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:35.211821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63578618-b395-4c9d-8855-f0eae4f8a327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:35.222843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63578618-b395-4c9d-8855-f0eae4f8a327 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:35.222843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63578618-b395-4c9d-8855-f0eae4f8a327 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:35.222843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63578618-b395-4c9d-8855-f0eae4f8a327 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:35.224606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63578618-b395-4c9d-8855-f0eae4f8a327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-63578618-b395-4c9d-8855-f0eae4f8a327 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:35.234926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:35.235863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:35.236696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:35.236696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:35.236696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:35.236696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:35.236696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:35.236696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:35.236696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:35.236696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:35.236696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:35.236696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:35.236696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 14:37:35.236696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:35.236696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 223/433] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:37:35.242079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63578618-b395-4c9d-8855-f0eae4f8a327 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:35.258121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceda333-f5f9-4ad1-b37f-194662321d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:35.259363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceda333-f5f9-4ad1-b37f-194662321d01 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:35.259846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceda333-f5f9-4ad1-b37f-194662321d01 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:35.260327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceda333-f5f9-4ad1-b37f-194662321d01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:35.261415 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceda333-f5f9-4ad1-b37f-194662321d01 None admin] RBAC: Adding query filter params (group.id=93917be20e754474af0b8ac38c49f957, role.id=aef73ff3b03c4ad0878a0dbb33fc285c, scope.project.id=c4e4f97ef7884bcab434c35f9d529509) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:35.261928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceda333-f5f9-4ad1-b37f-194662321d01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:35.263610 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceda333-f5f9-4ad1-b37f-194662321d01 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:35.273731 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 211/434] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Jun 27 14:37:35 2022] GET /identity/v3/role_assignments?group.id=93917be20e754474af0b8ac38c49f957&scope.project.id=c4e4f97ef7884bcab434c35f9d529509&role.id=aef73ff3b03c4ad0878a0dbb33fc285c => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:35.368708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63578618-b395-4c9d-8855-f0eae4f8a327 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:35.409778 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905be217-926e-4e8c-af14-9ad33bbe3ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:35.410890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905be217-926e-4e8c-af14-9ad33bbe3ee5 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:35.411443 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905be217-926e-4e8c-af14-9ad33bbe3ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:35.411915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905be217-926e-4e8c-af14-9ad33bbe3ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:35.412918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905be217-926e-4e8c-af14-9ad33bbe3ee5 None admin] RBAC: Adding query filter params (name=member) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:35.413427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905be217-926e-4e8c-af14-9ad33bbe3ee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:35.415015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905be217-926e-4e8c-af14-9ad33bbe3ee5 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:35.426063 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 224/435] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:37:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:35.433808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceda333-f5f9-4ad1-b37f-194662321d01 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:35.545336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceda333-f5f9-4ad1-b37f-194662321d01 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:35.585154 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e64b6-ccd2-4851-8815-c2b9eeec87d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:35.586703 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e64b6-ccd2-4851-8815-c2b9eeec87d6 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:35.587214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e64b6-ccd2-4851-8815-c2b9eeec87d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:35.587693 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e64b6-ccd2-4851-8815-c2b9eeec87d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:35.600856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334a2cd-caa3-43f3-a0c0-88d0361d978f None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:35.602920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334a2cd-caa3-43f3-a0c0-88d0361d978f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:35.603211 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334a2cd-caa3-43f3-a0c0-88d0361d978f None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:35.604617 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 225/436] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:37:35.605783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079f63-70ca-4546-b6dd-5262d58e832b None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:35.606069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079f63-70ca-4546-b6dd-5262d58e832b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:35.606349 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079f63-70ca-4546-b6dd-5262d58e832b None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:35.607981 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 226/437] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:35.610355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182a2f6-f474-4e0a-966d-ca54f26ff1ad None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:35.610640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182a2f6-f474-4e0a-966d-ca54f26ff1ad None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:35.610919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182a2f6-f474-4e0a-966d-ca54f26ff1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:35.621609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:35.634465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-0182a2f6-f474-4e0a-966d-ca54f26ff1ad None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:35.635682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-0182a2f6-f474-4e0a-966d-ca54f26ff1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:35.671777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e64b6-ccd2-4851-8815-c2b9eeec87d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:35.673274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e64b6-ccd2-4851-8815-c2b9eeec87d6 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:35.690496 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:35.715297 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 227/438] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:35.717219 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b5011-67ef-4b0e-8cbe-21eb01c8657e None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:35.717504 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b5011-67ef-4b0e-8cbe-21eb01c8657e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:35.718925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b5011-67ef-4b0e-8cbe-21eb01c8657e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:35.738582 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-088b5011-67ef-4b0e-8cbe-21eb01c8657e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:35.740255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-088b5011-67ef-4b0e-8cbe-21eb01c8657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:35.795712 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 212/439] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:35.796760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e64b6-ccd2-4851-8815-c2b9eeec87d6 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:35.832345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 228/440] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:35.833222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b5011-67ef-4b0e-8cbe-21eb01c8657e None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:35.864144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:35.906849 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e64b6-ccd2-4851-8815-c2b9eeec87d6 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:35.931926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b5011-67ef-4b0e-8cbe-21eb01c8657e None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:35.940229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567947b4-e881-4f8a-8f9b-7ee944f185c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:35.941088 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567947b4-e881-4f8a-8f9b-7ee944f185c8 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:35.941375 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567947b4-e881-4f8a-8f9b-7ee944f185c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:35.941650 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567947b4-e881-4f8a-8f9b-7ee944f185c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:35.943255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:35.952159 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567947b4-e881-4f8a-8f9b-7ee944f185c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-567947b4-e881-4f8a-8f9b-7ee944f185c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:35.959765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:35.960829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:35.961654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:35.961654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:35.961654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:35.961654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:35.961654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:35.961654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:35.961654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:35.961654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:35.961654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:35.961654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:35.961654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:37:35.961654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:35.961654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 213/441] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:37:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:35.962483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567947b4-e881-4f8a-8f9b-7ee944f185c8 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:35.973366 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b5b09-cd37-4ac1-b11c-33907b1f9eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:35.974219 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b5b09-cd37-4ac1-b11c-33907b1f9eb8 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:35.974638 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b5b09-cd37-4ac1-b11c-33907b1f9eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:35.975145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b5b09-cd37-4ac1-b11c-33907b1f9eb8 None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:35.976771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b5b09-cd37-4ac1-b11c-33907b1f9eb8 None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:35.978186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b5b09-cd37-4ac1-b11c-33907b1f9eb8 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:35.979875 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 229/442] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:35 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:35.980620 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b5b09-cd37-4ac1-b11c-33907b1f9eb8 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:36.057081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567947b4-e881-4f8a-8f9b-7ee944f185c8 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:36.074530 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:36.083084 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b5b09-cd37-4ac1-b11c-33907b1f9eb8 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:36.091749 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd3066-6e68-4249-a6e5-77c05dda5232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:36.092556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd3066-6e68-4249-a6e5-77c05dda5232 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:36.092866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd3066-6e68-4249-a6e5-77c05dda5232 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:36.093140 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd3066-6e68-4249-a6e5-77c05dda5232 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:36.104016 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd3066-6e68-4249-a6e5-77c05dda5232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-64cd3066-6e68-4249-a6e5-77c05dda5232 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:36.113308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:36.114309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:36.115198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:36.115198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:36.115198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:36.115198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:36.115198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:36.115198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:36.115198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:36.115198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:36.115198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:36.115198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:36.115198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:36.115198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:36.115198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 214/443] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:37:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:36.115861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd3066-6e68-4249-a6e5-77c05dda5232 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:36.128789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6143c-4a91-45f0-a185-16ead84088bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:36.129442 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6143c-4a91-45f0-a185-16ead84088bf None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:36.129726 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6143c-4a91-45f0-a185-16ead84088bf None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:36.130002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6143c-4a91-45f0-a185-16ead84088bf None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:36.130754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6143c-4a91-45f0-a185-16ead84088bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:36.131061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6143c-4a91-45f0-a185-16ead84088bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:36.132433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6143c-4a91-45f0-a185-16ead84088bf None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:36.141957 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 230/444] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:36.142733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6143c-4a91-45f0-a185-16ead84088bf None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:36.184859 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:36.216622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd3066-6e68-4249-a6e5-77c05dda5232 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:36.242994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6143c-4a91-45f0-a185-16ead84088bf None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:36.252452 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dda5b5-f8fc-4f49-af1b-c3752e95197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:36.253350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dda5b5-f8fc-4f49-af1b-c3752e95197a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:36.253635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dda5b5-f8fc-4f49-af1b-c3752e95197a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:36.253908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dda5b5-f8fc-4f49-af1b-c3752e95197a None admin] PATH_INFO: `/v3/groups/93917be20e754474af0b8ac38c49f957` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:36.255070 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dda5b5-f8fc-4f49-af1b-c3752e95197a None admin] RBAC: Authorizing `identity:get_group(group_id=93917be20e754474af0b8ac38c49f957)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:36.256533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dda5b5-f8fc-4f49-af1b-c3752e95197a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:36.258157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 215/445] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Jun 27 14:37:36 2022] GET /identity/v3/groups/93917be20e754474af0b8ac38c49f957 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:36.258912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dda5b5-f8fc-4f49-af1b-c3752e95197a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:36.276149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c95865-c9fe-4933-903d-9c79a5c2840a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:36.276846 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c95865-c9fe-4933-903d-9c79a5c2840a None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:36.277134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c95865-c9fe-4933-903d-9c79a5c2840a None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:36.277409 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c95865-c9fe-4933-903d-9c79a5c2840a None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:36.278147 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c95865-c9fe-4933-903d-9c79a5c2840a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:36.278452 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c95865-c9fe-4933-903d-9c79a5c2840a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:36.280451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c95865-c9fe-4933-903d-9c79a5c2840a None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:36.288328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 231/446] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:36.289089 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c95865-c9fe-4933-903d-9c79a5c2840a None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:36.313291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:36.366918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dda5b5-f8fc-4f49-af1b-c3752e95197a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:36.386972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c95865-c9fe-4933-903d-9c79a5c2840a None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:36.388615 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:36.400558 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a13d14-2401-4fb1-af12-7a7a57c05b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:36.401240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a13d14-2401-4fb1-af12-7a7a57c05b83 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:36.401543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a13d14-2401-4fb1-af12-7a7a57c05b83 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:36.403183 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a13d14-2401-4fb1-af12-7a7a57c05b83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:36.422135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf689f4-22c5-4b8b-88f2-486706378003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:36.422777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf689f4-22c5-4b8b-88f2-486706378003 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:36.423066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf689f4-22c5-4b8b-88f2-486706378003 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:36.423344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf689f4-22c5-4b8b-88f2-486706378003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:36.424176 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf689f4-22c5-4b8b-88f2-486706378003 None admin] RBAC: Adding query filter params (group.id=93917be20e754474af0b8ac38c49f957, role.id=4568d65f55c74c2bbc8265f34e62bbc4, scope.project.id=292b6b0d819648b58526d1dda82420c3) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:36.424496 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf689f4-22c5-4b8b-88f2-486706378003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:36.425947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf689f4-22c5-4b8b-88f2-486706378003 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:36.431671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 232/447] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Jun 27 14:37:36 2022] GET /identity/v3/role_assignments?group.id=93917be20e754474af0b8ac38c49f957&scope.project.id=292b6b0d819648b58526d1dda82420c3&role.id=4568d65f55c74c2bbc8265f34e62bbc4 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:36.432496 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf689f4-22c5-4b8b-88f2-486706378003 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:36.475492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a13d14-2401-4fb1-af12-7a7a57c05b83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:36.476984 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a13d14-2401-4fb1-af12-7a7a57c05b83 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:36.529990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:36.557954 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf689f4-22c5-4b8b-88f2-486706378003 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:36.594405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 216/448] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:36.595922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a13d14-2401-4fb1-af12-7a7a57c05b83 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:36.602858 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb10298-d415-4219-9694-5578d3f1b799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:36.603694 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb10298-d415-4219-9694-5578d3f1b799 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:36.604127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb10298-d415-4219-9694-5578d3f1b799 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:36.604403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb10298-d415-4219-9694-5578d3f1b799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:36.645829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:36.683485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb10298-d415-4219-9694-5578d3f1b799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:36.685807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb10298-d415-4219-9694-5578d3f1b799 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:36.715578 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a13d14-2401-4fb1-af12-7a7a57c05b83 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:36.754660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05095523-6706-478e-92ba-0404d3803fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:36.755448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05095523-6706-478e-92ba-0404d3803fa4 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:36.755724 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05095523-6706-478e-92ba-0404d3803fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:36.755996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05095523-6706-478e-92ba-0404d3803fa4 None admin] PATH_INFO: `/v3/projects/782bd5d4029d44cc9364a47cef782a05` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:36.757933 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05095523-6706-478e-92ba-0404d3803fa4 None admin] RBAC: Authorizing `identity:get_project(project_id=782bd5d4029d44cc9364a47cef782a05)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:36.759374 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05095523-6706-478e-92ba-0404d3803fa4 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:36.761314 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 217/449] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:36 2022] GET /identity/v3/projects/782bd5d4029d44cc9364a47cef782a05 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:36.767100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05095523-6706-478e-92ba-0404d3803fa4 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:36.782502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:36.800755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 233/450] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:36.804014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb10298-d415-4219-9694-5578d3f1b799 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:36.874420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:36.875705 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05095523-6706-478e-92ba-0404d3803fa4 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:36.910149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb10298-d415-4219-9694-5578d3f1b799 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:36.910460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22873f55-b41d-480d-a6c9-3d604b2cb0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:36.911306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22873f55-b41d-480d-a6c9-3d604b2cb0ac None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:36.911586 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22873f55-b41d-480d-a6c9-3d604b2cb0ac None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:36.911860 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22873f55-b41d-480d-a6c9-3d604b2cb0ac None admin] PATH_INFO: `/v3/groups/4952f6fdf3084213815328069568809e` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:36.913056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22873f55-b41d-480d-a6c9-3d604b2cb0ac None admin] RBAC: Authorizing `identity:get_group(group_id=4952f6fdf3084213815328069568809e)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:36.914505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22873f55-b41d-480d-a6c9-3d604b2cb0ac None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:36.916141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 218/451] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Jun 27 14:37:36 2022] GET /identity/v3/groups/4952f6fdf3084213815328069568809e => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:36.921908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22873f55-b41d-480d-a6c9-3d604b2cb0ac None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:36.942453 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a507f2-5297-4bf9-b402-be3c4621e5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:36.943286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a507f2-5297-4bf9-b402-be3c4621e5d8 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:36.943563 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a507f2-5297-4bf9-b402-be3c4621e5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:36.943830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a507f2-5297-4bf9-b402-be3c4621e5d8 None admin] PATH_INFO: `/v3/projects/292b6b0d819648b58526d1dda82420c3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:36.945030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a507f2-5297-4bf9-b402-be3c4621e5d8 None admin] RBAC: Authorizing `identity:get_project(project_id=292b6b0d819648b58526d1dda82420c3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:36.946456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a507f2-5297-4bf9-b402-be3c4621e5d8 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:36.948119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 234/452] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:37:36 2022] GET /identity/v3/projects/292b6b0d819648b58526d1dda82420c3 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:36.954384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a507f2-5297-4bf9-b402-be3c4621e5d8 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:37.000566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:37.019351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22873f55-b41d-480d-a6c9-3d604b2cb0ac None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:37.052428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a507f2-5297-4bf9-b402-be3c4621e5d8 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:37.052920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc694f-b112-420c-9046-9d4049955a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:37.053572 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc694f-b112-420c-9046-9d4049955a47 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:37.053884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc694f-b112-420c-9046-9d4049955a47 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:37.054157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc694f-b112-420c-9046-9d4049955a47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:37.054989 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc694f-b112-420c-9046-9d4049955a47 None admin] RBAC: Adding query filter params (group.id=4952f6fdf3084213815328069568809e, role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=782bd5d4029d44cc9364a47cef782a05) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:37.055299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc694f-b112-420c-9046-9d4049955a47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:37.056737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc694f-b112-420c-9046-9d4049955a47 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:37.063152 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 219/453] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Jun 27 14:37:36 2022] GET /identity/v3/role_assignments?group.id=4952f6fdf3084213815328069568809e&scope.project.id=782bd5d4029d44cc9364a47cef782a05&role.id=6036efe96c1948fb98d01c8703a0561a => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:37.087604 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a754a-91d7-4353-9120-fcd19fc6078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:37.088491 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a754a-91d7-4353-9120-fcd19fc6078c None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:37.088806 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a754a-91d7-4353-9120-fcd19fc6078c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:37.089084 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a754a-91d7-4353-9120-fcd19fc6078c None admin] PATH_INFO: `/v3/groups/93917be20e754474af0b8ac38c49f957` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:37.090568 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a754a-91d7-4353-9120-fcd19fc6078c None admin] RBAC: Authorizing `identity:get_group(group_id=93917be20e754474af0b8ac38c49f957)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:37.092231 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a754a-91d7-4353-9120-fcd19fc6078c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:37.093994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 235/454] 10.222.0.44 () {56 vars in 1180 bytes} [Mon Jun 27 14:37:36 2022] GET /identity/v3/groups/93917be20e754474af0b8ac38c49f957 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:37.099973 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc694f-b112-420c-9046-9d4049955a47 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:37.203549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc694f-b112-420c-9046-9d4049955a47 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:37.237931 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53873ba-b4a8-49a0-b8bd-3c26cf2b1dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:37.238582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53873ba-b4a8-49a0-b8bd-3c26cf2b1dad None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:37.238862 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53873ba-b4a8-49a0-b8bd-3c26cf2b1dad None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:37.239138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53873ba-b4a8-49a0-b8bd-3c26cf2b1dad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:37.239962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53873ba-b4a8-49a0-b8bd-3c26cf2b1dad None admin] RBAC: Adding query filter params (group.id=93917be20e754474af0b8ac38c49f957, role.id=aef73ff3b03c4ad0878a0dbb33fc285c, scope.project.id=292b6b0d819648b58526d1dda82420c3) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:37.240268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53873ba-b4a8-49a0-b8bd-3c26cf2b1dad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:37.241757 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53873ba-b4a8-49a0-b8bd-3c26cf2b1dad None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:37.248092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 220/455] 10.222.0.44 () {56 vars in 1376 bytes} [Mon Jun 27 14:37:37 2022] GET /identity/v3/role_assignments?group.id=93917be20e754474af0b8ac38c49f957&scope.project.id=292b6b0d819648b58526d1dda82420c3&role.id=aef73ff3b03c4ad0878a0dbb33fc285c => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:39.728449 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373665-58c8-4dc3-a97c-c3e79198820e None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:39.729493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373665-58c8-4dc3-a97c-c3e79198820e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:39.729978 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373665-58c8-4dc3-a97c-c3e79198820e None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:39.731574 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 236/456] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:39.737234 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe127ab-56e1-47e2-8ce4-d90004ee4bc2 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:39.737648 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe127ab-56e1-47e2-8ce4-d90004ee4bc2 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:39.737819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe127ab-56e1-47e2-8ce4-d90004ee4bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:39.758836 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-efe127ab-56e1-47e2-8ce4-d90004ee4bc2 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:39.760037 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-efe127ab-56e1-47e2-8ce4-d90004ee4bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:39.762141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:39.848431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 221/457] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:39.883628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a9c77-fb51-45b0-b3b3-617f8156e9ae None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:39.883960 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a9c77-fb51-45b0-b3b3-617f8156e9ae None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:39.884196 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a9c77-fb51-45b0-b3b3-617f8156e9ae None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:39.885871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 237/458] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:39.888529 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe127ab-56e1-47e2-8ce4-d90004ee4bc2 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:39.891701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa82e9d-c7cd-442b-ba6c-d997d87de98b None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:39.891990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa82e9d-c7cd-442b-ba6c-d997d87de98b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:39.892272 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa82e9d-c7cd-442b-ba6c-d997d87de98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:39.906765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:39.926754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1aa82e9d-c7cd-442b-ba6c-d997d87de98b None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:39.927969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1aa82e9d-c7cd-442b-ba6c-d997d87de98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:39.998726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe127ab-56e1-47e2-8ce4-d90004ee4bc2 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:40.045528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b22bea-1b64-4853-b4d8-80507d42bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:40.046331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b22bea-1b64-4853-b4d8-80507d42bf6c None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:40.046614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b22bea-1b64-4853-b4d8-80507d42bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:40.046890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b22bea-1b64-4853-b4d8-80507d42bf6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:40.057977 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b22bea-1b64-4853-b4d8-80507d42bf6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:40.059496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b22bea-1b64-4853-b4d8-80507d42bf6c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:40.066917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 238/459] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:37:40.079029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-a4b22bea-1b64-4853-b4d8-80507d42bf6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:40.079029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:40.079029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:40.079029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:40.079029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:40.079029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:40.079029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:40.079029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:40.079029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:40.079029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:40.079029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:40.079029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:40.079029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:40.079029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:40.079029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:40.079895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:40.080786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:40.080786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:40.080786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:40.080786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:40.080786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 222/460] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:40.081072 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:40.087450 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa82e9d-c7cd-442b-ba6c-d997d87de98b None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:40.098540 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b22bea-1b64-4853-b4d8-80507d42bf6c None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:40.249728 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b22bea-1b64-4853-b4d8-80507d42bf6c None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:40.292118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20948758-6cd2-47cd-916a-6e2a3a4ac8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:40.293188 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20948758-6cd2-47cd-916a-6e2a3a4ac8fd None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:40.293636 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20948758-6cd2-47cd-916a-6e2a3a4ac8fd None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:40.294117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20948758-6cd2-47cd-916a-6e2a3a4ac8fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:40.316144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa82e9d-c7cd-442b-ba6c-d997d87de98b None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:40.318333 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20948758-6cd2-47cd-916a-6e2a3a4ac8fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:40.319962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20948758-6cd2-47cd-916a-6e2a3a4ac8fd None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:40.349684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-20948758-6cd2-47cd-916a-6e2a3a4ac8fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:40.349684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:40.349684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:40.349684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:40.349684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:40.349684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:40.349684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:40.349684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:40.349684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:40.349684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:40.349684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:40.349684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:40.349684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:40.349684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:40.349684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:40.350619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:40.351458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:40.351458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:40.351458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:40.351458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:40.353386 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 223/461] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:40.361691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20948758-6cd2-47cd-916a-6e2a3a4ac8fd None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:40.376508 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:40.393940 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b5f11-17ee-4bd2-b512-76a15190e348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:40.394621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b5f11-17ee-4bd2-b512-76a15190e348 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:40.397636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b5f11-17ee-4bd2-b512-76a15190e348 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:40.397636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b5f11-17ee-4bd2-b512-76a15190e348 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:40.397636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b5f11-17ee-4bd2-b512-76a15190e348 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:40.397636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b5f11-17ee-4bd2-b512-76a15190e348 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:40.397636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b5f11-17ee-4bd2-b512-76a15190e348 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:40.417375 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:40.422904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 239/462] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:40.427870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b5f11-17ee-4bd2-b512-76a15190e348 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:40.482819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20948758-6cd2-47cd-916a-6e2a3a4ac8fd None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:40.523997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c73029-01bf-4cad-8cdb-ed3e9eb5f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:40.525018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c73029-01bf-4cad-8cdb-ed3e9eb5f5cb None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:40.525525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c73029-01bf-4cad-8cdb-ed3e9eb5f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:40.526001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c73029-01bf-4cad-8cdb-ed3e9eb5f5cb None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:40.526945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c73029-01bf-4cad-8cdb-ed3e9eb5f5cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:40.527472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c73029-01bf-4cad-8cdb-ed3e9eb5f5cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:40.530019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c73029-01bf-4cad-8cdb-ed3e9eb5f5cb None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:40.543127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 224/463] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:40.551935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c73029-01bf-4cad-8cdb-ed3e9eb5f5cb None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:40.597261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b5f11-17ee-4bd2-b512-76a15190e348 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:40.633606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dadd6-a8ec-441e-ab1f-a95c59268bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:40.634276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dadd6-a8ec-441e-ab1f-a95c59268bb4 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:40.634562 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dadd6-a8ec-441e-ab1f-a95c59268bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:40.634841 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dadd6-a8ec-441e-ab1f-a95c59268bb4 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:40.635551 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957dadd6-a8ec-441e-ab1f-a95c59268bb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:40.636996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957dadd6-a8ec-441e-ab1f-a95c59268bb4 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:40.674881 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c73029-01bf-4cad-8cdb-ed3e9eb5f5cb None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:40.680834 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:40.710431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e098b2-b16e-4943-a522-5d4187471509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:40.711100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e098b2-b16e-4943-a522-5d4187471509 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:40.711446 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e098b2-b16e-4943-a522-5d4187471509 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:40.711731 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e098b2-b16e-4943-a522-5d4187471509 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:40.712440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e098b2-b16e-4943-a522-5d4187471509 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:40.713905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e098b2-b16e-4943-a522-5d4187471509 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:40.753587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 240/464] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:37:40 2022] POST /identity/v3/users => generated 246 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:37:40.754743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dd091-5a32-482e-8fdb-103ee5e536d6 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:40.755035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dd091-5a32-482e-8fdb-103ee5e536d6 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:40.755444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dd091-5a32-482e-8fdb-103ee5e536d6 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:40.760902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 241/465] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:40.760902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2a8c7-7ec4-4ae4-bfcc-66af9c09fca6 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:40.760902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2a8c7-7ec4-4ae4-bfcc-66af9c09fca6 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:40.760902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2a8c7-7ec4-4ae4-bfcc-66af9c09fca6 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:40.764454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 242/466] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:40.765881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a424a1-4eb9-436c-8cfc-20d4ae7fec92 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:40.766196 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a424a1-4eb9-436c-8cfc-20d4ae7fec92 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:40.766464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a424a1-4eb9-436c-8cfc-20d4ae7fec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:40.785996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-33a424a1-4eb9-436c-8cfc-20d4ae7fec92 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:40.787146 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-33a424a1-4eb9-436c-8cfc-20d4ae7fec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:40.832919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 225/467] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:37:40 2022] POST /identity/v3/users => generated 248 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:37:40.835124 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd813bf-be89-4ee8-922a-7ea55eace016 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:40.837106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd813bf-be89-4ee8-922a-7ea55eace016 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:40.837106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd813bf-be89-4ee8-922a-7ea55eace016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:40.854675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:40.877255 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-2fd813bf-be89-4ee8-922a-7ea55eace016 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:40.878504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2fd813bf-be89-4ee8-922a-7ea55eace016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:40.912467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 243/468] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:40.956213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a424a1-4eb9-436c-8cfc-20d4ae7fec92 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:40.995003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 226/469] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:41.028207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd813bf-be89-4ee8-922a-7ea55eace016 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:41.090383 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a424a1-4eb9-436c-8cfc-20d4ae7fec92 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:41.129130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df656228-1490-4913-8c20-96eb3104749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:41.130325 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df656228-1490-4913-8c20-96eb3104749d None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:41.130802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df656228-1490-4913-8c20-96eb3104749d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:41.131276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df656228-1490-4913-8c20-96eb3104749d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:41.134291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:41.143811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df656228-1490-4913-8c20-96eb3104749d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:41.147018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df656228-1490-4913-8c20-96eb3104749d None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:41.147667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd813bf-be89-4ee8-922a-7ea55eace016 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:41.167154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-df656228-1490-4913-8c20-96eb3104749d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:41.167154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:41.167154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:41.167154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:41.167154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:41.167154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:41.167154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:41.167154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:41.167154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:41.167154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:41.167154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:41.167154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:41.167154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:41.167154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:41.167154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:41.168058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:41.169522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:41.169522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:41.169522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:41.169522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:41.169522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 244/470] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:37:41.174273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df656228-1490-4913-8c20-96eb3104749d None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:41.189218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325376f-8c28-4249-99d1-0cd1ae442778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:41.189973 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325376f-8c28-4249-99d1-0cd1ae442778 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:41.190255 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325376f-8c28-4249-99d1-0cd1ae442778 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:41.190532 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325376f-8c28-4249-99d1-0cd1ae442778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:41.204414 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325376f-8c28-4249-99d1-0cd1ae442778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:41.205950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325376f-8c28-4249-99d1-0cd1ae442778 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:41.215798 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:41.230910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-f325376f-8c28-4249-99d1-0cd1ae442778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:41.230910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:41.230910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:41.230910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:41.230910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:41.230910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:41.230910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:41.230910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:41.230910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:41.230910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:41.230910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:41.230910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:41.230910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:41.230910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:41.230910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:41.231950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:41.232890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:41.232890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:41.232890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:41.232890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:41.232890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 227/471] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:37:41.242933 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325376f-8c28-4249-99d1-0cd1ae442778 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:41.333802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df656228-1490-4913-8c20-96eb3104749d None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:41.380437 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325376f-8c28-4249-99d1-0cd1ae442778 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:41.382168 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a340a-deff-41b5-acfb-416a5ffaf6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:41.383781 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a340a-deff-41b5-acfb-416a5ffaf6c9 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:41.384131 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a340a-deff-41b5-acfb-416a5ffaf6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:41.384474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a340a-deff-41b5-acfb-416a5ffaf6c9 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:41.385314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a340a-deff-41b5-acfb-416a5ffaf6c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:41.385707 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a340a-deff-41b5-acfb-416a5ffaf6c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:41.387156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a340a-deff-41b5-acfb-416a5ffaf6c9 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:41.404597 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 245/472] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:41.406115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b62855-591d-466a-872d-073c186a7991 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:41.406654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b62855-591d-466a-872d-073c186a7991 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:41.406935 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b62855-591d-466a-872d-073c186a7991 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:41.412728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 246/473] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:41.414293 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b62855-591d-466a-872d-073c186a7991 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:41.423204 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717b6c2-2199-4b85-85a8-0d95c77e42ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:41.423867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717b6c2-2199-4b85-85a8-0d95c77e42ef None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:41.424149 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717b6c2-2199-4b85-85a8-0d95c77e42ef None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:41.424424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717b6c2-2199-4b85-85a8-0d95c77e42ef None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:41.425194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717b6c2-2199-4b85-85a8-0d95c77e42ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:41.425499 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717b6c2-2199-4b85-85a8-0d95c77e42ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:41.427156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717b6c2-2199-4b85-85a8-0d95c77e42ef None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:41.436947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:41.441022 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 228/474] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:41.442801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605943b6-10c5-4f2a-9153-54dc64e9ef5c None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:41.443270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605943b6-10c5-4f2a-9153-54dc64e9ef5c None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:41.443744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605943b6-10c5-4f2a-9153-54dc64e9ef5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:41.462285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-605943b6-10c5-4f2a-9153-54dc64e9ef5c None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:41.463743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-605943b6-10c5-4f2a-9153-54dc64e9ef5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:41.530028 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:41.542455 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b62855-591d-466a-872d-073c186a7991 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:41.552837 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 229/475] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:41.553930 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605943b6-10c5-4f2a-9153-54dc64e9ef5c None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:41.595922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d2bbe-29b8-4e3d-b44d-9847d16d4e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:41.596959 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d2bbe-29b8-4e3d-b44d-9847d16d4e90 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:41.597521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d2bbe-29b8-4e3d-b44d-9847d16d4e90 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:41.598033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d2bbe-29b8-4e3d-b44d-9847d16d4e90 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:41.598988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d2bbe-29b8-4e3d-b44d-9847d16d4e90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:41.600753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d2bbe-29b8-4e3d-b44d-9847d16d4e90 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:41.674993 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605943b6-10c5-4f2a-9153-54dc64e9ef5c None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:41.699006 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 247/476] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:37:41 2022] POST /identity/v3/users => generated 249 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:37:41.701521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d2bbe-29b8-4e3d-b44d-9847d16d4e90 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:41.714624 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:41.722875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7511d26-cca3-48e8-9d57-a65d1605a325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:41.723664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7511d26-cca3-48e8-9d57-a65d1605a325 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:41.723949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7511d26-cca3-48e8-9d57-a65d1605a325 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:41.724224 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7511d26-cca3-48e8-9d57-a65d1605a325 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:41.724992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7511d26-cca3-48e8-9d57-a65d1605a325 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:41.726832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7511d26-cca3-48e8-9d57-a65d1605a325 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:41.836028 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d2bbe-29b8-4e3d-b44d-9847d16d4e90 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:41.847949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 230/477] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:37:41 2022] POST /identity/v3/users => generated 248 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:37:41.878731 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe039a4e-ae8a-40f6-a749-b704317f8339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:41.879882 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe039a4e-ae8a-40f6-a749-b704317f8339 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:41.880421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe039a4e-ae8a-40f6-a749-b704317f8339 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:41.880969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe039a4e-ae8a-40f6-a749-b704317f8339 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:41.882004 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe039a4e-ae8a-40f6-a749-b704317f8339 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:41.883598 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe039a4e-ae8a-40f6-a749-b704317f8339 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:41.930494 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.sql.core [None req-fe039a4e-ae8a-40f6-a749-b704317f8339 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 27 14:37:41.930494 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 27 14:37:41.930494 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [parameters: {'id': '8aa2b4a5e6c04deb864c27f064d7c6ee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 27 14:37:41.930494 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91926) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 27 14:37:41.947077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-fe039a4e-ae8a-40f6-a749-b704317f8339 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 27 14:37:41.947077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:41.947077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 14:37:41.947077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 14:37:41.947077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 14:37:41.947077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 14:37:41.947077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 14:37:41.947077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 14:37:41.947077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 14:37:41.947077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application conn.query(q) Jun 27 14:37:41.947077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 14:37:41.947077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 14:37:41.947077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 14:37:41.947077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application result.read() Jun 27 14:37:41.947077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return ref.to_dict() Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 14:37:41.957166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application next(self.gen) Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application yield resource Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application next(self.gen) Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self.session.rollback() Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self.force_reraise() Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise self.value Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application session.commit() Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 27 14:37:41.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._prepare_impl() Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self.session.flush() Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._flush(objects) Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application compat.raise_( Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application flush_context.execute() Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rec.execute(self) Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 27 14:37:41.959156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 14:37:41.960055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application conn.query(q) Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application result.read() Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 14:37:41.960880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [parameters: {'id': '8aa2b4a5e6c04deb864c27f064d7c6ee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:41.961693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 27 14:37:41.962488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:41.968143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 248/478] 10.222.0.44 () {60 vars in 1131 bytes} [Mon Jun 27 14:37:41 2022] POST /identity/v3/roles => generated 144 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:41.968290 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7511d26-cca3-48e8-9d57-a65d1605a325 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:42.074983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7511d26-cca3-48e8-9d57-a65d1605a325 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:42.115560 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717a30f-b77d-4394-8bbd-f87c389824e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:42.116778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717a30f-b77d-4394-8bbd-f87c389824e5 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:42.117253 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717a30f-b77d-4394-8bbd-f87c389824e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:42.117713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717a30f-b77d-4394-8bbd-f87c389824e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:42.128634 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717a30f-b77d-4394-8bbd-f87c389824e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-2717a30f-b77d-4394-8bbd-f87c389824e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:42.137109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:42.138543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:42.139450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:42.139450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:42.139450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:42.139450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:42.139450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:42.139450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:42.139450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:42.139450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:42.139450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:42.139450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:42.139450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 14:37:42.139450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:42.142174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 231/479] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:37:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:42.147973 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe039a4e-ae8a-40f6-a749-b704317f8339 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:42.179525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:42.276171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe039a4e-ae8a-40f6-a749-b704317f8339 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:42.319741 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16785820-afec-44c7-afb8-5af6bc583503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:42.320424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16785820-afec-44c7-afb8-5af6bc583503 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:42.320733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16785820-afec-44c7-afb8-5af6bc583503 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:42.321014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16785820-afec-44c7-afb8-5af6bc583503 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:42.321778 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16785820-afec-44c7-afb8-5af6bc583503 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:42.322086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16785820-afec-44c7-afb8-5af6bc583503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:42.323499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16785820-afec-44c7-afb8-5af6bc583503 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:42.332945 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 249/480] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:43.244528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e6016-9230-42f2-8a64-9d5470127768 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:43.245099 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e6016-9230-42f2-8a64-9d5470127768 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:43.245099 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e6016-9230-42f2-8a64-9d5470127768 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:43.246708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 232/481] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:43.252070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038aa62-dcb1-410c-924d-8064571aca77 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:43.252894 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038aa62-dcb1-410c-924d-8064571aca77 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:43.253385 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038aa62-dcb1-410c-924d-8064571aca77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:43.265032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bf142-8471-46a7-9ed8-0c42820cecd6 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:43.265328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bf142-8471-46a7-9ed8-0c42820cecd6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:43.265584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bf142-8471-46a7-9ed8-0c42820cecd6 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:43.267338 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 233/482] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:43.279795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-8038aa62-dcb1-410c-924d-8064571aca77 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:43.280323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4ccc7-a847-4b2b-8d1c-f43a0bd4cdcf None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:43.280609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4ccc7-a847-4b2b-8d1c-f43a0bd4cdcf None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:43.280918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4ccc7-a847-4b2b-8d1c-f43a0bd4cdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:43.281926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-8038aa62-dcb1-410c-924d-8064571aca77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:43.313646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-83c4ccc7-a847-4b2b-8d1c-f43a0bd4cdcf None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:43.314828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-83c4ccc7-a847-4b2b-8d1c-f43a0bd4cdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:43.384702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 250/483] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:37:43.406367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:43.412757 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038aa62-dcb1-410c-924d-8064571aca77 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:43.429001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:43.472590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 234/484] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:37:43.515819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4ccc7-a847-4b2b-8d1c-f43a0bd4cdcf None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:43.563528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038aa62-dcb1-410c-924d-8064571aca77 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:43.608611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22d390-d024-42ca-9aa3-ceb78189acbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:43.609424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22d390-d024-42ca-9aa3-ceb78189acbc None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:43.609710 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22d390-d024-42ca-9aa3-ceb78189acbc None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:43.609984 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22d390-d024-42ca-9aa3-ceb78189acbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:43.628936 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22d390-d024-42ca-9aa3-ceb78189acbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-ae22d390-d024-42ca-9aa3-ceb78189acbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:43.636600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:43.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:43.638428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:43.638428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:43.638428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:43.638428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:43.638428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:43.638428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:43.638428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:43.638428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:43.638428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:43.638428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:43.638428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:43.638428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:43.639486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 251/485] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:37:43.651425 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22d390-d024-42ca-9aa3-ceb78189acbc None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:43.700501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4ccc7-a847-4b2b-8d1c-f43a0bd4cdcf None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:43.771429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3f681-90c6-41a4-a57c-cf149378e0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:43.772226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3f681-90c6-41a4-a57c-cf149378e0ba None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:43.772509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3f681-90c6-41a4-a57c-cf149378e0ba None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:43.772817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3f681-90c6-41a4-a57c-cf149378e0ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:43.784998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:43.803333 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3f681-90c6-41a4-a57c-cf149378e0ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-4bc3f681-90c6-41a4-a57c-cf149378e0ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:43.811627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:43.812515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:43.813343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:43.813343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:43.813343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:43.813343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:43.813343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:43.813343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:43.813343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:43.813343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:43.813343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:43.813343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:43.813343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:43.813343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:43.813343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 235/486] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:37:43.820156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3f681-90c6-41a4-a57c-cf149378e0ba None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:43.846852 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22d390-d024-42ca-9aa3-ceb78189acbc None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:43.890297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:43.922445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f146815-014e-4a81-849f-fe83851f87a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:43.923157 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f146815-014e-4a81-849f-fe83851f87a8 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:43.923524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f146815-014e-4a81-849f-fe83851f87a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:43.923801 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f146815-014e-4a81-849f-fe83851f87a8 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:43.924558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f146815-014e-4a81-849f-fe83851f87a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:43.924885 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f146815-014e-4a81-849f-fe83851f87a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:43.926241 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f146815-014e-4a81-849f-fe83851f87a8 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:43.943492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 252/487] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:37:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:43.950941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f146815-014e-4a81-849f-fe83851f87a8 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:43.990688 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3f681-90c6-41a4-a57c-cf149378e0ba None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:44.036680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dc140-d3b8-4245-9c3c-cd0670407577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:44.037348 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dc140-d3b8-4245-9c3c-cd0670407577 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:44.037628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dc140-d3b8-4245-9c3c-cd0670407577 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:44.037900 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dc140-d3b8-4245-9c3c-cd0670407577 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:44.038708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dc140-d3b8-4245-9c3c-cd0670407577 None admin] RBAC: Adding query filter params (name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:44.039014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dc140-d3b8-4245-9c3c-cd0670407577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:44.040380 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dc140-d3b8-4245-9c3c-cd0670407577 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:44.059019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 236/488] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:37:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:44.065211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dc140-d3b8-4245-9c3c-cd0670407577 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:44.164134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f146815-014e-4a81-849f-fe83851f87a8 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:44.205843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:44.233630 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:44.234859 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3efefa-fdb4-48cc-82cd-cd2a05c1657a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:44.235666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3efefa-fdb4-48cc-82cd-cd2a05c1657a None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:44.235951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3efefa-fdb4-48cc-82cd-cd2a05c1657a None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:44.236226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3efefa-fdb4-48cc-82cd-cd2a05c1657a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:44.243516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dc140-d3b8-4245-9c3c-cd0670407577 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:44.253342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3efefa-fdb4-48cc-82cd-cd2a05c1657a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:44.254798 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3efefa-fdb4-48cc-82cd-cd2a05c1657a None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:44.280869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-6b3efefa-fdb4-48cc-82cd-cd2a05c1657a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:44.280869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:44.280869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:44.280869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:44.280869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:44.280869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:44.280869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:44.280869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:44.280869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:44.280869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:44.280869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:44.280869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:44.280869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:44.280869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:44.280869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:44.281797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:44.282642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:44.282642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:44.282642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:44.282642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:44.282642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 253/489] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:44.288434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3efefa-fdb4-48cc-82cd-cd2a05c1657a None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:44.293340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfc337-2b70-4007-9fb8-e0361704b59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:44.295559 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc337-2b70-4007-9fb8-e0361704b59a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:44.296066 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc337-2b70-4007-9fb8-e0361704b59a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:44.296552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc337-2b70-4007-9fb8-e0361704b59a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:44.316357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfc337-2b70-4007-9fb8-e0361704b59a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:44.319422 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfc337-2b70-4007-9fb8-e0361704b59a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:44.350265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-eabfc337-2b70-4007-9fb8-e0361704b59a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:44.350265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:44.350265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:44.350265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:44.350265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:44.350265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:44.350265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:44.350265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:44.350265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:44.350265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:44.350265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:44.350265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:44.350265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:44.350265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:44.350265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:44.351176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:44.352040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:44.352040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:44.352040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:44.352040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:44.357886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 237/490] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:37:44.363923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfc337-2b70-4007-9fb8-e0361704b59a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:44.472840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3efefa-fdb4-48cc-82cd-cd2a05c1657a None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:44.508423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfc337-2b70-4007-9fb8-e0361704b59a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:44.510748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6fe45-d83f-4bd7-940a-52904ef355a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:44.511400 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6fe45-d83f-4bd7-940a-52904ef355a6 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:44.511690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6fe45-d83f-4bd7-940a-52904ef355a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:44.511969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6fe45-d83f-4bd7-940a-52904ef355a6 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:44.513381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6fe45-d83f-4bd7-940a-52904ef355a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:44.513696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6fe45-d83f-4bd7-940a-52904ef355a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:44.515066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6fe45-d83f-4bd7-940a-52904ef355a6 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:44.531729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 254/491] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:44.531729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a613672-d61c-46eb-8ffb-ef88712b108c None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:44.531729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a613672-d61c-46eb-8ffb-ef88712b108c None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:44.531729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a613672-d61c-46eb-8ffb-ef88712b108c None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:44.531729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 255/492] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:44.532151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1d12c-c808-448c-9a47-b0c1b33e43e2 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:44.532220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1d12c-c808-448c-9a47-b0c1b33e43e2 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:44.532728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1d12c-c808-448c-9a47-b0c1b33e43e2 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:44.534055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 256/493] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:44.534629 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1d12c-c808-448c-9a47-b0c1b33e43e2 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:44.554799 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c424516-1661-4c1f-a41a-7b535bdfb8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:44.555482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c424516-1661-4c1f-a41a-7b535bdfb8bb None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:44.555762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c424516-1661-4c1f-a41a-7b535bdfb8bb None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:44.556036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c424516-1661-4c1f-a41a-7b535bdfb8bb None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:44.556960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c424516-1661-4c1f-a41a-7b535bdfb8bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:44.557270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c424516-1661-4c1f-a41a-7b535bdfb8bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:44.558632 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c424516-1661-4c1f-a41a-7b535bdfb8bb None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:44.570982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 238/494] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:44.572197 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357a2fa-94af-47af-8095-f67b5943dd96 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:44.572486 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357a2fa-94af-47af-8095-f67b5943dd96 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:44.572795 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357a2fa-94af-47af-8095-f67b5943dd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:44.581511 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:44.591274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-7357a2fa-94af-47af-8095-f67b5943dd96 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:44.592526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7357a2fa-94af-47af-8095-f67b5943dd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:44.595696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:44.650217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1d12c-c808-448c-9a47-b0c1b33e43e2 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:44.664007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 239/495] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:44.665297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74388382-fc06-4cb8-938e-cb223b0e9e5e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:44.665588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74388382-fc06-4cb8-938e-cb223b0e9e5e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:44.665861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74388382-fc06-4cb8-938e-cb223b0e9e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:44.683421 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-74388382-fc06-4cb8-938e-cb223b0e9e5e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:44.684747 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-74388382-fc06-4cb8-938e-cb223b0e9e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:44.700435 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7059f7-d8d5-42a6-88aa-2a7c4907515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:44.701267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7059f7-d8d5-42a6-88aa-2a7c4907515c None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:44.701550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7059f7-d8d5-42a6-88aa-2a7c4907515c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:44.701827 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7059f7-d8d5-42a6-88aa-2a7c4907515c None admin] PATH_INFO: `/v3/users/glance` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:44.709010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7059f7-d8d5-42a6-88aa-2a7c4907515c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:44.710445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7059f7-d8d5-42a6-88aa-2a7c4907515c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-2c7059f7-d8d5-42a6-88aa-2a7c4907515c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:37:44.727664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:44.728571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:44.729539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:44.729539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:44.729539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:37:44.729539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:37:44.729539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:37:44.729539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:37:44.729539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:37:44.729539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:37:44.729539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 27 14:37:44.729539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:44.729539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 257/496] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:44.730104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7059f7-d8d5-42a6-88aa-2a7c4907515c None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:44.764568 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 240/497] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:44.769612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74388382-fc06-4cb8-938e-cb223b0e9e5e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:44.831886 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:44.837740 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7059f7-d8d5-42a6-88aa-2a7c4907515c None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:44.850493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:44.874785 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a538932-59bc-43e0-b5b3-c80e95bc2cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:44.875567 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a538932-59bc-43e0-b5b3-c80e95bc2cf1 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:44.875844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a538932-59bc-43e0-b5b3-c80e95bc2cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:44.876156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a538932-59bc-43e0-b5b3-c80e95bc2cf1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:44.880135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74388382-fc06-4cb8-938e-cb223b0e9e5e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:44.884364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a538932-59bc-43e0-b5b3-c80e95bc2cf1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:44.885826 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a538932-59bc-43e0-b5b3-c80e95bc2cf1 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-4a538932-59bc-43e0-b5b3-c80e95bc2cf1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:37:44.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:44.901299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:44.902186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:44.902186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:44.902186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:37:44.902186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:37:44.902186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:37:44.902186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:37:44.902186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:37:44.902186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:37:44.902186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:37:44.902186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:44.906658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 258/498] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Jun 27 14:37:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:44.907617 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a538932-59bc-43e0-b5b3-c80e95bc2cf1 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:44.919866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a412aa-6f04-4629-8b4c-621f86684d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:44.920807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a412aa-6f04-4629-8b4c-621f86684d1f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:44.921203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a412aa-6f04-4629-8b4c-621f86684d1f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:44.921443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a412aa-6f04-4629-8b4c-621f86684d1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:44.932091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a412aa-6f04-4629-8b4c-621f86684d1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-54a412aa-6f04-4629-8b4c-621f86684d1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:44.939871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:44.940962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:44.941825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:44.941825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:44.941825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:44.941825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:44.941825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:44.941825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:44.941825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:44.941825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:44.941825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:44.941825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:44.941825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:44.941825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:44.941825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 241/499] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:44.942493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a412aa-6f04-4629-8b4c-621f86684d1f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:45.015943 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a538932-59bc-43e0-b5b3-c80e95bc2cf1 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:45.049189 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a412aa-6f04-4629-8b4c-621f86684d1f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:45.049988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f6385-e688-47a0-a0dc-8f7349cd6758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:45.050656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f6385-e688-47a0-a0dc-8f7349cd6758 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:45.050943 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f6385-e688-47a0-a0dc-8f7349cd6758 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:45.051222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f6385-e688-47a0-a0dc-8f7349cd6758 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:45.052071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f6385-e688-47a0-a0dc-8f7349cd6758 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:45.052510 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f6385-e688-47a0-a0dc-8f7349cd6758 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:45.053966 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f6385-e688-47a0-a0dc-8f7349cd6758 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:45.076851 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:45.082353 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932938b-e370-411a-85b9-dcff2ba3a3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:45.083513 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932938b-e370-411a-85b9-dcff2ba3a3c9 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:45.083513 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932938b-e370-411a-85b9-dcff2ba3a3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:45.083674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932938b-e370-411a-85b9-dcff2ba3a3c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:45.093261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 259/500] 10.222.0.44 () {56 vars in 1137 bytes} [Mon Jun 27 14:37:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:45.093261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f6385-e688-47a0-a0dc-8f7349cd6758 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:45.099100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932938b-e370-411a-85b9-dcff2ba3a3c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-b932938b-e370-411a-85b9-dcff2ba3a3c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:45.106996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:45.107901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:45.108736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:45.108736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:45.108736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:45.108736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:45.108736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:45.108736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:45.108736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:45.108736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:45.108736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:45.108736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:45.108736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:45.108736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:45.108736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 242/501] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:45.109500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932938b-e370-411a-85b9-dcff2ba3a3c9 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:45.114846 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:45.201806 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f6385-e688-47a0-a0dc-8f7349cd6758 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:45.208423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932938b-e370-411a-85b9-dcff2ba3a3c9 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:45.235572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459129b-4f20-406b-9496-3d36b5db508b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:45.236234 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459129b-4f20-406b-9496-3d36b5db508b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:45.236524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459129b-4f20-406b-9496-3d36b5db508b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:45.236841 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459129b-4f20-406b-9496-3d36b5db508b None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:45.237690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459129b-4f20-406b-9496-3d36b5db508b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:45.238002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459129b-4f20-406b-9496-3d36b5db508b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:45.239432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459129b-4f20-406b-9496-3d36b5db508b None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:45.241750 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c9a11-9ba9-4735-85fb-065f44fe5f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:45.242398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c9a11-9ba9-4735-85fb-065f44fe5f23 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:45.242679 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c9a11-9ba9-4735-85fb-065f44fe5f23 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:45.242952 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c9a11-9ba9-4735-85fb-065f44fe5f23 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:45.243696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c9a11-9ba9-4735-85fb-065f44fe5f23 None admin] RBAC: Adding query filter params (name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:45.243998 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c9a11-9ba9-4735-85fb-065f44fe5f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:45.245359 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c9a11-9ba9-4735-85fb-065f44fe5f23 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:45.253647 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 243/502] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:37:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:45.254843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdb4c1-2e8e-4542-8130-f03919ff18fb None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:45.255126 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdb4c1-2e8e-4542-8130-f03919ff18fb None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:45.255404 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdb4c1-2e8e-4542-8130-f03919ff18fb None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:45.260893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 244/503] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:45.260893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdb4c1-2e8e-4542-8130-f03919ff18fb None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:45.261080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 260/504] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Jun 27 14:37:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:45.261080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459129b-4f20-406b-9496-3d36b5db508b None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:45.315398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:45.332273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:45.363343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459129b-4f20-406b-9496-3d36b5db508b None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:45.363749 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdb4c1-2e8e-4542-8130-f03919ff18fb None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:45.396349 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a956de-1ae9-4d01-8099-0e364bf58c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:45.397028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a956de-1ae9-4d01-8099-0e364bf58c58 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:45.397313 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a956de-1ae9-4d01-8099-0e364bf58c58 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:45.397591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a956de-1ae9-4d01-8099-0e364bf58c58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:45.398073 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0971fc-67ee-46a9-9445-102b584cb11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:45.398739 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0971fc-67ee-46a9-9445-102b584cb11e None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:45.399021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0971fc-67ee-46a9-9445-102b584cb11e None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:45.399297 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0971fc-67ee-46a9-9445-102b584cb11e None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:45.400048 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0971fc-67ee-46a9-9445-102b584cb11e None admin] RBAC: Adding query filter params (name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:45.400359 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0971fc-67ee-46a9-9445-102b584cb11e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:45.401788 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0971fc-67ee-46a9-9445-102b584cb11e None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:45.411004 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 261/505] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:37:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:45.411793 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0971fc-67ee-46a9-9445-102b584cb11e None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:45.465539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a956de-1ae9-4d01-8099-0e364bf58c58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:45.467958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a956de-1ae9-4d01-8099-0e364bf58c58 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:45.510982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0971fc-67ee-46a9-9445-102b584cb11e None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:45.519374 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:45.543579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b76b7-1aa9-4aab-b0f7-1f1626d51b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:45.545010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b76b7-1aa9-4aab-b0f7-1f1626d51b49 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:45.545294 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b76b7-1aa9-4aab-b0f7-1f1626d51b49 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:45.545566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b76b7-1aa9-4aab-b0f7-1f1626d51b49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:45.547454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:45.556242 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b76b7-1aa9-4aab-b0f7-1f1626d51b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:45.559285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b76b7-1aa9-4aab-b0f7-1f1626d51b49 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:45.567156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 245/506] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:45.567840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a956de-1ae9-4d01-8099-0e364bf58c58 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:45.578687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-816b76b7-1aa9-4aab-b0f7-1f1626d51b49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:45.578687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:45.578687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:45.578687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:45.578687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:45.578687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:45.578687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:45.578687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:45.578687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:45.578687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:45.578687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:45.578687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:45.578687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:45.578687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:45.578687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:45.579588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:45.580748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:45.580748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:45.580748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:45.580748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:45.580748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 262/507] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:45.581574 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8cd22-0719-4b77-80fa-7adbdc1ff7d6 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:45.582076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8cd22-0719-4b77-80fa-7adbdc1ff7d6 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:45.582355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8cd22-0719-4b77-80fa-7adbdc1ff7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:45.598950 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-e0c8cd22-0719-4b77-80fa-7adbdc1ff7d6 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:45.600078 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e0c8cd22-0719-4b77-80fa-7adbdc1ff7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:45.664225 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 263/508] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:45.665076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8cd22-0719-4b77-80fa-7adbdc1ff7d6 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:45.665599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a956de-1ae9-4d01-8099-0e364bf58c58 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:45.699302 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44211b70-4af4-4cc5-a0b5-9fb9630ee132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:45.699951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44211b70-4af4-4cc5-a0b5-9fb9630ee132 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:45.700779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44211b70-4af4-4cc5-a0b5-9fb9630ee132 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:45.701051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44211b70-4af4-4cc5-a0b5-9fb9630ee132 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:45.722305 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:45.767124 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44211b70-4af4-4cc5-a0b5-9fb9630ee132 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:45.768354 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8cd22-0719-4b77-80fa-7adbdc1ff7d6 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:45.768553 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44211b70-4af4-4cc5-a0b5-9fb9630ee132 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:45.785166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:45.801863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a47fd-f0cd-4d5f-9ddd-63676f6e6093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:45.802643 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a47fd-f0cd-4d5f-9ddd-63676f6e6093 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:45.803218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a47fd-f0cd-4d5f-9ddd-63676f6e6093 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:45.803218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a47fd-f0cd-4d5f-9ddd-63676f6e6093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:45.812965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a47fd-f0cd-4d5f-9ddd-63676f6e6093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:45.814415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a47fd-f0cd-4d5f-9ddd-63676f6e6093 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:45.832512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-e95a47fd-f0cd-4d5f-9ddd-63676f6e6093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:45.832512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:45.832512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:45.832512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:45.832512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:45.832512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:45.832512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:45.832512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:45.832512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:45.832512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:45.832512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:45.832512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:45.832512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:45.832512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:45.832512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:45.833572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:45.834831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:45.834831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:45.834831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:45.834831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:45.834831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 264/509] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:45.834831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a47fd-f0cd-4d5f-9ddd-63676f6e6093 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:45.869069 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 246/510] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:45.869905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44211b70-4af4-4cc5-a0b5-9fb9630ee132 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:45.921141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:45.935501 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a47fd-f0cd-4d5f-9ddd-63676f6e6093 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:45.967113 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44211b70-4af4-4cc5-a0b5-9fb9630ee132 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:45.970049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046a9a5-2a03-4128-9ea2-8934fb75c33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:45.970836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046a9a5-2a03-4128-9ea2-8934fb75c33f None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:45.971121 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046a9a5-2a03-4128-9ea2-8934fb75c33f None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:45.971396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046a9a5-2a03-4128-9ea2-8934fb75c33f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:45.981382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046a9a5-2a03-4128-9ea2-8934fb75c33f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:45.983092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046a9a5-2a03-4128-9ea2-8934fb75c33f None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:45.999495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e8146-8235-4c7d-a33a-8268d1cf6803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:46.000137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e8146-8235-4c7d-a33a-8268d1cf6803 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:46.000416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e8146-8235-4c7d-a33a-8268d1cf6803 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:46.000715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e8146-8235-4c7d-a33a-8268d1cf6803 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:46.001386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-c046a9a5-2a03-4128-9ea2-8934fb75c33f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:46.001386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:46.001386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:46.001386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:46.001386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:46.001386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:46.001386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:46.001386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:46.001386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:46.001386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:46.001386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:46.001386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:46.001386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:46.001386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:46.001386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:46.002370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:46.003222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:46.003222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:46.003222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:46.003222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:46.003433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e8146-8235-4c7d-a33a-8268d1cf6803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:46.003433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e8146-8235-4c7d-a33a-8268d1cf6803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:46.003551 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 265/511] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:46.003625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e8146-8235-4c7d-a33a-8268d1cf6803 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:46.003692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046a9a5-2a03-4128-9ea2-8934fb75c33f None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:46.021568 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 247/512] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:46.021568 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e8146-8235-4c7d-a33a-8268d1cf6803 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:46.025835 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:46.103719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046a9a5-2a03-4128-9ea2-8934fb75c33f None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:46.115838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e8146-8235-4c7d-a33a-8268d1cf6803 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:46.130373 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:46.136573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3babc-730d-4e8c-a359-022ff7cbefd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:46.137386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3babc-730d-4e8c-a359-022ff7cbefd9 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:46.138209 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3babc-730d-4e8c-a359-022ff7cbefd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:46.138484 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3babc-730d-4e8c-a359-022ff7cbefd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:46.148520 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3babc-730d-4e8c-a359-022ff7cbefd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:46.152090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3babc-730d-4e8c-a359-022ff7cbefd9 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:46.152191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92955b-6fde-422f-9523-67a4df347415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:46.152191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92955b-6fde-422f-9523-67a4df347415 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:46.152191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92955b-6fde-422f-9523-67a4df347415 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:46.152191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92955b-6fde-422f-9523-67a4df347415 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:46.152785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92955b-6fde-422f-9523-67a4df347415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:46.153134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92955b-6fde-422f-9523-67a4df347415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:46.154530 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92955b-6fde-422f-9523-67a4df347415 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:46.165345 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 248/513] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:46.166122 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92955b-6fde-422f-9523-67a4df347415 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:46.167372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-1ba3babc-730d-4e8c-a359-022ff7cbefd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:46.167372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:46.167372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:46.167372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:46.167372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:46.167372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:46.167372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:46.167372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:46.167372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:46.167372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:46.167372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:46.167372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:46.167372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:46.167372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:46.167372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:46.168207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:46.169579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:46.169579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:46.169579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:46.169579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:46.169579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 266/514] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:46.169579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3babc-730d-4e8c-a359-022ff7cbefd9 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:46.238304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:46.270171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3babc-730d-4e8c-a359-022ff7cbefd9 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:46.270774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92955b-6fde-422f-9523-67a4df347415 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:46.302964 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd4273-bcdb-458b-b9fe-cd2febe5e798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:46.303191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479df13c-7132-4ec3-87a8-fc349d74ef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:46.303742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd4273-bcdb-458b-b9fe-cd2febe5e798 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:46.303857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479df13c-7132-4ec3-87a8-fc349d74ef6d None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:46.304025 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd4273-bcdb-458b-b9fe-cd2febe5e798 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:46.304115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479df13c-7132-4ec3-87a8-fc349d74ef6d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:46.304299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd4273-bcdb-458b-b9fe-cd2febe5e798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:46.304385 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479df13c-7132-4ec3-87a8-fc349d74ef6d None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:46.305120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479df13c-7132-4ec3-87a8-fc349d74ef6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:46.305421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479df13c-7132-4ec3-87a8-fc349d74ef6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:46.306762 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479df13c-7132-4ec3-87a8-fc349d74ef6d None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:46.315248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd4273-bcdb-458b-b9fe-cd2febe5e798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:46.316694 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd4273-bcdb-458b-b9fe-cd2febe5e798 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:46.318712 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 267/515] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:46.319506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479df13c-7132-4ec3-87a8-fc349d74ef6d None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:46.334444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-4dbd4273-bcdb-458b-b9fe-cd2febe5e798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:46.334444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:46.334444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:46.334444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:46.334444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:46.334444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:46.334444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:46.334444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:46.334444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:46.334444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:46.334444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:46.334444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:46.334444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:46.334444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:46.334444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:46.335321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:46.336171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:46.336171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:46.336171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:46.336171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:46.336171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 249/516] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:46.336433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd4273-bcdb-458b-b9fe-cd2febe5e798 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:46.361771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:46.426896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479df13c-7132-4ec3-87a8-fc349d74ef6d None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:46.435744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd4273-bcdb-458b-b9fe-cd2febe5e798 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:46.456899 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:46.461691 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289b7b8-ec26-4c47-8bcd-900dd5f77a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:46.462475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289b7b8-ec26-4c47-8bcd-900dd5f77a04 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:46.462761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289b7b8-ec26-4c47-8bcd-900dd5f77a04 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:46.463059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289b7b8-ec26-4c47-8bcd-900dd5f77a04 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:46.470550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289b7b8-ec26-4c47-8bcd-900dd5f77a04 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:46.472051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289b7b8-ec26-4c47-8bcd-900dd5f77a04 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:46.473175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf79130-2a42-4b8a-872e-37daceada7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:46.473970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf79130-2a42-4b8a-872e-37daceada7fb None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:46.474252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf79130-2a42-4b8a-872e-37daceada7fb None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:46.474531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf79130-2a42-4b8a-872e-37daceada7fb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:46.481732 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf79130-2a42-4b8a-872e-37daceada7fb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:46.483450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf79130-2a42-4b8a-872e-37daceada7fb None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-f289b7b8-ec26-4c47-8bcd-900dd5f77a04 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:37:46.486608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:46.487640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:46.488606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:46.488606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:46.488606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:37:46.488606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:37:46.488606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:37:46.488606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:37:46.488606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:37:46.488606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:37:46.488606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 14:37:46.488606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:46.492393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 268/517] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:46.493104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289b7b8-ec26-4c47-8bcd-900dd5f77a04 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-ccf79130-2a42-4b8a-872e-37daceada7fb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:37:46.499523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:46.500555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:46.506213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:46.506213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:46.506213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:37:46.506213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:37:46.506213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:37:46.506213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:37:46.506213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:37:46.506213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:37:46.506213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 14:37:46.506213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:46.506213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 250/518] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:46.506213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf79130-2a42-4b8a-872e-37daceada7fb None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:46.590374 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:46.590634 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289b7b8-ec26-4c47-8bcd-900dd5f77a04 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:46.606204 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf79130-2a42-4b8a-872e-37daceada7fb None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:46.624662 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9ca21-1ed0-4efa-b796-e1e033a0c37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:46.625270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9ca21-1ed0-4efa-b796-e1e033a0c37f None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:46.625556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9ca21-1ed0-4efa-b796-e1e033a0c37f None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:46.625843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9ca21-1ed0-4efa-b796-e1e033a0c37f None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:46.626602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9ca21-1ed0-4efa-b796-e1e033a0c37f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:46.626912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9ca21-1ed0-4efa-b796-e1e033a0c37f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:46.628274 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9ca21-1ed0-4efa-b796-e1e033a0c37f None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:46.640122 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 269/519] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:46.640941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9ca21-1ed0-4efa-b796-e1e033a0c37f None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:46.645227 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd7063-250e-4ded-a373-ed0c4410f9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:46.646004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd7063-250e-4ded-a373-ed0c4410f9d7 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:46.646280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd7063-250e-4ded-a373-ed0c4410f9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:46.646557 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd7063-250e-4ded-a373-ed0c4410f9d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:46.653914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd7063-250e-4ded-a373-ed0c4410f9d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:46.655350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd7063-250e-4ded-a373-ed0c4410f9d7 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:46.669307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-38bd7063-250e-4ded-a373-ed0c4410f9d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:46.669307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:46.669307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:46.669307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:46.669307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:46.669307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:46.669307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:46.669307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:46.669307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:46.669307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:46.669307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:46.669307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:46.669307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:37:46.669307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:37:46.669307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:46.670162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:46.671146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:37:46.671146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:37:46.671146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:37:46.671146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:37:46.671146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:37:46.671146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:37:46.671146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:46.671146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:46.671146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 251/520] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:46.671624 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd7063-250e-4ded-a373-ed0c4410f9d7 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:46.701901 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:46.749709 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9ca21-1ed0-4efa-b796-e1e033a0c37f None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:46.769951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd7063-250e-4ded-a373-ed0c4410f9d7 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:46.783002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcbd7a-9870-4f6c-94dd-80e34d3e4ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:46.783684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcbd7a-9870-4f6c-94dd-80e34d3e4ba1 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:46.783964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcbd7a-9870-4f6c-94dd-80e34d3e4ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:46.784236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcbd7a-9870-4f6c-94dd-80e34d3e4ba1 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:46.784979 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcbd7a-9870-4f6c-94dd-80e34d3e4ba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:46.785281 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcbd7a-9870-4f6c-94dd-80e34d3e4ba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:46.786629 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcbd7a-9870-4f6c-94dd-80e34d3e4ba1 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:46.798247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 270/521] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:46.799069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcbd7a-9870-4f6c-94dd-80e34d3e4ba1 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:46.803762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dad620-e30a-446f-87dd-dedce250d3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:46.804425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dad620-e30a-446f-87dd-dedce250d3d0 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:46.804734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dad620-e30a-446f-87dd-dedce250d3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:46.805010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dad620-e30a-446f-87dd-dedce250d3d0 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:46.805842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dad620-e30a-446f-87dd-dedce250d3d0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:46.806149 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dad620-e30a-446f-87dd-dedce250d3d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:46.807568 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dad620-e30a-446f-87dd-dedce250d3d0 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:46.845263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 252/522] 10.222.0.44 () {56 vars in 1139 bytes} [Mon Jun 27 14:37:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:46.846068 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dad620-e30a-446f-87dd-dedce250d3d0 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:46.848611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:46.898609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcbd7a-9870-4f6c-94dd-80e34d3e4ba1 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:46.912025 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:46.931958 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c99d7-ae08-4aa8-8247-b5d602d6c305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:46.932614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c99d7-ae08-4aa8-8247-b5d602d6c305 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:46.932922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c99d7-ae08-4aa8-8247-b5d602d6c305 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:46.933193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c99d7-ae08-4aa8-8247-b5d602d6c305 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:46.934025 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c99d7-ae08-4aa8-8247-b5d602d6c305 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:46.934331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c99d7-ae08-4aa8-8247-b5d602d6c305 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:46.940608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c99d7-ae08-4aa8-8247-b5d602d6c305 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:46.944396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dad620-e30a-446f-87dd-dedce250d3d0 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:46.953643 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 271/523] 10.222.0.44 () {56 vars in 1137 bytes} [Mon Jun 27 14:37:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:46.954437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c99d7-ae08-4aa8-8247-b5d602d6c305 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:46.982974 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36eb190-18b9-42cd-8b96-70bcc713bd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:46.983634 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36eb190-18b9-42cd-8b96-70bcc713bd9e None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:46.983912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36eb190-18b9-42cd-8b96-70bcc713bd9e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:46.984184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36eb190-18b9-42cd-8b96-70bcc713bd9e None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:46.984916 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36eb190-18b9-42cd-8b96-70bcc713bd9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:46.986339 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36eb190-18b9-42cd-8b96-70bcc713bd9e None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:47.051661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c99d7-ae08-4aa8-8247-b5d602d6c305 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:47.072447 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 253/524] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:37:46 2022] POST /identity/v3/users => generated 247 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:37:47.073451 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36eb190-18b9-42cd-8b96-70bcc713bd9e None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:47.088437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837f820-5f35-4c9d-aae4-cd6ec8592776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:47.089592 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837f820-5f35-4c9d-aae4-cd6ec8592776 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:47.089887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837f820-5f35-4c9d-aae4-cd6ec8592776 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:47.090166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837f820-5f35-4c9d-aae4-cd6ec8592776 None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:47.091089 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837f820-5f35-4c9d-aae4-cd6ec8592776 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:47.091658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837f820-5f35-4c9d-aae4-cd6ec8592776 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:47.093281 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837f820-5f35-4c9d-aae4-cd6ec8592776 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:47.120448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 272/525] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:37:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:47.120448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837f820-5f35-4c9d-aae4-cd6ec8592776 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:47.150832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:47.167189 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:47.212890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36eb190-18b9-42cd-8b96-70bcc713bd9e None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:47.230006 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837f820-5f35-4c9d-aae4-cd6ec8592776 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:47.254508 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9eefb-0a74-491a-899c-e6e359462c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:47.255300 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9eefb-0a74-491a-899c-e6e359462c8b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:47.255586 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9eefb-0a74-491a-899c-e6e359462c8b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:47.255855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9eefb-0a74-491a-899c-e6e359462c8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:47.263914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9eefb-0a74-491a-899c-e6e359462c8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:47.265407 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9eefb-0a74-491a-899c-e6e359462c8b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:47.280859 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c19eec-d10c-4eae-b95e-ae19751cf3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:47.281522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c19eec-d10c-4eae-b95e-ae19751cf3dc None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:47.281803 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c19eec-d10c-4eae-b95e-ae19751cf3dc None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:47.281919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-1ab9eefb-0a74-491a-899c-e6e359462c8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:47.281919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:47.281919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:47.281919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:47.281919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:47.281919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:47.281919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:47.281919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:47.281919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:47.281919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:47.281919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:47.281919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:47.281919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:37:47.281919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:37:47.281919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:47.282744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:47.283602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:37:47.283602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:37:47.283602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:37:47.283602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:37:47.283602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:37:47.283602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:37:47.283602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:47.283602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:47.284019 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c19eec-d10c-4eae-b95e-ae19751cf3dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:47.284087 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 254/526] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:47.284633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9eefb-0a74-491a-899c-e6e359462c8b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:47.358584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c19eec-d10c-4eae-b95e-ae19751cf3dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:47.360035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c19eec-d10c-4eae-b95e-ae19751cf3dc None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:47.391530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:47.392822 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9eefb-0a74-491a-899c-e6e359462c8b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:47.413253 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:47.433922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881e6ea-6c42-4601-8f4b-9530a5494d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:47.435165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881e6ea-6c42-4601-8f4b-9530a5494d97 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:47.439848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881e6ea-6c42-4601-8f4b-9530a5494d97 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:47.439848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881e6ea-6c42-4601-8f4b-9530a5494d97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:47.464669 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 273/527] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:47.465528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c19eec-d10c-4eae-b95e-ae19751cf3dc None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:47.516748 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881e6ea-6c42-4601-8f4b-9530a5494d97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:47.518503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881e6ea-6c42-4601-8f4b-9530a5494d97 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:47.564686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c19eec-d10c-4eae-b95e-ae19751cf3dc None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:47.594938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:47.602194 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2aefb5-48de-4e87-aa28-21dc5e69e3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:47.603097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2aefb5-48de-4e87-aa28-21dc5e69e3af None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:47.610337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2aefb5-48de-4e87-aa28-21dc5e69e3af None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:47.610337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2aefb5-48de-4e87-aa28-21dc5e69e3af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:47.610337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2aefb5-48de-4e87-aa28-21dc5e69e3af None admin] RBAC: Adding query filter params (role.id=81973b552fbc46a4ad31c60d8f099564, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=6e93d0321eaa4936a55390155d5aab0a) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:47.610337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2aefb5-48de-4e87-aa28-21dc5e69e3af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:47.610337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2aefb5-48de-4e87-aa28-21dc5e69e3af None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:47.622405 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 274/528] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:47 2022] GET /identity/v3/role_assignments?user.id=6e93d0321eaa4936a55390155d5aab0a&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=81973b552fbc46a4ad31c60d8f099564 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:47.622405 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2aefb5-48de-4e87-aa28-21dc5e69e3af None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:47.643380 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 255/529] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:47.644388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881e6ea-6c42-4601-8f4b-9530a5494d97 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:47.673134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:47.735717 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2aefb5-48de-4e87-aa28-21dc5e69e3af None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:47.775034 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25342c-2379-4100-aad4-434bbac8f9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:47.775034 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25342c-2379-4100-aad4-434bbac8f9f4 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:47.775301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25342c-2379-4100-aad4-434bbac8f9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:47.775549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25342c-2379-4100-aad4-434bbac8f9f4 None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:47.776252 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25342c-2379-4100-aad4-434bbac8f9f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:47.776568 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25342c-2379-4100-aad4-434bbac8f9f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:47.778036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25342c-2379-4100-aad4-434bbac8f9f4 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:47.781118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881e6ea-6c42-4601-8f4b-9530a5494d97 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:47.793512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 275/530] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:37:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:47.795080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25342c-2379-4100-aad4-434bbac8f9f4 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:47.833906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f950a-2431-48a9-a72e-61a28db0c94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:47.834699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f950a-2431-48a9-a72e-61a28db0c94f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:47.834980 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f950a-2431-48a9-a72e-61a28db0c94f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:47.835256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f950a-2431-48a9-a72e-61a28db0c94f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:47.855408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f950a-2431-48a9-a72e-61a28db0c94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:47.858276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f950a-2431-48a9-a72e-61a28db0c94f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:47.866752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:47.878660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-086f950a-2431-48a9-a72e-61a28db0c94f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:47.878660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:47.878660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:47.878660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:47.878660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:47.878660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:47.878660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:47.878660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:47.878660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:47.878660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:47.878660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:47.878660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:47.878660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:47.878660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:47.878660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:47.879622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:47.880458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:47.880458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:47.880458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:47.880458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:47.884529 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 256/531] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:47.885431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f950a-2431-48a9-a72e-61a28db0c94f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:47.929277 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25342c-2379-4100-aad4-434bbac8f9f4 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:47.960747 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:47.978642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8f12c-7833-47a8-a7e4-f2163349481d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:47.979715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8f12c-7833-47a8-a7e4-f2163349481d None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:47.980143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8f12c-7833-47a8-a7e4-f2163349481d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:47.980894 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8f12c-7833-47a8-a7e4-f2163349481d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:47.994906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8f12c-7833-47a8-a7e4-f2163349481d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:47.996352 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8f12c-7833-47a8-a7e4-f2163349481d None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:48.000560 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f950a-2431-48a9-a72e-61a28db0c94f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:48.016240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-bee8f12c-7833-47a8-a7e4-f2163349481d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:48.016240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:48.016240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:48.016240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:48.016240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:48.016240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:48.016240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:48.016240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:48.016240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:48.016240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:48.016240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:48.016240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:48.016240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:48.016240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:48.016240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:48.017343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:48.018185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:48.018185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:48.018185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:48.018185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:48.021974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 276/532] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:48.022863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8f12c-7833-47a8-a7e4-f2163349481d None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:48.045630 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02126fd-0b1a-4112-a226-e1b13080fb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:48.046606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02126fd-0b1a-4112-a226-e1b13080fb9b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:48.047111 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02126fd-0b1a-4112-a226-e1b13080fb9b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:48.048091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02126fd-0b1a-4112-a226-e1b13080fb9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:48.049452 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02126fd-0b1a-4112-a226-e1b13080fb9b None admin] RBAC: Adding query filter params (role.id=81973b552fbc46a4ad31c60d8f099564, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=08529776af224c36ab560c13f5941e0a) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:48.049988 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02126fd-0b1a-4112-a226-e1b13080fb9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:48.052466 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02126fd-0b1a-4112-a226-e1b13080fb9b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:48.060762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 257/533] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:47 2022] GET /identity/v3/role_assignments?user.id=08529776af224c36ab560c13f5941e0a&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=81973b552fbc46a4ad31c60d8f099564 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:48.062108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02126fd-0b1a-4112-a226-e1b13080fb9b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:48.156206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8f12c-7833-47a8-a7e4-f2163349481d None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:48.165647 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:48.201951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3e2b7-72f9-472c-b243-2beed6560731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:48.202985 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3e2b7-72f9-472c-b243-2beed6560731 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:48.203465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3e2b7-72f9-472c-b243-2beed6560731 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:48.203932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3e2b7-72f9-472c-b243-2beed6560731 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:48.204885 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3e2b7-72f9-472c-b243-2beed6560731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:48.205402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3e2b7-72f9-472c-b243-2beed6560731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:48.206976 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3e2b7-72f9-472c-b243-2beed6560731 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:48.223058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 277/534] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:48.230633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3e2b7-72f9-472c-b243-2beed6560731 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:48.260323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02126fd-0b1a-4112-a226-e1b13080fb9b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:48.321404 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f115035-cc70-4897-ad26-5806c64cb55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:48.322150 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f115035-cc70-4897-ad26-5806c64cb55d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:48.322436 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f115035-cc70-4897-ad26-5806c64cb55d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:48.322717 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f115035-cc70-4897-ad26-5806c64cb55d None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:48.323493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f115035-cc70-4897-ad26-5806c64cb55d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:48.323800 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f115035-cc70-4897-ad26-5806c64cb55d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:48.326362 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f115035-cc70-4897-ad26-5806c64cb55d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:48.328007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:48.353374 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 258/535] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:48.354309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f115035-cc70-4897-ad26-5806c64cb55d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:48.389489 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3e2b7-72f9-472c-b243-2beed6560731 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:48.426830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ce310-60ec-457f-a6e8-d7469c119459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:48.427627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ce310-60ec-457f-a6e8-d7469c119459 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:48.427909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ce310-60ec-457f-a6e8-d7469c119459 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:48.428179 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ce310-60ec-457f-a6e8-d7469c119459 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:48.446092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ce310-60ec-457f-a6e8-d7469c119459 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:48.447525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ce310-60ec-457f-a6e8-d7469c119459 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:48.474403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-3e1ce310-60ec-457f-a6e8-d7469c119459 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:48.474403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:48.474403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:48.474403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:48.474403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:48.474403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:48.474403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:48.474403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:48.474403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:48.474403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:48.474403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:48.474403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:48.474403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:37:48.474403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:37:48.474403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:48.475284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:48.476218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:37:48.476218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:37:48.476218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:37:48.476218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:37:48.476218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:37:48.476218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:37:48.476218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:48.476218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:48.477107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 278/536] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:48.482617 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ce310-60ec-457f-a6e8-d7469c119459 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:48.533646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f115035-cc70-4897-ad26-5806c64cb55d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:48.534973 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:48.582478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cdc6e-41b2-45f3-809c-8b5610b4fe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:48.583285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cdc6e-41b2-45f3-809c-8b5610b4fe3f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:48.583565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cdc6e-41b2-45f3-809c-8b5610b4fe3f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:48.583834 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cdc6e-41b2-45f3-809c-8b5610b4fe3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:48.595928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983cdc6e-41b2-45f3-809c-8b5610b4fe3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:48.605481 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983cdc6e-41b2-45f3-809c-8b5610b4fe3f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:48.620191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-983cdc6e-41b2-45f3-809c-8b5610b4fe3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:48.620191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:48.620191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:48.620191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:48.620191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:48.620191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:48.620191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:48.620191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:48.620191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:48.620191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:48.620191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:48.620191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:48.620191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:37:48.620191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:37:48.620191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:48.621118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:48.622583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:37:48.622583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:37:48.622583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:37:48.622583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:37:48.622583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:37:48.622583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:37:48.622583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:48.622583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:48.622583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 259/537] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:48.627066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ce310-60ec-457f-a6e8-d7469c119459 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:48.627780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cdc6e-41b2-45f3-809c-8b5610b4fe3f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:48.663621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d29ebd-8511-4340-88a6-5ed4b7c420d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:48.664286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d29ebd-8511-4340-88a6-5ed4b7c420d0 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:48.664563 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d29ebd-8511-4340-88a6-5ed4b7c420d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:48.664976 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d29ebd-8511-4340-88a6-5ed4b7c420d0 None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:48.665651 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d29ebd-8511-4340-88a6-5ed4b7c420d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:48.665958 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d29ebd-8511-4340-88a6-5ed4b7c420d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:48.667438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d29ebd-8511-4340-88a6-5ed4b7c420d0 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:48.680095 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 279/538] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:37:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:48.689700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d29ebd-8511-4340-88a6-5ed4b7c420d0 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:48.734422 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:48.785398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:48.805770 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cdc6e-41b2-45f3-809c-8b5610b4fe3f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:48.812430 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d29ebd-8511-4340-88a6-5ed4b7c420d0 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:48.850810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f212f-b782-42ed-9cb6-0aeaa4bbbc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:48.851471 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f212f-b782-42ed-9cb6-0aeaa4bbbc46 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:48.851754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f212f-b782-42ed-9cb6-0aeaa4bbbc46 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:48.852028 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f212f-b782-42ed-9cb6-0aeaa4bbbc46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:48.852881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f212f-b782-42ed-9cb6-0aeaa4bbbc46 None admin] RBAC: Adding query filter params (role.id=81973b552fbc46a4ad31c60d8f099564, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=bdf31d7d8c164809bde0e12b71ecfca0) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:48.853192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f212f-b782-42ed-9cb6-0aeaa4bbbc46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:48.854941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f212f-b782-42ed-9cb6-0aeaa4bbbc46 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:48.861730 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 280/539] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:48 2022] GET /identity/v3/role_assignments?user.id=bdf31d7d8c164809bde0e12b71ecfca0&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=81973b552fbc46a4ad31c60d8f099564 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:48.874086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d216034-1793-4761-8bee-76790fa03344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:48.875327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d216034-1793-4761-8bee-76790fa03344 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:48.875327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d216034-1793-4761-8bee-76790fa03344 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:48.875327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d216034-1793-4761-8bee-76790fa03344 None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:48.876093 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d216034-1793-4761-8bee-76790fa03344 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:48.876392 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d216034-1793-4761-8bee-76790fa03344 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:48.877870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d216034-1793-4761-8bee-76790fa03344 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:48.906346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 260/540] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:37:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:48.912234 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f212f-b782-42ed-9cb6-0aeaa4bbbc46 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:49.050467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f212f-b782-42ed-9cb6-0aeaa4bbbc46 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:49.092361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d0362-2e6c-463b-8d8d-a9936f856388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:49.093300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d0362-2e6c-463b-8d8d-a9936f856388 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:49.093722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d0362-2e6c-463b-8d8d-a9936f856388 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:49.094134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d0362-2e6c-463b-8d8d-a9936f856388 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:49.095103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d0362-2e6c-463b-8d8d-a9936f856388 None admin] RBAC: Adding query filter params (role.id=81973b552fbc46a4ad31c60d8f099564, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=015326e75ae14b778e4478627d07c17f) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:49.095553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d0362-2e6c-463b-8d8d-a9936f856388 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:49.097234 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d0362-2e6c-463b-8d8d-a9936f856388 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:49.109439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 281/541] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:48 2022] GET /identity/v3/role_assignments?user.id=015326e75ae14b778e4478627d07c17f&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=81973b552fbc46a4ad31c60d8f099564 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:49.281875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9ed4b-7e49-464e-a919-30c3a9abe498 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:49.282164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9ed4b-7e49-464e-a919-30c3a9abe498 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:49.282443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9ed4b-7e49-464e-a919-30c3a9abe498 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:49.284069 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 261/542] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:49.289700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba8ba8-5cba-436e-9f9d-b19a91a5f7cd None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:49.289989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba8ba8-5cba-436e-9f9d-b19a91a5f7cd None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:49.290270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba8ba8-5cba-436e-9f9d-b19a91a5f7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:49.317869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-49ba8ba8-5cba-436e-9f9d-b19a91a5f7cd None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:49.319013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-49ba8ba8-5cba-436e-9f9d-b19a91a5f7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:49.330817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:49.415098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 282/543] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:49.462971 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9ed4b-7e49-464e-a919-30c3a9abe498 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:49.602448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9ed4b-7e49-464e-a919-30c3a9abe498 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:49.617004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:49.646842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad29a0e-0c67-4679-a8b7-b8106215c9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:49.647643 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad29a0e-0c67-4679-a8b7-b8106215c9d0 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:49.647923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad29a0e-0c67-4679-a8b7-b8106215c9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:49.648195 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad29a0e-0c67-4679-a8b7-b8106215c9d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:49.665733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad29a0e-0c67-4679-a8b7-b8106215c9d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-2ad29a0e-0c67-4679-a8b7-b8106215c9d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:49.673492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:49.674370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:49.675209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:49.675209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:49.675209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:49.675209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:49.675209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:49.675209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:49.675209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:49.675209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:49.675209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:49.675209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:49.675209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:49.675209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:49.675209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 262/544] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:49.680599 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba8ba8-5cba-436e-9f9d-b19a91a5f7cd None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:49.841295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba8ba8-5cba-436e-9f9d-b19a91a5f7cd None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:49.892237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cf958-7d9f-4c01-b46b-36bfe0a7c66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:49.892853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cf958-7d9f-4c01-b46b-36bfe0a7c66d None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:49.893139 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cf958-7d9f-4c01-b46b-36bfe0a7c66d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:49.893417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cf958-7d9f-4c01-b46b-36bfe0a7c66d None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:49.894169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cf958-7d9f-4c01-b46b-36bfe0a7c66d None admin] RBAC: Adding query filter params (name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:49.894475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cf958-7d9f-4c01-b46b-36bfe0a7c66d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:49.895824 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cf958-7d9f-4c01-b46b-36bfe0a7c66d None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:49.908983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 283/545] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:37:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:49.910667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad29a0e-0c67-4679-a8b7-b8106215c9d0 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:50.040976 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad29a0e-0c67-4679-a8b7-b8106215c9d0 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:50.094749 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea82986-6c15-49cb-88ea-4b73e2a42c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:50.095545 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea82986-6c15-49cb-88ea-4b73e2a42c08 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:50.095825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea82986-6c15-49cb-88ea-4b73e2a42c08 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:50.096099 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea82986-6c15-49cb-88ea-4b73e2a42c08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:50.107501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea82986-6c15-49cb-88ea-4b73e2a42c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:50.109147 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea82986-6c15-49cb-88ea-4b73e2a42c08 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:50.139028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-8ea82986-6c15-49cb-88ea-4b73e2a42c08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:50.139028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:50.139028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:50.139028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:50.139028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:50.139028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:50.139028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:50.139028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:50.139028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:50.139028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:50.139028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:50.139028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:50.139028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:50.139028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:50.139028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:50.139946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:50.140842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:50.140842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:50.140842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:50.140842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:50.140842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 263/546] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:50.145949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cf958-7d9f-4c01-b46b-36bfe0a7c66d None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:50.159608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:50.313282 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cf958-7d9f-4c01-b46b-36bfe0a7c66d None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:50.358252 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b6a21-e4d4-4466-b1e3-e78f4c1ca221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:50.358924 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b6a21-e4d4-4466-b1e3-e78f4c1ca221 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:50.359208 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b6a21-e4d4-4466-b1e3-e78f4c1ca221 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:50.359482 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b6a21-e4d4-4466-b1e3-e78f4c1ca221 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:50.360207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b6a21-e4d4-4466-b1e3-e78f4c1ca221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:50.360512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b6a21-e4d4-4466-b1e3-e78f4c1ca221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:50.361899 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b6a21-e4d4-4466-b1e3-e78f4c1ca221 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:50.385699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 284/547] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:50.391132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea82986-6c15-49cb-88ea-4b73e2a42c08 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:50.422346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a24380-0850-40b5-a65a-449d8f506d5b None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:50.422830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a24380-0850-40b5-a65a-449d8f506d5b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:50.422830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a24380-0850-40b5-a65a-449d8f506d5b None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:50.424549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 285/548] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:37:50.435631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:50.440550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9a8e6-98ea-4863-919f-b269c0e33314 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:50.440865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9a8e6-98ea-4863-919f-b269c0e33314 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:50.441141 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9a8e6-98ea-4863-919f-b269c0e33314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:50.470882 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-63f9a8e6-98ea-4863-919f-b269c0e33314 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:50.472124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-63f9a8e6-98ea-4863-919f-b269c0e33314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:50.543447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:50.549415 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea82986-6c15-49cb-88ea-4b73e2a42c08 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:50.551378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 286/549] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:37:50.552870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa450a-cef4-47df-ad92-eeb4f766c90f None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:50.553213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa450a-cef4-47df-ad92-eeb4f766c90f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:50.553613 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa450a-cef4-47df-ad92-eeb4f766c90f None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:50.559076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 287/550] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:50.560983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d2ad2-ee5c-40dc-9af0-7f3e50aeb9ff None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:50.561376 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d2ad2-ee5c-40dc-9af0-7f3e50aeb9ff None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:50.561753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d2ad2-ee5c-40dc-9af0-7f3e50aeb9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:50.579914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-655d2ad2-ee5c-40dc-9af0-7f3e50aeb9ff None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:50.581295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-655d2ad2-ee5c-40dc-9af0-7f3e50aeb9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:50.597519 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535fbe2-b7b9-40a5-aa50-05a5fff22d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:50.598609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535fbe2-b7b9-40a5-aa50-05a5fff22d18 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:50.598942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535fbe2-b7b9-40a5-aa50-05a5fff22d18 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:50.599223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535fbe2-b7b9-40a5-aa50-05a5fff22d18 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:50.609656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535fbe2-b7b9-40a5-aa50-05a5fff22d18 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:50.611823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535fbe2-b7b9-40a5-aa50-05a5fff22d18 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-d535fbe2-b7b9-40a5-aa50-05a5fff22d18 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:37:50.632000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:50.633258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:50.639897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:50.639897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:50.639897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:37:50.639897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:37:50.639897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:37:50.639897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:37:50.639897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:37:50.639897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:37:50.639897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 14:37:50.639897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:50.639897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 264/551] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:37:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:50.639897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535fbe2-b7b9-40a5-aa50-05a5fff22d18 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:50.677489 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 288/552] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:37:50.679059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d2ad2-ee5c-40dc-9af0-7f3e50aeb9ff None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:50.758787 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:50.774387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535fbe2-b7b9-40a5-aa50-05a5fff22d18 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:50.793684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d2ad2-ee5c-40dc-9af0-7f3e50aeb9ff None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:50.812475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392887e-37fd-45f4-a534-e58df2b59a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:50.813365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392887e-37fd-45f4-a534-e58df2b59a82 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:50.813654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392887e-37fd-45f4-a534-e58df2b59a82 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:50.813929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392887e-37fd-45f4-a534-e58df2b59a82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:50.823758 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:50.827878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392887e-37fd-45f4-a534-e58df2b59a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:50.834062 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd6556-aacc-4133-95a4-653e4cb59f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:50.834954 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd6556-aacc-4133-95a4-653e4cb59f9a None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:50.835398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd6556-aacc-4133-95a4-653e4cb59f9a None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-d392887e-37fd-45f4-a534-e58df2b59a82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:50.835566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:50.842361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:50.843336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:50.843336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:50.843336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:50.843336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:50.843336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:50.843336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:50.843336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:50.843336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:50.843336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:50.843336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:50.843336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:50.843336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:50.843994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd6556-aacc-4133-95a4-653e4cb59f9a None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:50.843994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd6556-aacc-4133-95a4-653e4cb59f9a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:50.844127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 265/553] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:50.844195 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd6556-aacc-4133-95a4-653e4cb59f9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:50.844271 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392887e-37fd-45f4-a534-e58df2b59a82 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:50.844340 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd6556-aacc-4133-95a4-653e4cb59f9a None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:50.864285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 289/554] 10.222.0.44 () {56 vars in 1135 bytes} [Mon Jun 27 14:37:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:50.870316 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd6556-aacc-4133-95a4-653e4cb59f9a None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:50.946051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392887e-37fd-45f4-a534-e58df2b59a82 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:50.978858 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd6556-aacc-4133-95a4-653e4cb59f9a None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:50.984451 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725f1b7-7ddb-444f-a010-623c5e0e4010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:50.985444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725f1b7-7ddb-444f-a010-623c5e0e4010 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:50.985732 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725f1b7-7ddb-444f-a010-623c5e0e4010 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:50.986008 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725f1b7-7ddb-444f-a010-623c5e0e4010 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:50.997559 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725f1b7-7ddb-444f-a010-623c5e0e4010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-0725f1b7-7ddb-444f-a010-623c5e0e4010 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:51.006064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:51.007175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:51.008298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:51.008298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:51.008298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:51.008298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:51.008298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:51.008298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:51.008298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:51.008298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:51.008298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:51.008298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:51.008298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:51.008298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:51.012094 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 266/555] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:51.013248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725f1b7-7ddb-444f-a010-623c5e0e4010 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:51.020591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b7f28-39f4-4572-b07c-89618cc418de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:51.021504 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b7f28-39f4-4572-b07c-89618cc418de None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:51.021930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b7f28-39f4-4572-b07c-89618cc418de None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:51.022402 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:51.023414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b7f28-39f4-4572-b07c-89618cc418de None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:51.024319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b7f28-39f4-4572-b07c-89618cc418de None admin] RBAC: Adding query filter params (name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:51.024876 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b7f28-39f4-4572-b07c-89618cc418de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:51.026379 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b7f28-39f4-4572-b07c-89618cc418de None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:51.035482 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 290/556] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:37:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:51.036763 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b7f28-39f4-4572-b07c-89618cc418de None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:51.092288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:51.150668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725f1b7-7ddb-444f-a010-623c5e0e4010 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:51.154890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b7f28-39f4-4572-b07c-89618cc418de None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:51.191095 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431601f-232e-4917-93f8-caa2387e8947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:51.191999 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431601f-232e-4917-93f8-caa2387e8947 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:51.192537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431601f-232e-4917-93f8-caa2387e8947 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:51.192988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431601f-232e-4917-93f8-caa2387e8947 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:51.193881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431601f-232e-4917-93f8-caa2387e8947 None admin] RBAC: Adding query filter params (name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:51.194524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431601f-232e-4917-93f8-caa2387e8947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:51.195660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebf959-a321-472f-9800-061c88368463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:51.196339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431601f-232e-4917-93f8-caa2387e8947 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:51.196456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebf959-a321-472f-9800-061c88368463 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:51.196585 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebf959-a321-472f-9800-061c88368463 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:51.196894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebf959-a321-472f-9800-061c88368463 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:51.207193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 291/557] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:37:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:51.208302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431601f-232e-4917-93f8-caa2387e8947 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:51.276381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebf959-a321-472f-9800-061c88368463 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:51.277869 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebf959-a321-472f-9800-061c88368463 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:51.285614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:51.317501 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431601f-232e-4917-93f8-caa2387e8947 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:51.328035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:51.354058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2bbcc-3645-487e-b5e7-8b396e266195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:51.354845 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2bbcc-3645-487e-b5e7-8b396e266195 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:51.355341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2bbcc-3645-487e-b5e7-8b396e266195 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:51.355494 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2bbcc-3645-487e-b5e7-8b396e266195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:51.366520 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2bbcc-3645-487e-b5e7-8b396e266195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:51.368181 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2bbcc-3645-487e-b5e7-8b396e266195 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:51.392697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 267/558] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:51.392697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebf959-a321-472f-9800-061c88368463 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:51.392941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-64b2bbcc-3645-487e-b5e7-8b396e266195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:51.392941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:51.392941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:51.392941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:51.392941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:51.392941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:51.392941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:51.392941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:51.392941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:51.392941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:51.392941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:51.392941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:51.392941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:51.392941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:51.392941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:51.393784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:51.394658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:51.394658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:51.394658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:51.394658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:51.394658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 292/559] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:51.394658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1892a-0bdf-47f8-b69d-42a4c003dff1 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:51.394658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1892a-0bdf-47f8-b69d-42a4c003dff1 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:51.394658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1892a-0bdf-47f8-b69d-42a4c003dff1 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:51.394658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 293/560] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:51.396975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cd054-7bb0-4024-a45b-83a36a119b31 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:51.397267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cd054-7bb0-4024-a45b-83a36a119b31 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:51.397548 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cd054-7bb0-4024-a45b-83a36a119b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:51.415605 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-4a5cd054-7bb0-4024-a45b-83a36a119b31 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:51.416823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4a5cd054-7bb0-4024-a45b-83a36a119b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:51.493203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 294/561] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:37:51.494051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cd054-7bb0-4024-a45b-83a36a119b31 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:51.503907 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebf959-a321-472f-9800-061c88368463 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:51.515354 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:51.545130 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad4ed7-9a52-437e-8b8f-70d91476204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:51.546321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad4ed7-9a52-437e-8b8f-70d91476204f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:51.546800 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad4ed7-9a52-437e-8b8f-70d91476204f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:51.547436 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad4ed7-9a52-437e-8b8f-70d91476204f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:51.558826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad4ed7-9a52-437e-8b8f-70d91476204f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:51.561409 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad4ed7-9a52-437e-8b8f-70d91476204f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:51.580887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-b0ad4ed7-9a52-437e-8b8f-70d91476204f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:51.580887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:51.580887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:51.580887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:51.580887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:51.580887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:51.580887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:51.580887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:51.580887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:51.580887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:51.580887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:51.580887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:51.580887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:51.580887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:51.580887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:51.581805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:51.582695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:51.582695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:51.582695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:51.582695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:51.582695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 268/562] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:51.583572 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad4ed7-9a52-437e-8b8f-70d91476204f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:51.599351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:51.610146 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cd054-7bb0-4024-a45b-83a36a119b31 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:51.648602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c661b7a-f4d6-42cd-98ef-4f64b09a531c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:51.649587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c661b7a-f4d6-42cd-98ef-4f64b09a531c None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:51.649852 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c661b7a-f4d6-42cd-98ef-4f64b09a531c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:51.650127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c661b7a-f4d6-42cd-98ef-4f64b09a531c None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:51.650851 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c661b7a-f4d6-42cd-98ef-4f64b09a531c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:51.651154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c661b7a-f4d6-42cd-98ef-4f64b09a531c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:51.652583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c661b7a-f4d6-42cd-98ef-4f64b09a531c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:51.664833 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 295/563] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:51.665618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c661b7a-f4d6-42cd-98ef-4f64b09a531c None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:51.691698 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad4ed7-9a52-437e-8b8f-70d91476204f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:51.728238 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8a66c-9d88-4eb9-916b-bcfb51d21f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:51.729077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8a66c-9d88-4eb9-916b-bcfb51d21f87 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:51.729413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8a66c-9d88-4eb9-916b-bcfb51d21f87 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:51.729631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8a66c-9d88-4eb9-916b-bcfb51d21f87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:51.739679 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8a66c-9d88-4eb9-916b-bcfb51d21f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:51.741171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8a66c-9d88-4eb9-916b-bcfb51d21f87 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:51.758917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-1cf8a66c-9d88-4eb9-916b-bcfb51d21f87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:51.758917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:51.758917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:51.758917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:51.758917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:51.758917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:51.758917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:51.758917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:51.758917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:51.758917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:51.758917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:51.758917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:51.758917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:51.758917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:51.758917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:51.760004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:51.761156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:51.761156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:51.761156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:51.761156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:51.761156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 269/564] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:51.761156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8a66c-9d88-4eb9-916b-bcfb51d21f87 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:51.771894 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c661b7a-f4d6-42cd-98ef-4f64b09a531c None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:51.773381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:51.805284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c586bf2-9913-4aa9-abf1-9e107236a622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:51.806076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c586bf2-9913-4aa9-abf1-9e107236a622 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:51.806361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c586bf2-9913-4aa9-abf1-9e107236a622 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:51.806631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c586bf2-9913-4aa9-abf1-9e107236a622 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:51.816535 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c586bf2-9913-4aa9-abf1-9e107236a622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-9c586bf2-9913-4aa9-abf1-9e107236a622 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:51.824448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:51.826130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:51.826989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:51.826989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:51.826989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:51.826989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:51.826989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:51.826989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:51.826989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:51.826989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:51.826989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:51.826989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:51.826989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:51.826989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:51.826989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 296/565] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:51.827685 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98df2d-2084-4abc-9c74-44f641529aca None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:51.827878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98df2d-2084-4abc-9c74-44f641529aca None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:51.828155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98df2d-2084-4abc-9c74-44f641529aca None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:51.829435 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 297/566] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:51.830112 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98df2d-2084-4abc-9c74-44f641529aca None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:51.843203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:51.864704 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8a66c-9d88-4eb9-916b-bcfb51d21f87 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:51.899785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f09d2a-8f4b-4841-8f61-178742d95ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:51.900448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f09d2a-8f4b-4841-8f61-178742d95ad2 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:51.900767 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f09d2a-8f4b-4841-8f61-178742d95ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:51.901044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f09d2a-8f4b-4841-8f61-178742d95ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:51.901773 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f09d2a-8f4b-4841-8f61-178742d95ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:51.902079 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f09d2a-8f4b-4841-8f61-178742d95ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:51.904090 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f09d2a-8f4b-4841-8f61-178742d95ad2 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:51.915691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 270/567] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:51.916489 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f09d2a-8f4b-4841-8f61-178742d95ad2 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:51.931749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98df2d-2084-4abc-9c74-44f641529aca None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:51.989009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e946ed-5136-425e-a325-d82bed213315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:51.989789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e946ed-5136-425e-a325-d82bed213315 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:51.990066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e946ed-5136-425e-a325-d82bed213315 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:51.990333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e946ed-5136-425e-a325-d82bed213315 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:51.999969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e946ed-5136-425e-a325-d82bed213315 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:52.001437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e946ed-5136-425e-a325-d82bed213315 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-60e946ed-5136-425e-a325-d82bed213315 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:37:52.016606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:52.017735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:52.018701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:52.018701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:52.018701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:37:52.018701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:37:52.018701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:37:52.018701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:37:52.018701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:37:52.018701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:37:52.018701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 27 14:37:52.018701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:52.018701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 298/568] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:52.018701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e946ed-5136-425e-a325-d82bed213315 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:52.023414 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:52.053935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f09d2a-8f4b-4841-8f61-178742d95ad2 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:52.090202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:52.092930 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536263ac-40ef-457c-8e0b-935c6dc81110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:52.093592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536263ac-40ef-457c-8e0b-935c6dc81110 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:52.093882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536263ac-40ef-457c-8e0b-935c6dc81110 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:52.094160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536263ac-40ef-457c-8e0b-935c6dc81110 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:52.094882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536263ac-40ef-457c-8e0b-935c6dc81110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:52.095249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536263ac-40ef-457c-8e0b-935c6dc81110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:52.096618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536263ac-40ef-457c-8e0b-935c6dc81110 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:52.109176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 271/569] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:52.110492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1adaf2-2982-44c5-a448-58c5ff621bac None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:52.110785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1adaf2-2982-44c5-a448-58c5ff621bac None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:52.111065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1adaf2-2982-44c5-a448-58c5ff621bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:52.121607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e946ed-5136-425e-a325-d82bed213315 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:52.127551 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-7d1adaf2-2982-44c5-a448-58c5ff621bac None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:52.128786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7d1adaf2-2982-44c5-a448-58c5ff621bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:52.157323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01bf68-7471-4214-a2af-0440552b2f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:52.157988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01bf68-7471-4214-a2af-0440552b2f03 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:52.158276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01bf68-7471-4214-a2af-0440552b2f03 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:52.158559 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01bf68-7471-4214-a2af-0440552b2f03 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:52.159307 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01bf68-7471-4214-a2af-0440552b2f03 None admin] RBAC: Adding query filter params (name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:52.159620 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01bf68-7471-4214-a2af-0440552b2f03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:52.161004 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01bf68-7471-4214-a2af-0440552b2f03 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:52.170182 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 299/570] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:37:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:52.170819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01bf68-7471-4214-a2af-0440552b2f03 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:52.200843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 272/571] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:52.200843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1adaf2-2982-44c5-a448-58c5ff621bac None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:52.259662 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:52.279159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01bf68-7471-4214-a2af-0440552b2f03 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:52.299393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1adaf2-2982-44c5-a448-58c5ff621bac None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:52.300251 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:52.305000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb059c8-9b5f-4285-80ad-aa8268758c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:52.305809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb059c8-9b5f-4285-80ad-aa8268758c99 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:52.306095 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb059c8-9b5f-4285-80ad-aa8268758c99 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:52.306372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb059c8-9b5f-4285-80ad-aa8268758c99 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:52.313856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb059c8-9b5f-4285-80ad-aa8268758c99 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:52.315280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb059c8-9b5f-4285-80ad-aa8268758c99 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-adb059c8-9b5f-4285-80ad-aa8268758c99 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:37:52.329968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:52.330946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:52.331962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:52.331962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:52.331962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:37:52.331962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:37:52.331962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:37:52.331962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:37:52.331962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:37:52.331962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:37:52.331962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:37:52.331962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:52.333552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff615a14-9ea4-47ef-b938-0a34d888e6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:52.334215 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff615a14-9ea4-47ef-b938-0a34d888e6f1 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:52.334497 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff615a14-9ea4-47ef-b938-0a34d888e6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:52.334774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff615a14-9ea4-47ef-b938-0a34d888e6f1 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:52.335617 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff615a14-9ea4-47ef-b938-0a34d888e6f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:52.335934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff615a14-9ea4-47ef-b938-0a34d888e6f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:52.336061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 300/572] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Jun 27 14:37:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:52.336860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb059c8-9b5f-4285-80ad-aa8268758c99 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:52.337383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff615a14-9ea4-47ef-b938-0a34d888e6f1 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:52.354867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 273/573] 10.222.0.44 () {56 vars in 1137 bytes} [Mon Jun 27 14:37:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:52.355662 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff615a14-9ea4-47ef-b938-0a34d888e6f1 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:52.435261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb059c8-9b5f-4285-80ad-aa8268758c99 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:52.455021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff615a14-9ea4-47ef-b938-0a34d888e6f1 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:52.468786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd929d0-44bc-4461-82bb-c919c8540c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:52.469565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd929d0-44bc-4461-82bb-c919c8540c12 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:52.469843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd929d0-44bc-4461-82bb-c919c8540c12 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:52.470116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd929d0-44bc-4461-82bb-c919c8540c12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:52.473293 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:52.476907 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd929d0-44bc-4461-82bb-c919c8540c12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:52.478348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd929d0-44bc-4461-82bb-c919c8540c12 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:52.489368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae593d-343f-412a-af6b-fa2f7b10ecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:52.490142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae593d-343f-412a-af6b-fa2f7b10ecfd None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:52.490424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae593d-343f-412a-af6b-fa2f7b10ecfd None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:52.490700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae593d-343f-412a-af6b-fa2f7b10ecfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:52.492308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-abd929d0-44bc-4461-82bb-c919c8540c12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:52.492308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:52.492308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:52.492308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:52.492308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:52.492308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:52.492308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:52.492308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:52.492308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:52.492308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:52.492308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:52.492308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:52.492308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:37:52.492308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:37:52.492308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:52.493216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:52.494558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:37:52.494558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:37:52.494558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:37:52.494558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:37:52.494558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:37:52.494558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:37:52.494558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:52.494558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:52.496791 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 301/574] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:52.497811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd929d0-44bc-4461-82bb-c919c8540c12 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:52.501819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae593d-343f-412a-af6b-fa2f7b10ecfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:52.503264 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae593d-343f-412a-af6b-fa2f7b10ecfd None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:52.521720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-b3ae593d-343f-412a-af6b-fa2f7b10ecfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:52.521720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:52.521720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:52.521720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:52.521720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:52.521720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:52.521720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:52.521720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:52.521720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:52.521720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:52.521720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:52.521720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:52.521720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:52.521720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:52.521720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:52.522780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:52.523677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:52.523677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:52.523677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:52.523677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:52.523677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 274/575] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:52.523677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae593d-343f-412a-af6b-fa2f7b10ecfd None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:52.555183 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:52.601852 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd929d0-44bc-4461-82bb-c919c8540c12 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:52.621107 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae593d-343f-412a-af6b-fa2f7b10ecfd None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:52.635875 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012bb08-5226-42ed-a330-27c723496548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:52.636664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012bb08-5226-42ed-a330-27c723496548 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:52.636972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012bb08-5226-42ed-a330-27c723496548 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:52.637287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012bb08-5226-42ed-a330-27c723496548 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:52.647123 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012bb08-5226-42ed-a330-27c723496548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:52.654131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f769f-85b0-433c-a9b9-73235abde64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:52.654786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f769f-85b0-433c-a9b9-73235abde64a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-f012bb08-5226-42ed-a330-27c723496548 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:52.654887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:52.655983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:52.656890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:52.656890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:52.656890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:52.656890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:52.656890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:52.656890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:52.656890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:52.656890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:52.656890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:52.656890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:52.656890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:52.656890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:52.657539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f769f-85b0-433c-a9b9-73235abde64a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:52.657539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f769f-85b0-433c-a9b9-73235abde64a None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:52.657676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 302/576] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:52.657758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f769f-85b0-433c-a9b9-73235abde64a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:52.657758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f769f-85b0-433c-a9b9-73235abde64a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:52.657884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012bb08-5226-42ed-a330-27c723496548 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:52.657962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f769f-85b0-433c-a9b9-73235abde64a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:52.679743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 275/577] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Jun 27 14:37:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:52.679743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f769f-85b0-433c-a9b9-73235abde64a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:52.703392 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:52.766290 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012bb08-5226-42ed-a330-27c723496548 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:52.773805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f769f-85b0-433c-a9b9-73235abde64a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:52.779292 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:52.799876 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af571e-cd91-4916-954d-a9f57bf46efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:52.800671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af571e-cd91-4916-954d-a9f57bf46efd None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:52.800964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af571e-cd91-4916-954d-a9f57bf46efd None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:52.801239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af571e-cd91-4916-954d-a9f57bf46efd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:52.807665 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2df116-6f6b-4b93-af58-b6f6d7ab8cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:52.808268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2df116-6f6b-4b93-af58-b6f6d7ab8cf9 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:52.808550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2df116-6f6b-4b93-af58-b6f6d7ab8cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:52.808853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2df116-6f6b-4b93-af58-b6f6d7ab8cf9 None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:52.809873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2df116-6f6b-4b93-af58-b6f6d7ab8cf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:52.810185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2df116-6f6b-4b93-af58-b6f6d7ab8cf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:52.811594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2df116-6f6b-4b93-af58-b6f6d7ab8cf9 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:52.812323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af571e-cd91-4916-954d-a9f57bf46efd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:52.813761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af571e-cd91-4916-954d-a9f57bf46efd None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:52.822774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 276/578] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:37:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:52.823554 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2df116-6f6b-4b93-af58-b6f6d7ab8cf9 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:52.830570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-f2af571e-cd91-4916-954d-a9f57bf46efd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:52.830570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:52.830570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:52.830570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:52.830570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:52.830570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:52.830570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:52.830570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:52.830570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:52.830570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:52.830570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:52.830570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:52.830570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:52.830570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:52.830570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:52.831591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:52.832499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:52.832499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:52.832499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:52.832499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:52.832499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 303/579] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:52.832499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af571e-cd91-4916-954d-a9f57bf46efd None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:52.929203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:52.940685 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af571e-cd91-4916-954d-a9f57bf46efd None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:52.940934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2df116-6f6b-4b93-af58-b6f6d7ab8cf9 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:52.973898 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81042a43-1434-47af-b692-46611d313731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:52.974551 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81042a43-1434-47af-b692-46611d313731 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:52.974832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81042a43-1434-47af-b692-46611d313731 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:52.975106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81042a43-1434-47af-b692-46611d313731 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:52.975841 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81042a43-1434-47af-b692-46611d313731 None admin] RBAC: Adding query filter params (name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:52.976126 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab66e5-0e70-470b-b0c5-202e38b04647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:52.976244 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81042a43-1434-47af-b692-46611d313731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:52.976815 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab66e5-0e70-470b-b0c5-202e38b04647 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:52.977108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab66e5-0e70-470b-b0c5-202e38b04647 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:52.977486 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab66e5-0e70-470b-b0c5-202e38b04647 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:52.977591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81042a43-1434-47af-b692-46611d313731 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:52.978134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab66e5-0e70-470b-b0c5-202e38b04647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:52.978442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab66e5-0e70-470b-b0c5-202e38b04647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:52.979833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab66e5-0e70-470b-b0c5-202e38b04647 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:52.986413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 304/580] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:37:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:52.986982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81042a43-1434-47af-b692-46611d313731 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:52.992618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 277/581] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:52.993444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab66e5-0e70-470b-b0c5-202e38b04647 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:53.018343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:53.093594 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81042a43-1434-47af-b692-46611d313731 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:53.094300 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab66e5-0e70-470b-b0c5-202e38b04647 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:53.128361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cfdf1-ddba-48d4-82bb-a6e4b9c753ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:53.129171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cfdf1-ddba-48d4-82bb-a6e4b9c753ba None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:53.129455 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cfdf1-ddba-48d4-82bb-a6e4b9c753ba None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:53.129549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368610a-d215-47a7-806c-8fdf9e267fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:53.129729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cfdf1-ddba-48d4-82bb-a6e4b9c753ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:53.130144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368610a-d215-47a7-806c-8fdf9e267fb1 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:53.130429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368610a-d215-47a7-806c-8fdf9e267fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:53.130703 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368610a-d215-47a7-806c-8fdf9e267fb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:53.131533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368610a-d215-47a7-806c-8fdf9e267fb1 None admin] RBAC: Adding query filter params (role.id=81973b552fbc46a4ad31c60d8f099564, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=482c11dafd8541e28d50705f7651fd15) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:53.131839 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368610a-d215-47a7-806c-8fdf9e267fb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:53.133294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368610a-d215-47a7-806c-8fdf9e267fb1 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:53.138615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 278/582] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:37:52 2022] GET /identity/v3/role_assignments?user.id=482c11dafd8541e28d50705f7651fd15&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=81973b552fbc46a4ad31c60d8f099564 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:53.139377 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368610a-d215-47a7-806c-8fdf9e267fb1 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:53.139896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cfdf1-ddba-48d4-82bb-a6e4b9c753ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:53.141360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cfdf1-ddba-48d4-82bb-a6e4b9c753ba None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:53.156270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:53.161949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-811cfdf1-ddba-48d4-82bb-a6e4b9c753ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:53.161949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:53.161949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:53.161949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:53.161949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:53.161949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:53.161949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:53.161949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:53.161949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:53.161949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:53.161949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:53.161949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:53.161949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:53.161949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:53.161949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:53.163106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:53.164284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:53.164284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:53.164284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:53.164284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:53.164284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 305/583] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:53.164568 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cfdf1-ddba-48d4-82bb-a6e4b9c753ba None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:53.259390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:53.263623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368610a-d215-47a7-806c-8fdf9e267fb1 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:53.284125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cfdf1-ddba-48d4-82bb-a6e4b9c753ba None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:53.303910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc2410-7f06-4197-91bf-db9419247e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:53.304574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc2410-7f06-4197-91bf-db9419247e9e None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:53.304893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc2410-7f06-4197-91bf-db9419247e9e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:53.305168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc2410-7f06-4197-91bf-db9419247e9e None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:53.305901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc2410-7f06-4197-91bf-db9419247e9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:53.306213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc2410-7f06-4197-91bf-db9419247e9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:53.307639 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc2410-7f06-4197-91bf-db9419247e9e None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:53.326048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 279/584] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:53.326048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc2410-7f06-4197-91bf-db9419247e9e None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:53.329738 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f90fbe-6704-44bf-96a8-c1819ba02da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:53.330533 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f90fbe-6704-44bf-96a8-c1819ba02da8 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:53.330818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f90fbe-6704-44bf-96a8-c1819ba02da8 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:53.331094 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f90fbe-6704-44bf-96a8-c1819ba02da8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:53.341423 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f90fbe-6704-44bf-96a8-c1819ba02da8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:53.342843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f90fbe-6704-44bf-96a8-c1819ba02da8 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:53.360903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-e0f90fbe-6704-44bf-96a8-c1819ba02da8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:53.360903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:53.360903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:53.360903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:53.360903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:53.360903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:53.360903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:53.360903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:53.360903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:53.360903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:53.360903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:53.360903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:53.360903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:53.360903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:53.360903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:53.361865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:53.362777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:53.362777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:53.362777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:53.362777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:53.362777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 306/585] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:53.362777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f90fbe-6704-44bf-96a8-c1819ba02da8 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:53.416631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:53.452497 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc2410-7f06-4197-91bf-db9419247e9e None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:53.474803 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f90fbe-6704-44bf-96a8-c1819ba02da8 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:53.487359 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61324c-4753-4eae-ab48-900cc0121241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:53.488149 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61324c-4753-4eae-ab48-900cc0121241 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:53.488440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61324c-4753-4eae-ab48-900cc0121241 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:53.488725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61324c-4753-4eae-ab48-900cc0121241 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:53.495876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61324c-4753-4eae-ab48-900cc0121241 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:53.497328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61324c-4753-4eae-ab48-900cc0121241 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:53.506799 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-1b61324c-4753-4eae-ab48-900cc0121241 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:37:53.512144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:53.517274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:53.518327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:53.518327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:53.518327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:37:53.518327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:37:53.518327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:37:53.518327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:37:53.518327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:37:53.518327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:37:53.518327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 14:37:53.518327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:53.518883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f44ef9-96c2-4ae7-b65f-c9aabef594d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:53.518883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f44ef9-96c2-4ae7-b65f-c9aabef594d3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:53.518883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f44ef9-96c2-4ae7-b65f-c9aabef594d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:53.518883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f44ef9-96c2-4ae7-b65f-c9aabef594d3 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:53.519149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f44ef9-96c2-4ae7-b65f-c9aabef594d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:53.519149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f44ef9-96c2-4ae7-b65f-c9aabef594d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:53.519149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f44ef9-96c2-4ae7-b65f-c9aabef594d3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:53.519945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 280/586] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:53.519945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61324c-4753-4eae-ab48-900cc0121241 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:53.537260 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 307/587] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:53.537260 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f44ef9-96c2-4ae7-b65f-c9aabef594d3 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:53.627262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61324c-4753-4eae-ab48-900cc0121241 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:53.635546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f44ef9-96c2-4ae7-b65f-c9aabef594d3 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:53.657860 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:53.664169 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270070c7-a5a9-4066-8cc0-0d73eb95e0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:53.665377 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270070c7-a5a9-4066-8cc0-0d73eb95e0ca None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:53.666063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270070c7-a5a9-4066-8cc0-0d73eb95e0ca None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:53.666656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270070c7-a5a9-4066-8cc0-0d73eb95e0ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:53.671291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20062c4e-fea0-4e03-8075-b2d76eea84df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:53.671951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20062c4e-fea0-4e03-8075-b2d76eea84df None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:53.672236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20062c4e-fea0-4e03-8075-b2d76eea84df None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:53.672510 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20062c4e-fea0-4e03-8075-b2d76eea84df None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:53.673261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20062c4e-fea0-4e03-8075-b2d76eea84df None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:53.673572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20062c4e-fea0-4e03-8075-b2d76eea84df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:53.674690 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270070c7-a5a9-4066-8cc0-0d73eb95e0ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:53.674922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20062c4e-fea0-4e03-8075-b2d76eea84df None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:53.676517 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270070c7-a5a9-4066-8cc0-0d73eb95e0ca None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:53.691473 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 308/588] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:53.691473 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20062c4e-fea0-4e03-8075-b2d76eea84df None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:53.692463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-270070c7-a5a9-4066-8cc0-0d73eb95e0ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:53.692463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:53.692463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:53.692463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:53.692463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:53.692463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:53.692463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:53.692463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:53.692463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:53.692463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:53.692463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:53.692463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:53.692463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:37:53.692463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:37:53.692463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:53.693569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:53.694697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:37:53.694697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:37:53.694697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:37:53.694697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:37:53.694697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:37:53.694697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:37:53.694697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:53.694697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:53.694697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 281/589] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:53.695312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270070c7-a5a9-4066-8cc0-0d73eb95e0ca None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:53.744346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:53.798056 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20062c4e-fea0-4e03-8075-b2d76eea84df None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:53.808918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270070c7-a5a9-4066-8cc0-0d73eb95e0ca None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:53.837041 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23735dc9-19a4-4eff-bbaa-f71c11373058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:53.838098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23735dc9-19a4-4eff-bbaa-f71c11373058 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:53.838688 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23735dc9-19a4-4eff-bbaa-f71c11373058 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:53.839417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23735dc9-19a4-4eff-bbaa-f71c11373058 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:53.841697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23735dc9-19a4-4eff-bbaa-f71c11373058 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:53.842305 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23735dc9-19a4-4eff-bbaa-f71c11373058 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:53.844292 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23735dc9-19a4-4eff-bbaa-f71c11373058 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:53.844437 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa03b47-bf8a-42d6-b318-7e1532201bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:53.845255 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa03b47-bf8a-42d6-b318-7e1532201bdb None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:53.845535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa03b47-bf8a-42d6-b318-7e1532201bdb None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:53.845807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa03b47-bf8a-42d6-b318-7e1532201bdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:53.852581 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa03b47-bf8a-42d6-b318-7e1532201bdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:53.854016 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa03b47-bf8a-42d6-b318-7e1532201bdb None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:53.865046 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 309/590] 10.222.0.44 () {56 vars in 1139 bytes} [Mon Jun 27 14:37:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:53.866097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23735dc9-19a4-4eff-bbaa-f71c11373058 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:53.868475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-2aa03b47-bf8a-42d6-b318-7e1532201bdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:53.868475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:53.868475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:53.868475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:53.868475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:53.868475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:53.868475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:53.868475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:53.868475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:53.868475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:53.868475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:53.868475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:53.868475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:37:53.868475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:37:53.868475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:53.872010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:53.872961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:37:53.872961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:37:53.872961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:37:53.872961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:37:53.872961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:37:53.872961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:37:53.872961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:53.872961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:53.872961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 282/591] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:53.872961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa03b47-bf8a-42d6-b318-7e1532201bdb None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:53.928221 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:53.979131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa03b47-bf8a-42d6-b318-7e1532201bdb None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:53.986153 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23735dc9-19a4-4eff-bbaa-f71c11373058 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:53.995317 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:54.019656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa1701-4aef-444c-b4ec-0d23596c0011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:54.020311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa1701-4aef-444c-b4ec-0d23596c0011 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:54.020589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa1701-4aef-444c-b4ec-0d23596c0011 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:54.020897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa1701-4aef-444c-b4ec-0d23596c0011 None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:54.021682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa1701-4aef-444c-b4ec-0d23596c0011 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:54.021988 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa1701-4aef-444c-b4ec-0d23596c0011 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:54.022972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef50102-b051-4d95-bf20-df78593ed147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:54.023402 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa1701-4aef-444c-b4ec-0d23596c0011 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:54.023762 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef50102-b051-4d95-bf20-df78593ed147 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:54.024046 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef50102-b051-4d95-bf20-df78593ed147 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:54.024323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef50102-b051-4d95-bf20-df78593ed147 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:54.035462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef50102-b051-4d95-bf20-df78593ed147 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:54.036952 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef50102-b051-4d95-bf20-df78593ed147 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:54.037594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 283/592] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:37:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:54.038394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa1701-4aef-444c-b4ec-0d23596c0011 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-4ef50102-b051-4d95-bf20-df78593ed147 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:37:54.056679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:54.057831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:54.058920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:54.058920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:54.058920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:37:54.058920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:37:54.058920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:37:54.058920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:37:54.058920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:37:54.058920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:37:54.058920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 14:37:54.058920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:54.058920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 310/593] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:54.063709 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef50102-b051-4d95-bf20-df78593ed147 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:54.155891 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa1701-4aef-444c-b4ec-0d23596c0011 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:54.170339 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:54.173586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef50102-b051-4d95-bf20-df78593ed147 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:54.193455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0842425-74e2-473e-82cc-05ca1c0745e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:54.194178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0842425-74e2-473e-82cc-05ca1c0745e7 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:54.194464 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0842425-74e2-473e-82cc-05ca1c0745e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:54.194745 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0842425-74e2-473e-82cc-05ca1c0745e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:54.207443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0842425-74e2-473e-82cc-05ca1c0745e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:54.207652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827461f-b9d6-43f4-abb1-d009fe1e39ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:54.208403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827461f-b9d6-43f4-abb1-d009fe1e39ed None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:54.208806 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827461f-b9d6-43f4-abb1-d009fe1e39ed None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:54.209173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827461f-b9d6-43f4-abb1-d009fe1e39ed None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:54.209267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0842425-74e2-473e-82cc-05ca1c0745e7 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:54.210142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827461f-b9d6-43f4-abb1-d009fe1e39ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:54.210520 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827461f-b9d6-43f4-abb1-d009fe1e39ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:54.212006 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827461f-b9d6-43f4-abb1-d009fe1e39ed None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:54.229290 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 311/594] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:54.229290 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827461f-b9d6-43f4-abb1-d009fe1e39ed None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:54.230009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-a0842425-74e2-473e-82cc-05ca1c0745e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:54.230009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:54.230009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:54.230009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:54.230009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:54.230009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:54.230009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:54.230009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:54.230009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:54.230009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:54.230009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:54.230009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:54.230009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:54.230009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:54.230009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:54.231184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:54.232280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:54.232280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:54.232280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:54.232280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:54.232280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 284/595] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:54.232633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0842425-74e2-473e-82cc-05ca1c0745e7 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:54.266887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:54.342519 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827461f-b9d6-43f4-abb1-d009fe1e39ed None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:54.348958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0842425-74e2-473e-82cc-05ca1c0745e7 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:54.380239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051abd1-5401-4631-92c8-9759824b333d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:54.381150 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051abd1-5401-4631-92c8-9759824b333d None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:54.381429 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051abd1-5401-4631-92c8-9759824b333d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:54.381708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051abd1-5401-4631-92c8-9759824b333d None admin] PATH_INFO: `/v3/projects/af4d24603fa24a62946a57fabb774756/users/6e93d0321eaa4936a55390155d5aab0a/roles/81973b552fbc46a4ad31c60d8f099564` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:54.386621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b339e-900b-4786-8f78-37065a0c54c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:54.387740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b339e-900b-4786-8f78-37065a0c54c3 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:54.388302 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b339e-900b-4786-8f78-37065a0c54c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:54.388829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b339e-900b-4786-8f78-37065a0c54c3 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:54.390405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b339e-900b-4786-8f78-37065a0c54c3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:54.390926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b339e-900b-4786-8f78-37065a0c54c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:54.393141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b339e-900b-4786-8f78-37065a0c54c3 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:54.396437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051abd1-5401-4631-92c8-9759824b333d None admin] RBAC: Authorizing `identity:create_grant(project_id=af4d24603fa24a62946a57fabb774756, user_id=6e93d0321eaa4936a55390155d5aab0a, role_id=81973b552fbc46a4ad31c60d8f099564)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:54.398591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051abd1-5401-4631-92c8-9759824b333d None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:54.413915 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 285/596] 10.222.0.44 () {56 vars in 1137 bytes} [Mon Jun 27 14:37:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:54.415077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b339e-900b-4786-8f78-37065a0c54c3 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:54.439281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:54.461179 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 312/597] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:37:54 2022] PUT /identity/v3/projects/af4d24603fa24a62946a57fabb774756/users/6e93d0321eaa4936a55390155d5aab0a/roles/81973b552fbc46a4ad31c60d8f099564 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:37:54.462043 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051abd1-5401-4631-92c8-9759824b333d None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:54.535916 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b339e-900b-4786-8f78-37065a0c54c3 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:54.569466 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:54.578198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db40dea-af36-4a8e-a965-b6fb9c4a55a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:54.579584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db40dea-af36-4a8e-a965-b6fb9c4a55a7 None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:54.579852 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db40dea-af36-4a8e-a965-b6fb9c4a55a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:54.580221 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db40dea-af36-4a8e-a965-b6fb9c4a55a7 None admin] PATH_INFO: `/v3/projects/af4d24603fa24a62946a57fabb774756/users/08529776af224c36ab560c13f5941e0a/roles/81973b552fbc46a4ad31c60d8f099564` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:54.597832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db40dea-af36-4a8e-a965-b6fb9c4a55a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=af4d24603fa24a62946a57fabb774756, user_id=08529776af224c36ab560c13f5941e0a, role_id=81973b552fbc46a4ad31c60d8f099564)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:54.598627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051abd1-5401-4631-92c8-9759824b333d None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:54.599583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db40dea-af36-4a8e-a965-b6fb9c4a55a7 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:54.639690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7f7d7-c005-4da6-9846-37ecb6f00473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:54.640353 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7f7d7-c005-4da6-9846-37ecb6f00473 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:54.640704 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7f7d7-c005-4da6-9846-37ecb6f00473 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:54.640986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7f7d7-c005-4da6-9846-37ecb6f00473 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:54.641712 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7f7d7-c005-4da6-9846-37ecb6f00473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:54.642019 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7f7d7-c005-4da6-9846-37ecb6f00473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:54.643369 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7f7d7-c005-4da6-9846-37ecb6f00473 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:54.655476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 313/598] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:54.656127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7f7d7-c005-4da6-9846-37ecb6f00473 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:54.680538 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 286/599] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:37:54 2022] PUT /identity/v3/projects/af4d24603fa24a62946a57fabb774756/users/08529776af224c36ab560c13f5941e0a/roles/81973b552fbc46a4ad31c60d8f099564 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:37:54.682024 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db40dea-af36-4a8e-a965-b6fb9c4a55a7 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:54.807161 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7f7d7-c005-4da6-9846-37ecb6f00473 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:54.849233 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e05c7-8e67-4435-ac98-cb538a483e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:54.850047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e05c7-8e67-4435-ac98-cb538a483e27 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:54.850332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e05c7-8e67-4435-ac98-cb538a483e27 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:54.850607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e05c7-8e67-4435-ac98-cb538a483e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:54.858162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:54.860460 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:54.867748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e05c7-8e67-4435-ac98-cb538a483e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:54.871254 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e05c7-8e67-4435-ac98-cb538a483e27 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:54.887714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-650e05c7-8e67-4435-ac98-cb538a483e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:54.887714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:54.887714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:54.887714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:54.887714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:54.887714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:54.887714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:54.887714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:54.887714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:54.887714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:54.887714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:54.887714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:54.887714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:54.887714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:54.887714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:54.888884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:54.890032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:54.890032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:54.890032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:54.890032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:54.890675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 314/600] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:54.896510 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e05c7-8e67-4435-ac98-cb538a483e27 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:54.898023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db40dea-af36-4a8e-a965-b6fb9c4a55a7 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:54.938931 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4101d-4a69-409c-8ba8-6c11cc8721e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:54.940186 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4101d-4a69-409c-8ba8-6c11cc8721e8 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:54.940611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4101d-4a69-409c-8ba8-6c11cc8721e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:54.941071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4101d-4a69-409c-8ba8-6c11cc8721e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:54.949161 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4101d-4a69-409c-8ba8-6c11cc8721e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:54.951674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4101d-4a69-409c-8ba8-6c11cc8721e8 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:54.969320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-4fe4101d-4a69-409c-8ba8-6c11cc8721e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:54.969320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:54.969320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:54.969320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:54.969320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:54.969320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:54.969320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:54.969320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:54.969320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:54.969320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:54.969320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:54.969320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:54.969320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:37:54.969320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:37:54.969320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:54.970433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:54.971393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:37:54.971393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:37:54.971393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:37:54.971393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:37:54.971393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:37:54.971393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:37:54.971393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:54.971393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:54.973656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 287/601] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:54.990447 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4101d-4a69-409c-8ba8-6c11cc8721e8 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:55.012879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e05c7-8e67-4435-ac98-cb538a483e27 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:55.047854 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c405a-12e2-421a-ad41-347d350cb432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:55.048524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c405a-12e2-421a-ad41-347d350cb432 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:55.048841 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c405a-12e2-421a-ad41-347d350cb432 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:55.052670 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c405a-12e2-421a-ad41-347d350cb432 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:55.052670 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c405a-12e2-421a-ad41-347d350cb432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:55.052670 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c405a-12e2-421a-ad41-347d350cb432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:55.052670 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c405a-12e2-421a-ad41-347d350cb432 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:55.065140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 315/602] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:55.070392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c405a-12e2-421a-ad41-347d350cb432 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:55.129008 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:55.179530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c405a-12e2-421a-ad41-347d350cb432 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:55.214519 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4101d-4a69-409c-8ba8-6c11cc8721e8 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:55.216078 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249923b1-a10b-4d6b-8757-50b576f526cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:55.216850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249923b1-a10b-4d6b-8757-50b576f526cb None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:55.217136 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249923b1-a10b-4d6b-8757-50b576f526cb None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:55.217414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249923b1-a10b-4d6b-8757-50b576f526cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:55.224868 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249923b1-a10b-4d6b-8757-50b576f526cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:55.226311 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249923b1-a10b-4d6b-8757-50b576f526cb None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:55.242185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-249923b1-a10b-4d6b-8757-50b576f526cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:55.242185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:55.242185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:55.242185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:55.242185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:55.242185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:55.242185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:55.242185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:55.242185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:55.242185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:55.242185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:55.242185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:55.242185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:37:55.242185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:37:55.242185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:55.243287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:55.244416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:37:55.244416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:37:55.244416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:37:55.244416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:37:55.244416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:37:55.244416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:37:55.244416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:55.244416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:55.244416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 316/603] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:55.249783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073edbcd-104f-4c4a-9f84-aa824cfe7e03 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:55.250075 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073edbcd-104f-4c4a-9f84-aa824cfe7e03 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:55.250357 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073edbcd-104f-4c4a-9f84-aa824cfe7e03 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:55.251774 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 317/604] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:55.252956 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073edbcd-104f-4c4a-9f84-aa824cfe7e03 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:55.266481 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:55.271497 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c90f0-aa77-4203-9e99-ee5dfcedf690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:55.272089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c90f0-aa77-4203-9e99-ee5dfcedf690 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:55.272446 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c90f0-aa77-4203-9e99-ee5dfcedf690 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:55.272886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c90f0-aa77-4203-9e99-ee5dfcedf690 None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:55.280185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c90f0-aa77-4203-9e99-ee5dfcedf690 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:55.280185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c90f0-aa77-4203-9e99-ee5dfcedf690 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:55.280185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c90f0-aa77-4203-9e99-ee5dfcedf690 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:55.299773 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 288/605] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:55.304742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4587e76-80de-4d46-a88e-95b611865e47 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:55.304742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4587e76-80de-4d46-a88e-95b611865e47 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:55.304742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4587e76-80de-4d46-a88e-95b611865e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:55.324339 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f4587e76-80de-4d46-a88e-95b611865e47 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:55.326506 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f4587e76-80de-4d46-a88e-95b611865e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:55.376244 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073edbcd-104f-4c4a-9f84-aa824cfe7e03 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:55.389388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:55.414815 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f994965-1e89-4aa2-8002-f9aae2ad3ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:55.415013 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 289/606] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:55.415813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4587e76-80de-4d46-a88e-95b611865e47 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:55.416177 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f994965-1e89-4aa2-8002-f9aae2ad3ca3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:55.416678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f994965-1e89-4aa2-8002-f9aae2ad3ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:55.417177 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f994965-1e89-4aa2-8002-f9aae2ad3ca3 None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:55.418407 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f994965-1e89-4aa2-8002-f9aae2ad3ca3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:55.419119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f994965-1e89-4aa2-8002-f9aae2ad3ca3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:55.420776 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f994965-1e89-4aa2-8002-f9aae2ad3ca3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:55.434543 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 318/607] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:37:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:55.440377 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f994965-1e89-4aa2-8002-f9aae2ad3ca3 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:55.544177 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4587e76-80de-4d46-a88e-95b611865e47 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:55.568575 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:55.581117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f994965-1e89-4aa2-8002-f9aae2ad3ca3 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:55.584854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26db73-97e7-4cd8-ab26-22887137220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:55.586002 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26db73-97e7-4cd8-ab26-22887137220e None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:55.586458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26db73-97e7-4cd8-ab26-22887137220e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:55.586902 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26db73-97e7-4cd8-ab26-22887137220e None admin] PATH_INFO: `/v3/projects/af4d24603fa24a62946a57fabb774756/users/bdf31d7d8c164809bde0e12b71ecfca0/roles/81973b552fbc46a4ad31c60d8f099564` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:55.608999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26db73-97e7-4cd8-ab26-22887137220e None admin] RBAC: Authorizing `identity:create_grant(project_id=af4d24603fa24a62946a57fabb774756, user_id=bdf31d7d8c164809bde0e12b71ecfca0, role_id=81973b552fbc46a4ad31c60d8f099564)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:55.611410 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26db73-97e7-4cd8-ab26-22887137220e None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:55.620163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bea6d-eba1-4b88-8be6-0b772a9cdd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:55.621069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bea6d-eba1-4b88-8be6-0b772a9cdd72 None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:55.621349 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bea6d-eba1-4b88-8be6-0b772a9cdd72 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:55.622240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bea6d-eba1-4b88-8be6-0b772a9cdd72 None admin] PATH_INFO: `/v3/projects/af4d24603fa24a62946a57fabb774756/users/015326e75ae14b778e4478627d07c17f/roles/81973b552fbc46a4ad31c60d8f099564` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:55.637422 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bea6d-eba1-4b88-8be6-0b772a9cdd72 None admin] RBAC: Authorizing `identity:create_grant(project_id=af4d24603fa24a62946a57fabb774756, user_id=015326e75ae14b778e4478627d07c17f, role_id=81973b552fbc46a4ad31c60d8f099564)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:55.638995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bea6d-eba1-4b88-8be6-0b772a9cdd72 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:55.702051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 290/608] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:37:55 2022] PUT /identity/v3/projects/af4d24603fa24a62946a57fabb774756/users/bdf31d7d8c164809bde0e12b71ecfca0/roles/81973b552fbc46a4ad31c60d8f099564 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:37:55.702051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26db73-97e7-4cd8-ab26-22887137220e None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:55.725961 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 319/609] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:37:55 2022] PUT /identity/v3/projects/af4d24603fa24a62946a57fabb774756/users/015326e75ae14b778e4478627d07c17f/roles/81973b552fbc46a4ad31c60d8f099564 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:37:55.863842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26db73-97e7-4cd8-ab26-22887137220e None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:55.912435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13368d69-bc53-402b-8f40-949281b9caf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:55.913842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13368d69-bc53-402b-8f40-949281b9caf4 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:55.914334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13368d69-bc53-402b-8f40-949281b9caf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:55.914830 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13368d69-bc53-402b-8f40-949281b9caf4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:55.927982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13368d69-bc53-402b-8f40-949281b9caf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-13368d69-bc53-402b-8f40-949281b9caf4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:55.936892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:55.937876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:55.938763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:55.938763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:55.938763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:55.938763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:55.938763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:55.938763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:55.938763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:55.938763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:55.938763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:55.938763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:55.938763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:55.938763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:55.941774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 291/610] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:55.950650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bea6d-eba1-4b88-8be6-0b772a9cdd72 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:55.978275 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:56.075399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bea6d-eba1-4b88-8be6-0b772a9cdd72 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:56.111028 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74470c3-1052-4746-916a-0e1775da39e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:56.112156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74470c3-1052-4746-916a-0e1775da39e5 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:56.112537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74470c3-1052-4746-916a-0e1775da39e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:56.112835 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74470c3-1052-4746-916a-0e1775da39e5 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:56.113645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74470c3-1052-4746-916a-0e1775da39e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:56.114005 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74470c3-1052-4746-916a-0e1775da39e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:56.115297 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74470c3-1052-4746-916a-0e1775da39e5 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:56.124858 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 320/611] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:37:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:56.130457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13368d69-bc53-402b-8f40-949281b9caf4 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:56.167019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:56.240915 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13368d69-bc53-402b-8f40-949281b9caf4 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:56.276865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b6482-6688-49f8-b4fe-823e3e8da67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:56.277651 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b6482-6688-49f8-b4fe-823e3e8da67f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:56.278483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b6482-6688-49f8-b4fe-823e3e8da67f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:56.278760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b6482-6688-49f8-b4fe-823e3e8da67f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:56.290035 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b6482-6688-49f8-b4fe-823e3e8da67f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:56.291461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b6482-6688-49f8-b4fe-823e3e8da67f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:56.309369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-987b6482-6688-49f8-b4fe-823e3e8da67f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:56.309369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:56.309369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:56.309369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:56.309369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:56.309369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:56.309369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:56.309369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:56.309369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:56.309369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:56.309369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:56.309369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:56.309369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:56.309369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:56.309369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:56.310297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:56.311235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:56.311235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:56.311235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:56.311235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:56.311235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 292/612] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:56.316396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74470c3-1052-4746-916a-0e1775da39e5 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:56.420308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:56.437964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74470c3-1052-4746-916a-0e1775da39e5 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:56.486835 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3978ae-983b-44f3-9766-f86d458ac603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:56.487565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3978ae-983b-44f3-9766-f86d458ac603 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:56.487845 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3978ae-983b-44f3-9766-f86d458ac603 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:56.488164 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3978ae-983b-44f3-9766-f86d458ac603 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:56.488914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3978ae-983b-44f3-9766-f86d458ac603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:56.489220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3978ae-983b-44f3-9766-f86d458ac603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:56.490580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3978ae-983b-44f3-9766-f86d458ac603 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:56.507106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 321/613] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:56.513020 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b6482-6688-49f8-b4fe-823e3e8da67f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:56.621017 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:56.638151 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b6482-6688-49f8-b4fe-823e3e8da67f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:56.673186 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08393256-6053-4130-bb53-b2df0db6666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:56.673901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08393256-6053-4130-bb53-b2df0db6666d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:56.674179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08393256-6053-4130-bb53-b2df0db6666d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:56.674452 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08393256-6053-4130-bb53-b2df0db6666d None admin] PATH_INFO: `/v3/users/swift` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:56.681961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08393256-6053-4130-bb53-b2df0db6666d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:56.683469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08393256-6053-4130-bb53-b2df0db6666d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-08393256-6053-4130-bb53-b2df0db6666d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:37:56.698709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:56.700569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:56.701543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:56.701543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:56.701543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:37:56.701543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:37:56.701543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:37:56.701543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:37:56.701543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:37:56.701543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:37:56.701543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 14:37:56.701543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:56.701543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 293/614] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:37:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:56.705212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34782f39-fc9a-4a08-b7ce-320eaa17e611 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:56.705735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34782f39-fc9a-4a08-b7ce-320eaa17e611 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:56.705888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34782f39-fc9a-4a08-b7ce-320eaa17e611 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:56.709605 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08393256-6053-4130-bb53-b2df0db6666d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:56.710846 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 322/615] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:56.712452 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b53d37-28df-44a8-8bad-18220f9c8638 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:56.712777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b53d37-28df-44a8-8bad-18220f9c8638 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:56.713068 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b53d37-28df-44a8-8bad-18220f9c8638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:56.757380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-c5b53d37-28df-44a8-8bad-18220f9c8638 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:56.758946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-c5b53d37-28df-44a8-8bad-18220f9c8638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:56.815281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08393256-6053-4130-bb53-b2df0db6666d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:56.850142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30dbba-8d50-4a14-b8b2-16102e568d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:56.850817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30dbba-8d50-4a14-b8b2-16102e568d90 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:56.851100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30dbba-8d50-4a14-b8b2-16102e568d90 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:56.851375 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30dbba-8d50-4a14-b8b2-16102e568d90 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:56.852211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30dbba-8d50-4a14-b8b2-16102e568d90 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:56.852526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30dbba-8d50-4a14-b8b2-16102e568d90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:56.854055 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30dbba-8d50-4a14-b8b2-16102e568d90 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:56.873562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 294/616] 10.222.0.44 () {56 vars in 1135 bytes} [Mon Jun 27 14:37:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:56.878742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30dbba-8d50-4a14-b8b2-16102e568d90 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:56.883064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:56.955752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 323/617] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:56.979236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b53d37-28df-44a8-8bad-18220f9c8638 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:57.085232 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30dbba-8d50-4a14-b8b2-16102e568d90 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:57.106111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:57.149485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b53d37-28df-44a8-8bad-18220f9c8638 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:57.155593 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9032d-0068-420d-a46f-2fe70452bc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:57.158059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9032d-0068-420d-a46f-2fe70452bc3e None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:57.158358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9032d-0068-420d-a46f-2fe70452bc3e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:57.158644 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9032d-0068-420d-a46f-2fe70452bc3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:57.178763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9032d-0068-420d-a46f-2fe70452bc3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:57.180210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9032d-0068-420d-a46f-2fe70452bc3e None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:57.191704 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac60ed-586f-47d3-95ea-3d669e940d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:57.192555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac60ed-586f-47d3-95ea-3d669e940d95 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:57.192872 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac60ed-586f-47d3-95ea-3d669e940d95 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:57.193156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac60ed-586f-47d3-95ea-3d669e940d95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:57.204547 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac60ed-586f-47d3-95ea-3d669e940d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-dbac60ed-586f-47d3-95ea-3d669e940d95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:57.212434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:57.213395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:57.214399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:57.214399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:57.214399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:57.214399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:57.214399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:57.214399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:57.214399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:57.214399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:57.214399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:57.214399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:57.214399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:57.214399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:57.214399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 324/618] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:57.225385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-4ab9032d-0068-420d-a46f-2fe70452bc3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:57.225385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:57.225385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:57.225385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:57.225385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:57.225385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:57.225385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:57.225385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:57.225385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:57.225385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:57.225385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:57.225385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:57.225385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:57.225385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:57.225385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:57.226317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:57.227214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:57.227214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:57.227214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:57.227214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:57.227214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 295/619] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:57.227938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac60ed-586f-47d3-95ea-3d669e940d95 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:57.237786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9032d-0068-420d-a46f-2fe70452bc3e None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:57.341405 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac60ed-586f-47d3-95ea-3d669e940d95 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:57.355992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:57.373686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:57.378621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e77e2-d971-47be-9d70-6a5f6b2c23af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:57.379638 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e77e2-d971-47be-9d70-6a5f6b2c23af None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:57.379638 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e77e2-d971-47be-9d70-6a5f6b2c23af None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:57.384300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e77e2-d971-47be-9d70-6a5f6b2c23af None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:57.384300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e77e2-d971-47be-9d70-6a5f6b2c23af None admin] RBAC: Adding query filter params (name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:57.384300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e77e2-d971-47be-9d70-6a5f6b2c23af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:57.384300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e77e2-d971-47be-9d70-6a5f6b2c23af None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:57.397520 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 325/620] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:37:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:57.398929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fa77d-c1e6-480e-ad3a-9cfa45424d03 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:57.399221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fa77d-c1e6-480e-ad3a-9cfa45424d03 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:57.399501 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fa77d-c1e6-480e-ad3a-9cfa45424d03 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:57.400979 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 326/621] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:57.402111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fa77d-c1e6-480e-ad3a-9cfa45424d03 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:57.411890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9032d-0068-420d-a46f-2fe70452bc3e None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:57.448385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3e983-8cd3-4c0f-a7b3-acabe495810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:57.449716 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3e983-8cd3-4c0f-a7b3-acabe495810a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:57.451342 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3e983-8cd3-4c0f-a7b3-acabe495810a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:57.451886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3e983-8cd3-4c0f-a7b3-acabe495810a None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:57.452957 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3e983-8cd3-4c0f-a7b3-acabe495810a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:57.453509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3e983-8cd3-4c0f-a7b3-acabe495810a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:57.455220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3e983-8cd3-4c0f-a7b3-acabe495810a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:57.468422 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 296/622] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:57.469985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10178e09-1fad-4288-9616-47a77537c712 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:57.470478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10178e09-1fad-4288-9616-47a77537c712 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:57.470947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10178e09-1fad-4288-9616-47a77537c712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:57.488905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-10178e09-1fad-4288-9616-47a77537c712 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:57.490474 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-10178e09-1fad-4288-9616-47a77537c712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:57.517094 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fa77d-c1e6-480e-ad3a-9cfa45424d03 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:57.552963 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148a80a-386c-409c-a77b-868f42dd1626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:57.553843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148a80a-386c-409c-a77b-868f42dd1626 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:57.554124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148a80a-386c-409c-a77b-868f42dd1626 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:57.554405 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148a80a-386c-409c-a77b-868f42dd1626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:57.563943 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 297/623] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:57.565170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10178e09-1fad-4288-9616-47a77537c712 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:57.565796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148a80a-386c-409c-a77b-868f42dd1626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:57.567232 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148a80a-386c-409c-a77b-868f42dd1626 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:57.586699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-1148a80a-386c-409c-a77b-868f42dd1626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:57.586699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:57.586699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:57.586699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:57.586699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:57.586699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:57.586699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:57.586699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:57.586699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:57.586699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:57.586699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:57.586699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:57.586699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:57.586699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:57.586699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:57.587641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:57.588540 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:57.588540 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:57.588540 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:57.588540 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:57.592464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 327/624] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:57.593755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148a80a-386c-409c-a77b-868f42dd1626 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:57.617426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:57.645024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:57.676152 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10178e09-1fad-4288-9616-47a77537c712 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:57.702616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148a80a-386c-409c-a77b-868f42dd1626 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:57.713439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aee519-7e2c-4f59-8088-a43f7bc5d934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:57.714488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aee519-7e2c-4f59-8088-a43f7bc5d934 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:57.714956 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aee519-7e2c-4f59-8088-a43f7bc5d934 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:57.716079 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aee519-7e2c-4f59-8088-a43f7bc5d934 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:57.724119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aee519-7e2c-4f59-8088-a43f7bc5d934 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:57.725812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aee519-7e2c-4f59-8088-a43f7bc5d934 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:57.738532 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af63df-6cda-4b21-919f-d7c99acfe624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:57.739282 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af63df-6cda-4b21-919f-d7c99acfe624 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:57.739639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af63df-6cda-4b21-919f-d7c99acfe624 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:57.739988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af63df-6cda-4b21-919f-d7c99acfe624 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:57.740820 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af63df-6cda-4b21-919f-d7c99acfe624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:57.741196 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af63df-6cda-4b21-919f-d7c99acfe624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:57.742507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-38aee519-7e2c-4f59-8088-a43f7bc5d934 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:57.742507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:57.742507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:57.742507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:57.742507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:57.742507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:57.742507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:57.742507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:57.742507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:57.742507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:57.742507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:57.742507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:57.742507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:37:57.742507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:37:57.742507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:57.743405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:57.744312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:37:57.744312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:37:57.744312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:37:57.744312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:37:57.744312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:37:57.744312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:37:57.744312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:57.744312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:57.744787 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af63df-6cda-4b21-919f-d7c99acfe624 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:57.746860 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 298/625] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:57.747976 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aee519-7e2c-4f59-8088-a43f7bc5d934 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:57.765239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 328/626] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:37:57.766299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af63df-6cda-4b21-919f-d7c99acfe624 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:57.857865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aee519-7e2c-4f59-8088-a43f7bc5d934 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:57.860616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:57.874975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af63df-6cda-4b21-919f-d7c99acfe624 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:57.883050 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:57.897217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26d45f-cb5d-44f9-8756-14699bf3683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:57.898650 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26d45f-cb5d-44f9-8756-14699bf3683f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:57.899141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26d45f-cb5d-44f9-8756-14699bf3683f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:57.899595 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26d45f-cb5d-44f9-8756-14699bf3683f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:57.911406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26d45f-cb5d-44f9-8756-14699bf3683f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:57.913314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d181c5-8e18-413a-b4e5-4f934dd974f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:57.913975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d181c5-8e18-413a-b4e5-4f934dd974f5 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:57.914261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d181c5-8e18-413a-b4e5-4f934dd974f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:57.914537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d181c5-8e18-413a-b4e5-4f934dd974f5 None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:57.915342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d181c5-8e18-413a-b4e5-4f934dd974f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:57.915653 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d181c5-8e18-413a-b4e5-4f934dd974f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:57.917171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d181c5-8e18-413a-b4e5-4f934dd974f5 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-aa26d45f-cb5d-44f9-8756-14699bf3683f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:57.921926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:57.922883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:57.923725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:57.923725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:57.923725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:57.923725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:57.923725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:57.923725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:57.923725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:57.923725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:57.923725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:57.923725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:57.923725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:57.923725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:57.931917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 299/628] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:57.937711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26d45f-cb5d-44f9-8756-14699bf3683f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:57.937820 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 329/628] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:37:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:57.937820 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d181c5-8e18-413a-b4e5-4f934dd974f5 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:58.043248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26d45f-cb5d-44f9-8756-14699bf3683f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:58.043518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d181c5-8e18-413a-b4e5-4f934dd974f5 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:58.080345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3f7e5-0096-48c3-b818-34813ad19ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:58.080857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed56c6-fc84-4782-9746-1fa652202278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:58.081091 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3f7e5-0096-48c3-b818-34813ad19ede None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:58.081341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3f7e5-0096-48c3-b818-34813ad19ede None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:58.081617 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3f7e5-0096-48c3-b818-34813ad19ede None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:58.082378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3f7e5-0096-48c3-b818-34813ad19ede None admin] RBAC: Adding query filter params (name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:58.082671 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed56c6-fc84-4782-9746-1fa652202278 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:58.082772 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3f7e5-0096-48c3-b818-34813ad19ede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:58.084849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3f7e5-0096-48c3-b818-34813ad19ede None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:58.088873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed56c6-fc84-4782-9746-1fa652202278 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:58.089587 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed56c6-fc84-4782-9746-1fa652202278 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:58.093392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 330/629] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:37:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:58.094208 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3f7e5-0096-48c3-b818-34813ad19ede None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:58.099106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed56c6-fc84-4782-9746-1fa652202278 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:58.106797 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed56c6-fc84-4782-9746-1fa652202278 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-22ed56c6-fc84-4782-9746-1fa652202278 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:37:58.123531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:58.124511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:58.125516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:58.125516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:58.125516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:37:58.125516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:37:58.125516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:37:58.125516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:37:58.125516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:37:58.125516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:37:58.125516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 27 14:37:58.125516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:58.127208 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:58.129291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 300/630] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:37:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:58.130268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed56c6-fc84-4782-9746-1fa652202278 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:58.161017 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:58.206569 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3f7e5-0096-48c3-b818-34813ad19ede None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:58.240767 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed56c6-fc84-4782-9746-1fa652202278 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:58.243929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66ff9b-07ac-42fb-857a-3b45b0ee6adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:58.244486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66ff9b-07ac-42fb-857a-3b45b0ee6adc None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:58.244803 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66ff9b-07ac-42fb-857a-3b45b0ee6adc None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:58.245079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66ff9b-07ac-42fb-857a-3b45b0ee6adc None admin] PATH_INFO: `/v3/projects/af4d24603fa24a62946a57fabb774756/users/482c11dafd8541e28d50705f7651fd15/roles/81973b552fbc46a4ad31c60d8f099564` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:58.260304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66ff9b-07ac-42fb-857a-3b45b0ee6adc None admin] RBAC: Authorizing `identity:create_grant(project_id=af4d24603fa24a62946a57fabb774756, user_id=482c11dafd8541e28d50705f7651fd15, role_id=81973b552fbc46a4ad31c60d8f099564)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:58.261790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66ff9b-07ac-42fb-857a-3b45b0ee6adc None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:58.277337 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120bd05-1825-48a6-bc1f-04464ee0932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:58.278840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120bd05-1825-48a6-bc1f-04464ee0932a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:58.279126 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120bd05-1825-48a6-bc1f-04464ee0932a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:58.279400 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120bd05-1825-48a6-bc1f-04464ee0932a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:58.290740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120bd05-1825-48a6-bc1f-04464ee0932a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:58.292173 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120bd05-1825-48a6-bc1f-04464ee0932a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:58.310596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-7120bd05-1825-48a6-bc1f-04464ee0932a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:58.310596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:58.310596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:58.310596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:58.310596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:58.310596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:58.310596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:58.310596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:58.310596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:58.310596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:58.310596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:58.310596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:58.310596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:58.310596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:58.310596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:58.316065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:58.317176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:58.317176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:58.317176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:58.317176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:58.317176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 301/631] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:58.317176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120bd05-1825-48a6-bc1f-04464ee0932a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:58.336245 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 331/632] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:37:58 2022] PUT /identity/v3/projects/af4d24603fa24a62946a57fabb774756/users/482c11dafd8541e28d50705f7651fd15/roles/81973b552fbc46a4ad31c60d8f099564 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:37:58.338665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e2b0a-2806-48fe-a708-9ea07d5a1422 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:58.339322 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e2b0a-2806-48fe-a708-9ea07d5a1422 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:58.339700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e2b0a-2806-48fe-a708-9ea07d5a1422 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:58.342676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 332/633] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:58.343685 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e2b0a-2806-48fe-a708-9ea07d5a1422 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:58.407220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:58.434272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120bd05-1825-48a6-bc1f-04464ee0932a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:58.442302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:58.467642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e2b0a-2806-48fe-a708-9ea07d5a1422 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:58.474989 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0490d3-c158-4e11-9e97-89bbe56c27ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:58.475668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0490d3-c158-4e11-9e97-89bbe56c27ff None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:58.475947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0490d3-c158-4e11-9e97-89bbe56c27ff None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:58.476223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0490d3-c158-4e11-9e97-89bbe56c27ff None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:58.477152 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0490d3-c158-4e11-9e97-89bbe56c27ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:58.477459 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0490d3-c158-4e11-9e97-89bbe56c27ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:58.478921 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0490d3-c158-4e11-9e97-89bbe56c27ff None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:58.499014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 302/634] 10.222.0.44 () {56 vars in 1137 bytes} [Mon Jun 27 14:37:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:58.501983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074d7aa-b0ef-49ca-8134-dad0f35d8ecb None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:58.503968 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074d7aa-b0ef-49ca-8134-dad0f35d8ecb None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:58.503968 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074d7aa-b0ef-49ca-8134-dad0f35d8ecb None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:58.503968 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 303/635] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:37:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:37:58.504895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a56d05-d7ba-434e-b422-3bb9913112c3 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:58.505177 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a56d05-d7ba-434e-b422-3bb9913112c3 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:58.505454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a56d05-d7ba-434e-b422-3bb9913112c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:58.512912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9929f-4414-444f-a9c6-1d556e678442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:58.513593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9929f-4414-444f-a9c6-1d556e678442 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:58.514765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9929f-4414-444f-a9c6-1d556e678442 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:58.515078 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9929f-4414-444f-a9c6-1d556e678442 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:58.515800 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9929f-4414-444f-a9c6-1d556e678442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:58.516111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9929f-4414-444f-a9c6-1d556e678442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:58.517560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9929f-4414-444f-a9c6-1d556e678442 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:58.525780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-51a56d05-d7ba-434e-b422-3bb9913112c3 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:58.526976 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-51a56d05-d7ba-434e-b422-3bb9913112c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:58.532675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 333/636] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:58.533714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9929f-4414-444f-a9c6-1d556e678442 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:58.598895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 304/637] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:58.600458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be09f8b-04fe-44de-beb9-30d32324fb25 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:58.600783 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be09f8b-04fe-44de-beb9-30d32324fb25 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:58.601065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be09f8b-04fe-44de-beb9-30d32324fb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:58.620902 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-6be09f8b-04fe-44de-beb9-30d32324fb25 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:37:58.622999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6be09f8b-04fe-44de-beb9-30d32324fb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:37:58.650364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9929f-4414-444f-a9c6-1d556e678442 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:58.683537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:58.688156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e094b8f-87b2-47ae-8e34-49d8eea8dadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:58.689057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e094b8f-87b2-47ae-8e34-49d8eea8dadf None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:58.689514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e094b8f-87b2-47ae-8e34-49d8eea8dadf None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:58.689972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e094b8f-87b2-47ae-8e34-49d8eea8dadf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:58.692277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 305/638] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:37:58.693188 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be09f8b-04fe-44de-beb9-30d32324fb25 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:58.708818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:58.774480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e094b8f-87b2-47ae-8e34-49d8eea8dadf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:58.775918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e094b8f-87b2-47ae-8e34-49d8eea8dadf None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:58.808720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be09f8b-04fe-44de-beb9-30d32324fb25 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:58.843736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36673c48-5db2-45ee-b69b-f29f1aac003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:58.844529 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36673c48-5db2-45ee-b69b-f29f1aac003b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:58.844855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36673c48-5db2-45ee-b69b-f29f1aac003b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:58.845140 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36673c48-5db2-45ee-b69b-f29f1aac003b None admin] PATH_INFO: `/v3/users/nova` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:58.852343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36673c48-5db2-45ee-b69b-f29f1aac003b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:58.853738 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36673c48-5db2-45ee-b69b-f29f1aac003b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-36673c48-5db2-45ee-b69b-f29f1aac003b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:37:58.869114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:58.875754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:58.876934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:58.876934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:58.876934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:37:58.876934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:37:58.876934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:37:58.876934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:37:58.876934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:37:58.876934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:37:58.876934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:37:58.876934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:58.876934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 306/639] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Jun 27 14:37:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:58.876934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36673c48-5db2-45ee-b69b-f29f1aac003b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:58.898293 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 334/640] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:58.899380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e094b8f-87b2-47ae-8e34-49d8eea8dadf None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:58.930934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:58.944062 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:58.978052 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36673c48-5db2-45ee-b69b-f29f1aac003b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:59.006363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e094b8f-87b2-47ae-8e34-49d8eea8dadf None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:59.012901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099006a-f4b4-4ecd-b438-530aa22018b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:59.013698 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099006a-f4b4-4ecd-b438-530aa22018b0 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:59.013986 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099006a-f4b4-4ecd-b438-530aa22018b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:59.014261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099006a-f4b4-4ecd-b438-530aa22018b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:59.025381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099006a-f4b4-4ecd-b438-530aa22018b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-0099006a-f4b4-4ecd-b438-530aa22018b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:59.033683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:59.034846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:59.035917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:59.035917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:59.035917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:59.035917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:59.035917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:59.035917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:59.035917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:59.035917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:59.035917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:59.035917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:59.035917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:59.035917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:59.039677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 307/641] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:59.040531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099006a-f4b4-4ecd-b438-530aa22018b0 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:59.046583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87955856-0069-47ed-97a5-985b54f6a913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:59.047381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87955856-0069-47ed-97a5-985b54f6a913 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:59.047665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87955856-0069-47ed-97a5-985b54f6a913 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:59.047947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87955856-0069-47ed-97a5-985b54f6a913 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:59.059172 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87955856-0069-47ed-97a5-985b54f6a913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-87955856-0069-47ed-97a5-985b54f6a913 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:37:59.067120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:59.068107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:59.069343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:59.069343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:59.069343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:59.069343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:59.069343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:37:59.069343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:37:59.069343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:37:59.069343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:37:59.069343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:37:59.069343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:37:59.069343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:37:59.069343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:59.069343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 335/642] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:37:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:59.069343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87955856-0069-47ed-97a5-985b54f6a913 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:59.154136 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099006a-f4b4-4ecd-b438-530aa22018b0 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:59.169487 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:59.178653 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:59.182935 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87955856-0069-47ed-97a5-985b54f6a913 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:59.190220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91138536-6eb7-4a6b-9de6-21ad546ce09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:59.191038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91138536-6eb7-4a6b-9de6-21ad546ce09f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:59.191373 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91138536-6eb7-4a6b-9de6-21ad546ce09f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:59.191649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91138536-6eb7-4a6b-9de6-21ad546ce09f None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:59.192544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91138536-6eb7-4a6b-9de6-21ad546ce09f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:59.192885 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91138536-6eb7-4a6b-9de6-21ad546ce09f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:59.194304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91138536-6eb7-4a6b-9de6-21ad546ce09f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:59.213867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 308/643] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Jun 27 14:37:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:59.214927 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91138536-6eb7-4a6b-9de6-21ad546ce09f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:59.221113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305a025-41c1-4e2a-8eb9-6c3873da40ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:59.221912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305a025-41c1-4e2a-8eb9-6c3873da40ea None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:59.222197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305a025-41c1-4e2a-8eb9-6c3873da40ea None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:59.222474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305a025-41c1-4e2a-8eb9-6c3873da40ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:59.235486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305a025-41c1-4e2a-8eb9-6c3873da40ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:59.236965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305a025-41c1-4e2a-8eb9-6c3873da40ea None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:59.255047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-7305a025-41c1-4e2a-8eb9-6c3873da40ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:59.255047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:59.255047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:59.255047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:59.255047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:59.255047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:59.255047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:59.255047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:59.255047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:59.255047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:59.255047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:59.255047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:59.255047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:59.255047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:59.255047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:59.255939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:59.261607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:59.261607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:59.261607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:59.261607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:59.261607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 336/644] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:59.261607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305a025-41c1-4e2a-8eb9-6c3873da40ea None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:59.326466 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91138536-6eb7-4a6b-9de6-21ad546ce09f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:59.359960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21050e52-f28d-432f-9d4b-848a4e5d4db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:59.360544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21050e52-f28d-432f-9d4b-848a4e5d4db8 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:59.360853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21050e52-f28d-432f-9d4b-848a4e5d4db8 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:59.361132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21050e52-f28d-432f-9d4b-848a4e5d4db8 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:59.361870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21050e52-f28d-432f-9d4b-848a4e5d4db8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:59.362173 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21050e52-f28d-432f-9d4b-848a4e5d4db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:59.363532 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21050e52-f28d-432f-9d4b-848a4e5d4db8 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:59.366629 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305a025-41c1-4e2a-8eb9-6c3873da40ea None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:59.371392 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 309/645] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:37:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:59.372826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21050e52-f28d-432f-9d4b-848a4e5d4db8 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:59.407342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e11002-2c06-40d2-bc1e-4f36517d4a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:59.408001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11002-2c06-40d2-bc1e-4f36517d4a2c None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:59.408284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11002-2c06-40d2-bc1e-4f36517d4a2c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:59.408597 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11002-2c06-40d2-bc1e-4f36517d4a2c None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:59.409323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e11002-2c06-40d2-bc1e-4f36517d4a2c None admin] RBAC: Adding query filter params (name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:59.409626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e11002-2c06-40d2-bc1e-4f36517d4a2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:59.411132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e11002-2c06-40d2-bc1e-4f36517d4a2c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:59.414414 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:59.419367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 337/646] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:37:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:59.420109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e11002-2c06-40d2-bc1e-4f36517d4a2c None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:59.443370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:59.499665 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21050e52-f28d-432f-9d4b-848a4e5d4db8 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:59.537826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e337731-5cc9-4b8e-a248-58043bedba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:59.538472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e337731-5cc9-4b8e-a248-58043bedba2a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:59.538758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e337731-5cc9-4b8e-a248-58043bedba2a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:59.539034 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e337731-5cc9-4b8e-a248-58043bedba2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:59.540180 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e11002-2c06-40d2-bc1e-4f36517d4a2c None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:59.577641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a23c2e-52f5-4f60-8a89-a5adcf9fe509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:59.578297 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a23c2e-52f5-4f60-8a89-a5adcf9fe509 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:59.578576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a23c2e-52f5-4f60-8a89-a5adcf9fe509 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:59.578850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a23c2e-52f5-4f60-8a89-a5adcf9fe509 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:59.579562 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a23c2e-52f5-4f60-8a89-a5adcf9fe509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:37:59.579867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a23c2e-52f5-4f60-8a89-a5adcf9fe509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:59.581254 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a23c2e-52f5-4f60-8a89-a5adcf9fe509 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:59.594016 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 338/647] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:37:59.594775 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a23c2e-52f5-4f60-8a89-a5adcf9fe509 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:59.620832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e337731-5cc9-4b8e-a248-58043bedba2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:59.622883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e337731-5cc9-4b8e-a248-58043bedba2a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:59.660404 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:59.669623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:59.699136 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a23c2e-52f5-4f60-8a89-a5adcf9fe509 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:59.732767 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9623f7-293c-40b8-9377-1a8135ebd923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:59.732767 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9623f7-293c-40b8-9377-1a8135ebd923 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:59.732767 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9623f7-293c-40b8-9377-1a8135ebd923 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:59.733120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9623f7-293c-40b8-9377-1a8135ebd923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:59.733566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 310/648] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:37:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:37:59.734577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e337731-5cc9-4b8e-a248-58043bedba2a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:59.743338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9623f7-293c-40b8-9377-1a8135ebd923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:59.744912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9623f7-293c-40b8-9377-1a8135ebd923 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:59.762639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-8d9623f7-293c-40b8-9377-1a8135ebd923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:59.762639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:59.762639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:59.762639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:59.762639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:59.762639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:59.762639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:59.762639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:59.762639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:59.762639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:59.762639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:59.762639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:59.762639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:59.762639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:59.762639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:59.763646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:59.764621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:59.764621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:59.764621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:59.764621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:59.764621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 339/649] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:59.765723 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9623f7-293c-40b8-9377-1a8135ebd923 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:59.841654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e337731-5cc9-4b8e-a248-58043bedba2a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:59.869656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9623f7-293c-40b8-9377-1a8135ebd923 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:37:59.874528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb018f-daed-4245-8e91-9b32b54ad73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:59.875591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb018f-daed-4245-8e91-9b32b54ad73d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:59.876077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb018f-daed-4245-8e91-9b32b54ad73d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:59.876548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb018f-daed-4245-8e91-9b32b54ad73d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:59.887906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb018f-daed-4245-8e91-9b32b54ad73d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:59.889378 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb018f-daed-4245-8e91-9b32b54ad73d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:59.905744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccb10f-1a5b-4acc-a38b-7d3030145327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:37:59.906534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccb10f-1a5b-4acc-a38b-7d3030145327 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:37:59.906845 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccb10f-1a5b-4acc-a38b-7d3030145327 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:37:59.907123 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccb10f-1a5b-4acc-a38b-7d3030145327 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:37:59.907896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-61cb018f-daed-4245-8e91-9b32b54ad73d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:59.907896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:59.907896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:59.907896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:59.907896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:59.907896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:59.907896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:59.907896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:59.907896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:59.907896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:59.907896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:59.907896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:59.907896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:37:59.907896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:37:59.907896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:59.908969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:59.910084 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:37:59.910084 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:37:59.910084 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:37:59.910084 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:37:59.912612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:37:59.914623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccb10f-1a5b-4acc-a38b-7d3030145327 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:37:59.916054 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccb10f-1a5b-4acc-a38b-7d3030145327 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:37:59.917326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 311/650] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:59.925512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb018f-daed-4245-8e91-9b32b54ad73d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:59.930328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-18ccb10f-1a5b-4acc-a38b-7d3030145327 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:59.930328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:37:59.930328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:37:59.930328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:37:59.930328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:37:59.930328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:37:59.930328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:37:59.930328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:37:59.930328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:37:59.930328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:37:59.930328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:37:59.930328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:37:59.930328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:37:59.930328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:37:59.930328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:37:59.931301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:37:59.932236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:37:59.932236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:37:59.932236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:37:59.932236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:37:59.932236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:37:59.932236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:37:59.932236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:37:59.932236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:37:59.936278 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 340/651] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:37:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:37:59.937161 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccb10f-1a5b-4acc-a38b-7d3030145327 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:37:59.944933 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:00.024468 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb018f-daed-4245-8e91-9b32b54ad73d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:00.044002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccb10f-1a5b-4acc-a38b-7d3030145327 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:00.058788 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da412e-3693-4fff-b82a-4fa4dbae222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:00.059725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da412e-3693-4fff-b82a-4fa4dbae222e None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:00.060005 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da412e-3693-4fff-b82a-4fa4dbae222e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:00.060309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da412e-3693-4fff-b82a-4fa4dbae222e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:00.070709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da412e-3693-4fff-b82a-4fa4dbae222e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:00.072163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da412e-3693-4fff-b82a-4fa4dbae222e None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:00.078630 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748e232-007b-453a-8df6-741ca1d67726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:00.079363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748e232-007b-453a-8df6-741ca1d67726 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:00.079722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748e232-007b-453a-8df6-741ca1d67726 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:00.080064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748e232-007b-453a-8df6-741ca1d67726 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:00.080882 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748e232-007b-453a-8df6-741ca1d67726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:00.081262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748e232-007b-453a-8df6-741ca1d67726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:00.082609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748e232-007b-453a-8df6-741ca1d67726 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:00.090768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-92da412e-3693-4fff-b82a-4fa4dbae222e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:00.090768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:00.090768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:00.090768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:00.090768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:00.090768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:00.090768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:00.090768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:00.090768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:00.090768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:00.090768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:00.090768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:00.090768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:00.090768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:00.090768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:00.091824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:00.097460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:00.097460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:00.097460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:00.097460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:00.097460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 312/652] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:00.097460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da412e-3693-4fff-b82a-4fa4dbae222e None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:00.107126 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 341/653] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:00.108016 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748e232-007b-453a-8df6-741ca1d67726 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:00.145365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:00.154661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:00.209003 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748e232-007b-453a-8df6-741ca1d67726 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:00.210290 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da412e-3693-4fff-b82a-4fa4dbae222e None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:00.247348 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f937fad-e573-4e9a-a7a1-f7b4ba04bdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:00.247615 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86b2f8-adde-4b35-979d-223733f0b530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:00.248004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f937fad-e573-4e9a-a7a1-f7b4ba04bdaf None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:00.248285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f937fad-e573-4e9a-a7a1-f7b4ba04bdaf None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:00.248554 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f937fad-e573-4e9a-a7a1-f7b4ba04bdaf None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:00.248674 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86b2f8-adde-4b35-979d-223733f0b530 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:00.249089 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86b2f8-adde-4b35-979d-223733f0b530 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:00.249306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f937fad-e573-4e9a-a7a1-f7b4ba04bdaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:00.249609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f937fad-e573-4e9a-a7a1-f7b4ba04bdaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:00.249937 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86b2f8-adde-4b35-979d-223733f0b530 None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:00.250958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f937fad-e573-4e9a-a7a1-f7b4ba04bdaf None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:00.251708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86b2f8-adde-4b35-979d-223733f0b530 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:00.252433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86b2f8-adde-4b35-979d-223733f0b530 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:00.255303 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86b2f8-adde-4b35-979d-223733f0b530 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:00.264070 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 313/654] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:00.264864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f937fad-e573-4e9a-a7a1-f7b4ba04bdaf None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:00.278904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 342/655] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:00.278904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86b2f8-adde-4b35-979d-223733f0b530 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:00.380037 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86b2f8-adde-4b35-979d-223733f0b530 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:00.383208 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:00.384195 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:00.387784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f937fad-e573-4e9a-a7a1-f7b4ba04bdaf None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:00.416469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd769a90-85d0-4943-8697-77e9791c6060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:00.417332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd769a90-85d0-4943-8697-77e9791c6060 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:00.417796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd769a90-85d0-4943-8697-77e9791c6060 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:00.418342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd769a90-85d0-4943-8697-77e9791c6060 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:00.422796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fd7aa-f6bc-4701-b9d5-c0baa73293a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:00.423500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fd7aa-f6bc-4701-b9d5-c0baa73293a2 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:00.423779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fd7aa-f6bc-4701-b9d5-c0baa73293a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:00.424050 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fd7aa-f6bc-4701-b9d5-c0baa73293a2 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:00.425042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fd7aa-f6bc-4701-b9d5-c0baa73293a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:00.425164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fd7aa-f6bc-4701-b9d5-c0baa73293a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:00.426476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fd7aa-f6bc-4701-b9d5-c0baa73293a2 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:00.426855 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd769a90-85d0-4943-8697-77e9791c6060 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:00.428766 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd769a90-85d0-4943-8697-77e9791c6060 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:00.438143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 314/656] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:00.438951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fd7aa-f6bc-4701-b9d5-c0baa73293a2 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-cd769a90-85d0-4943-8697-77e9791c6060 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:00.444248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:00.445413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:00.446699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:00.446699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:00.446699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:00.446699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:00.446699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:00.446699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:00.446699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:00.446699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:00.446699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 14:38:00.446699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:00.446699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 343/657] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:38:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:00.446699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd769a90-85d0-4943-8697-77e9791c6060 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:00.540779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fd7aa-f6bc-4701-b9d5-c0baa73293a2 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:00.549836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd769a90-85d0-4943-8697-77e9791c6060 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:00.573489 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9383d-f034-44b5-a28d-77fc0680d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:00.574620 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9383d-f034-44b5-a28d-77fc0680d245 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:00.575495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9383d-f034-44b5-a28d-77fc0680d245 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:00.575856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9383d-f034-44b5-a28d-77fc0680d245 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:00.583250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9383d-f034-44b5-a28d-77fc0680d245 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:00.583382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f703e69-6702-44a3-81c0-dce4ea898f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:00.583922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f703e69-6702-44a3-81c0-dce4ea898f2c None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:00.584204 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f703e69-6702-44a3-81c0-dce4ea898f2c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:00.584479 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f703e69-6702-44a3-81c0-dce4ea898f2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:00.584703 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9383d-f034-44b5-a28d-77fc0680d245 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:00.585342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f703e69-6702-44a3-81c0-dce4ea898f2c None admin] RBAC: Adding query filter params (role.id=81973b552fbc46a4ad31c60d8f099564, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=6e93d0321eaa4936a55390155d5aab0a) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:00.585649 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f703e69-6702-44a3-81c0-dce4ea898f2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:00.587042 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f703e69-6702-44a3-81c0-dce4ea898f2c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:00.592816 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 344/658] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:00 2022] GET /identity/v3/role_assignments?user.id=6e93d0321eaa4936a55390155d5aab0a&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=81973b552fbc46a4ad31c60d8f099564 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:00.594020 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac387-1839-455b-95a3-2876a17ca866 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:00.594303 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac387-1839-455b-95a3-2876a17ca866 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:00.594576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac387-1839-455b-95a3-2876a17ca866 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:00.595956 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 345/659] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:00.596464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeac387-1839-455b-95a3-2876a17ca866 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-e4e9383d-f034-44b5-a28d-77fc0680d245 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:00.599781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:00.600817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:00.601825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:00.601825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:00.601825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:00.601825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:00.601825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:00.601825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:00.601825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:00.601825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:00.601825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 14:38:00.601825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:00.601825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 315/660] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:38:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:00.602474 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9383d-f034-44b5-a28d-77fc0680d245 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:00.628096 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:00.639033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:00.725707 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9383d-f034-44b5-a28d-77fc0680d245 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:00.731948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeac387-1839-455b-95a3-2876a17ca866 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:00.766271 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8676a-ae41-420f-9236-3723738d9080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:00.767157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8676a-ae41-420f-9236-3723738d9080 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:00.767276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8676a-ae41-420f-9236-3723738d9080 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:00.767552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8676a-ae41-420f-9236-3723738d9080 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:00.768403 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8676a-ae41-420f-9236-3723738d9080 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:00.768749 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8676a-ae41-420f-9236-3723738d9080 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:00.770229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8676a-ae41-420f-9236-3723738d9080 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:00.774530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04552cd-af38-4147-af79-c6db774e4596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:00.775535 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04552cd-af38-4147-af79-c6db774e4596 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:00.775997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04552cd-af38-4147-af79-c6db774e4596 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:00.776989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04552cd-af38-4147-af79-c6db774e4596 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:00.786578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04552cd-af38-4147-af79-c6db774e4596 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:00.788070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04552cd-af38-4147-af79-c6db774e4596 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:00.789961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 316/661] 10.222.0.44 () {56 vars in 1139 bytes} [Mon Jun 27 14:38:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:00.791233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f0ed9-2ef3-4f1b-a4de-c3e9627f8a17 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:00.791527 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f0ed9-2ef3-4f1b-a4de-c3e9627f8a17 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:00.791808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f0ed9-2ef3-4f1b-a4de-c3e9627f8a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:00.802906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-b04552cd-af38-4147-af79-c6db774e4596 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:00.802906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:00.802906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:00.802906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:00.802906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:00.802906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:00.802906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:00.802906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:00.802906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:00.802906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:00.802906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:00.802906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:00.802906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:00.802906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:00.802906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:00.803990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:00.805010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:00.805010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:00.805010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:00.805010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:00.805010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:00.805010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:00.805010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:00.805010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:00.805010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 346/662] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:00.805010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04552cd-af38-4147-af79-c6db774e4596 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:00.813077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-650f0ed9-2ef3-4f1b-a4de-c3e9627f8a17 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:00.814280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-650f0ed9-2ef3-4f1b-a4de-c3e9627f8a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:00.891277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 317/663] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:38:00.892121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f0ed9-2ef3-4f1b-a4de-c3e9627f8a17 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:00.906958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:00.913088 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:00.925884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04552cd-af38-4147-af79-c6db774e4596 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:00.962652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263e9fc-1231-4774-bd7a-225fd6552968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:00.963326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263e9fc-1231-4774-bd7a-225fd6552968 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:00.963620 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263e9fc-1231-4774-bd7a-225fd6552968 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:00.963885 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263e9fc-1231-4774-bd7a-225fd6552968 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:00.964753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263e9fc-1231-4774-bd7a-225fd6552968 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:00.965202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263e9fc-1231-4774-bd7a-225fd6552968 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:00.967402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263e9fc-1231-4774-bd7a-225fd6552968 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:00.992789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 347/664] 10.222.0.44 () {56 vars in 1137 bytes} [Mon Jun 27 14:38:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:00.992789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263e9fc-1231-4774-bd7a-225fd6552968 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:01.009142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f0ed9-2ef3-4f1b-a4de-c3e9627f8a17 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:01.050358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e21711-55a6-42ef-8f6e-398c95f8a5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:01.051055 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e21711-55a6-42ef-8f6e-398c95f8a5c4 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:01.051274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e21711-55a6-42ef-8f6e-398c95f8a5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:01.051547 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e21711-55a6-42ef-8f6e-398c95f8a5c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:01.103077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263e9fc-1231-4774-bd7a-225fd6552968 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:01.131914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e21711-55a6-42ef-8f6e-398c95f8a5c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:01.133772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e21711-55a6-42ef-8f6e-398c95f8a5c4 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:01.140570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84606b9-0e00-4bb3-a33a-cfcc00428d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:01.141338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84606b9-0e00-4bb3-a33a-cfcc00428d96 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:01.141688 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84606b9-0e00-4bb3-a33a-cfcc00428d96 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:01.142050 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84606b9-0e00-4bb3-a33a-cfcc00428d96 None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:01.142797 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:01.142913 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84606b9-0e00-4bb3-a33a-cfcc00428d96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:01.143302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84606b9-0e00-4bb3-a33a-cfcc00428d96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:01.144800 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84606b9-0e00-4bb3-a33a-cfcc00428d96 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:01.157409 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 348/665] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:01.158213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84606b9-0e00-4bb3-a33a-cfcc00428d96 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:01.169610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:01.247748 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 318/666] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:38:01.248925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e21711-55a6-42ef-8f6e-398c95f8a5c4 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:01.269838 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84606b9-0e00-4bb3-a33a-cfcc00428d96 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:01.305758 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d336eb0-a7c6-4799-8b5a-f9eb82c52d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:01.306974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d336eb0-a7c6-4799-8b5a-f9eb82c52d11 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:01.307256 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d336eb0-a7c6-4799-8b5a-f9eb82c52d11 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:01.307801 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d336eb0-a7c6-4799-8b5a-f9eb82c52d11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:01.321683 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d336eb0-a7c6-4799-8b5a-f9eb82c52d11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-7d336eb0-a7c6-4799-8b5a-f9eb82c52d11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:01.331693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:01.332682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:01.333557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:01.333557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:01.333557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:01.333557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:01.333557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:01.333557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:01.333557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:01.333557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:01.333557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:01.333557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:01.333557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:38:01.333557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:01.334893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 349/667] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:38:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:01.335790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d336eb0-a7c6-4799-8b5a-f9eb82c52d11 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:01.358196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e21711-55a6-42ef-8f6e-398c95f8a5c4 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:01.366937 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:01.394654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef4f57-ee22-43a7-bc40-11beac2a0a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:01.395324 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef4f57-ee22-43a7-bc40-11beac2a0a60 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:01.395604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef4f57-ee22-43a7-bc40-11beac2a0a60 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:01.395885 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef4f57-ee22-43a7-bc40-11beac2a0a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:01.406652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:01.446951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d336eb0-a7c6-4799-8b5a-f9eb82c52d11 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:01.468884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef4f57-ee22-43a7-bc40-11beac2a0a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:01.470368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef4f57-ee22-43a7-bc40-11beac2a0a60 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:01.483910 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5630a7b-777c-454a-aad9-0177e17a0f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:01.484818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5630a7b-777c-454a-aad9-0177e17a0f27 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:01.485100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5630a7b-777c-454a-aad9-0177e17a0f27 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:01.485374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5630a7b-777c-454a-aad9-0177e17a0f27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:01.486258 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5630a7b-777c-454a-aad9-0177e17a0f27 None admin] RBAC: Adding query filter params (role.id=81973b552fbc46a4ad31c60d8f099564, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=08529776af224c36ab560c13f5941e0a) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:01.486574 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5630a7b-777c-454a-aad9-0177e17a0f27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:01.488010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5630a7b-777c-454a-aad9-0177e17a0f27 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:01.494059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 350/668] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:01 2022] GET /identity/v3/role_assignments?user.id=08529776af224c36ab560c13f5941e0a&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=81973b552fbc46a4ad31c60d8f099564 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:01.494648 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5630a7b-777c-454a-aad9-0177e17a0f27 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:01.614345 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 319/669] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:38:01.614345 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef4f57-ee22-43a7-bc40-11beac2a0a60 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:01.621305 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:01.632178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5630a7b-777c-454a-aad9-0177e17a0f27 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:01.671622 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:01.676994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf598fa-483e-41a5-9fea-34c140dabcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:01.677791 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf598fa-483e-41a5-9fea-34c140dabcf3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:01.678125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf598fa-483e-41a5-9fea-34c140dabcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:01.678383 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf598fa-483e-41a5-9fea-34c140dabcf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:01.694924 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf598fa-483e-41a5-9fea-34c140dabcf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:01.697738 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf598fa-483e-41a5-9fea-34c140dabcf3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:01.722612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-6bf598fa-483e-41a5-9fea-34c140dabcf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:01.722612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:01.722612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:01.722612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:01.722612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:01.722612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:01.722612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:01.722612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:01.722612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:01.722612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:01.722612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:01.722612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:01.722612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:01.722612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:01.722612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:01.723584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:01.724487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:01.724487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:01.724487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:01.724487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:01.724760 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 351/670] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:01.726360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf598fa-483e-41a5-9fea-34c140dabcf3 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:01.749478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef4f57-ee22-43a7-bc40-11beac2a0a60 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:01.789382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a5719-215b-431e-8654-b122bb571fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:01.790411 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a5719-215b-431e-8654-b122bb571fdb None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:01.790852 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a5719-215b-431e-8654-b122bb571fdb None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:01.791848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a5719-215b-431e-8654-b122bb571fdb None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:01.793195 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a5719-215b-431e-8654-b122bb571fdb None admin] RBAC: Adding query filter params (name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:01.793718 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a5719-215b-431e-8654-b122bb571fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:01.795913 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a5719-215b-431e-8654-b122bb571fdb None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:01.806545 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 320/671] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:38:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:01.807622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a5719-215b-431e-8654-b122bb571fdb None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:01.850844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf598fa-483e-41a5-9fea-34c140dabcf3 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:01.893306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27d844-ed18-43fc-ad83-19ef87b8c769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:01.893732 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:01.894853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27d844-ed18-43fc-ad83-19ef87b8c769 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:01.895243 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27d844-ed18-43fc-ad83-19ef87b8c769 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:01.895621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27d844-ed18-43fc-ad83-19ef87b8c769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:01.913697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27d844-ed18-43fc-ad83-19ef87b8c769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:01.915568 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27d844-ed18-43fc-ad83-19ef87b8c769 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:01.936846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a5719-215b-431e-8654-b122bb571fdb None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:01.941909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-bd27d844-ed18-43fc-ad83-19ef87b8c769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:01.941909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:01.941909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:01.941909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:01.941909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:01.941909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:01.941909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:01.941909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:01.941909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:01.941909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:01.941909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:01.941909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:01.941909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:01.941909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:01.941909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:01.942997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:01.944156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:01.944156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:01.944156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:01.944156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:01.950150 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 352/672] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:01.950150 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27d844-ed18-43fc-ad83-19ef87b8c769 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:01.990963 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:01.992076 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aa49e-c253-42f2-9e27-55fb85a9d70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:01.993120 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aa49e-c253-42f2-9e27-55fb85a9d70d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:01.993319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aa49e-c253-42f2-9e27-55fb85a9d70d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:01.993679 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aa49e-c253-42f2-9e27-55fb85a9d70d None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:01.994507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1aa49e-c253-42f2-9e27-55fb85a9d70d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:01.994928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1aa49e-c253-42f2-9e27-55fb85a9d70d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:01.997011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1aa49e-c253-42f2-9e27-55fb85a9d70d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:02.014620 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 321/673] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:02.015624 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aa49e-c253-42f2-9e27-55fb85a9d70d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:02.064044 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27d844-ed18-43fc-ad83-19ef87b8c769 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:02.102802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70e73e-9a0b-4909-bdf8-82e8a18843ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:02.103998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e73e-9a0b-4909-bdf8-82e8a18843ba None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:02.104428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e73e-9a0b-4909-bdf8-82e8a18843ba None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:02.104896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e73e-9a0b-4909-bdf8-82e8a18843ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:02.117778 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70e73e-9a0b-4909-bdf8-82e8a18843ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:02.119462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70e73e-9a0b-4909-bdf8-82e8a18843ba None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:02.124085 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aa49e-c253-42f2-9e27-55fb85a9d70d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:02.140142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-ef70e73e-9a0b-4909-bdf8-82e8a18843ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:02.140142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:02.140142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:02.140142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:02.140142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:02.140142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:02.140142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:02.140142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:02.140142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:02.140142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:02.140142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:02.140142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:02.140142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:02.140142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:02.140142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:02.141298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:02.142428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:02.142428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:02.142428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:02.142428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:02.144387 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 353/674] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:02.145455 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70e73e-9a0b-4909-bdf8-82e8a18843ba None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:02.156112 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:02.164751 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d09ad-b193-4670-a4d8-e1027b5e6804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:02.165527 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d09ad-b193-4670-a4d8-e1027b5e6804 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:02.174059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d09ad-b193-4670-a4d8-e1027b5e6804 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:02.174059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d09ad-b193-4670-a4d8-e1027b5e6804 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:02.174059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d09ad-b193-4670-a4d8-e1027b5e6804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:02.174059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d09ad-b193-4670-a4d8-e1027b5e6804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:02.174059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d09ad-b193-4670-a4d8-e1027b5e6804 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:02.187983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 322/675] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:02.187983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d09ad-b193-4670-a4d8-e1027b5e6804 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:02.248785 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:02.265208 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70e73e-9a0b-4909-bdf8-82e8a18843ba None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:02.293997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d09ad-b193-4670-a4d8-e1027b5e6804 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:02.302916 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f78b58-a733-4888-96de-813eaff33255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:02.304000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f78b58-a733-4888-96de-813eaff33255 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:02.304485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f78b58-a733-4888-96de-813eaff33255 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:02.304958 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f78b58-a733-4888-96de-813eaff33255 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:02.313286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f78b58-a733-4888-96de-813eaff33255 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:02.314898 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f78b58-a733-4888-96de-813eaff33255 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:02.330309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-06f78b58-a733-4888-96de-813eaff33255 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:02.330309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:02.330309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:02.330309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:02.330309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:02.330309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:02.330309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:02.330309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:02.330309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:02.330309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:02.330309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:02.330309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:02.330309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:02.330309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:02.330309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:02.331486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:02.332596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:02.332596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:02.332596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:02.332596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:02.332596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:02.332596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:02.332596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:02.332596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:02.333169 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535f964-c51b-4b22-b117-f18f95671815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:02.333863 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535f964-c51b-4b22-b117-f18f95671815 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:02.334246 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535f964-c51b-4b22-b117-f18f95671815 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:02.334621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535f964-c51b-4b22-b117-f18f95671815 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:02.335444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 354/676] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:02.336461 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f78b58-a733-4888-96de-813eaff33255 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:02.339993 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535f964-c51b-4b22-b117-f18f95671815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:02.341504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535f964-c51b-4b22-b117-f18f95671815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:02.342363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535f964-c51b-4b22-b117-f18f95671815 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:02.356822 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 323/677] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:02.357972 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535f964-c51b-4b22-b117-f18f95671815 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:02.410994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:02.449264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f78b58-a733-4888-96de-813eaff33255 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:02.467466 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535f964-c51b-4b22-b117-f18f95671815 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:02.487436 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afca16b-4b4f-4ead-ab73-f4a275f17333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:02.488425 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afca16b-4b4f-4ead-ab73-f4a275f17333 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:02.488900 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afca16b-4b4f-4ead-ab73-f4a275f17333 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:02.489447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afca16b-4b4f-4ead-ab73-f4a275f17333 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:02.497588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afca16b-4b4f-4ead-ab73-f4a275f17333 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:02.499307 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afca16b-4b4f-4ead-ab73-f4a275f17333 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:02.504494 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085a76d-545f-400b-982a-068b4b9e0bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:02.505287 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085a76d-545f-400b-982a-068b4b9e0bdb None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:02.505679 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085a76d-545f-400b-982a-068b4b9e0bdb None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:02.506065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085a76d-545f-400b-982a-068b4b9e0bdb None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:02.506956 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085a76d-545f-400b-982a-068b4b9e0bdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:02.507371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085a76d-545f-400b-982a-068b4b9e0bdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:02.508939 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085a76d-545f-400b-982a-068b4b9e0bdb None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:02.516200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-6afca16b-4b4f-4ead-ab73-f4a275f17333 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:02.516200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:02.516200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:02.516200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:02.516200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:02.516200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:02.516200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:02.516200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:02.516200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:02.516200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:02.516200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:02.516200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:02.516200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:02.516200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:02.516200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:02.517169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:02.518097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:02.518097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:02.518097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:02.518097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:02.518097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:02.518097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:02.518097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:02.518097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:02.524503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 324/678] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:02.525110 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 355/679] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:02.526097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afca16b-4b4f-4ead-ab73-f4a275f17333 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:02.530700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085a76d-545f-400b-982a-068b4b9e0bdb None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:02.535756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:02.636071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afca16b-4b4f-4ead-ab73-f4a275f17333 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:02.639155 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085a76d-545f-400b-982a-068b4b9e0bdb None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:02.648868 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:02.673784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3e93e-3ee6-4f4f-a51f-0b7b5da2ba8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:02.674361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3e93e-3ee6-4f4f-a51f-0b7b5da2ba8a None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:02.674648 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3e93e-3ee6-4f4f-a51f-0b7b5da2ba8a None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:02.674925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3e93e-3ee6-4f4f-a51f-0b7b5da2ba8a None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:02.675717 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3e93e-3ee6-4f4f-a51f-0b7b5da2ba8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:02.676030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3e93e-3ee6-4f4f-a51f-0b7b5da2ba8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:02.677965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3e93e-3ee6-4f4f-a51f-0b7b5da2ba8a None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:02.678297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2b86d-0fe1-4f1d-8f74-aa3f981d3bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:02.679456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2b86d-0fe1-4f1d-8f74-aa3f981d3bb8 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:02.680109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2b86d-0fe1-4f1d-8f74-aa3f981d3bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:02.680621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2b86d-0fe1-4f1d-8f74-aa3f981d3bb8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:02.689817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2b86d-0fe1-4f1d-8f74-aa3f981d3bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:02.691534 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2b86d-0fe1-4f1d-8f74-aa3f981d3bb8 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:02.696738 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 356/680] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:02.697624 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3e93e-3ee6-4f4f-a51f-0b7b5da2ba8a None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-d7c2b86d-0fe1-4f1d-8f74-aa3f981d3bb8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:02.708962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:02.709935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:02.710978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:02.710978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:02.710978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:02.710978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:02.710978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:02.710978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:02.710978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:02.710978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:02.710978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 14:38:02.710978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:02.715016 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 325/681] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:38:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:02.716219 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2b86d-0fe1-4f1d-8f74-aa3f981d3bb8 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:02.770920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:02.811312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3e93e-3ee6-4f4f-a51f-0b7b5da2ba8a None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:02.827802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2b86d-0fe1-4f1d-8f74-aa3f981d3bb8 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:02.848661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63166280-9c02-4b31-bedb-d15fba20dc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:02.849315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63166280-9c02-4b31-bedb-d15fba20dc71 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:02.849602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63166280-9c02-4b31-bedb-d15fba20dc71 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:02.849877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63166280-9c02-4b31-bedb-d15fba20dc71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:02.850707 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63166280-9c02-4b31-bedb-d15fba20dc71 None admin] RBAC: Adding query filter params (role.id=81973b552fbc46a4ad31c60d8f099564, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=bdf31d7d8c164809bde0e12b71ecfca0) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:02.851020 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63166280-9c02-4b31-bedb-d15fba20dc71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:02.852445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63166280-9c02-4b31-bedb-d15fba20dc71 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:02.858967 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 357/682] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:02 2022] GET /identity/v3/role_assignments?user.id=bdf31d7d8c164809bde0e12b71ecfca0&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=81973b552fbc46a4ad31c60d8f099564 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:02.859813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63166280-9c02-4b31-bedb-d15fba20dc71 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:02.866873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce64bf3-249f-4d73-90ba-ea52c1ccbf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:02.868137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64bf3-249f-4d73-90ba-ea52c1ccbf67 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:02.868758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64bf3-249f-4d73-90ba-ea52c1ccbf67 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:02.870178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64bf3-249f-4d73-90ba-ea52c1ccbf67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:02.872524 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce64bf3-249f-4d73-90ba-ea52c1ccbf67 None admin] RBAC: Adding query filter params (role.id=81973b552fbc46a4ad31c60d8f099564, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=015326e75ae14b778e4478627d07c17f) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:02.873211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce64bf3-249f-4d73-90ba-ea52c1ccbf67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:02.875700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce64bf3-249f-4d73-90ba-ea52c1ccbf67 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:02.886337 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 326/683] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:02 2022] GET /identity/v3/role_assignments?user.id=015326e75ae14b778e4478627d07c17f&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=81973b552fbc46a4ad31c60d8f099564 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:02.889063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a8a0e-0700-46f6-ac9a-10ac0e22b93e None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:02.889634 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a8a0e-0700-46f6-ac9a-10ac0e22b93e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:02.890116 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a8a0e-0700-46f6-ac9a-10ac0e22b93e None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:02.896615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 327/684] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:02.899260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb262e-69bc-4f50-8f71-f0a86cef1d48 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:02.899260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb262e-69bc-4f50-8f71-f0a86cef1d48 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:02.899260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb262e-69bc-4f50-8f71-f0a86cef1d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:02.922625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-68bb262e-69bc-4f50-8f71-f0a86cef1d48 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:02.924471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-68bb262e-69bc-4f50-8f71-f0a86cef1d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:02.962180 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:03.018600 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 328/685] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:38:03.049020 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb262e-69bc-4f50-8f71-f0a86cef1d48 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:03.071670 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63166280-9c02-4b31-bedb-d15fba20dc71 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:03.117610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:03.124522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2216a-660c-4a54-9fb6-7e9ad4c0d0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:03.125498 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2216a-660c-4a54-9fb6-7e9ad4c0d0fd None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:03.125850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2216a-660c-4a54-9fb6-7e9ad4c0d0fd None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:03.126198 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2216a-660c-4a54-9fb6-7e9ad4c0d0fd None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:03.127214 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2216a-660c-4a54-9fb6-7e9ad4c0d0fd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:03.127616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2216a-660c-4a54-9fb6-7e9ad4c0d0fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:03.129344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2216a-660c-4a54-9fb6-7e9ad4c0d0fd None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:03.156118 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 358/686] 10.222.0.44 () {56 vars in 1135 bytes} [Mon Jun 27 14:38:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:03.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2216a-660c-4a54-9fb6-7e9ad4c0d0fd None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:03.182943 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb262e-69bc-4f50-8f71-f0a86cef1d48 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:03.226733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7000e5-68db-4e5f-a307-75daf8e4a517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:03.228335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7000e5-68db-4e5f-a307-75daf8e4a517 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:03.229046 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7000e5-68db-4e5f-a307-75daf8e4a517 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:03.229708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7000e5-68db-4e5f-a307-75daf8e4a517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:03.253296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7000e5-68db-4e5f-a307-75daf8e4a517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:03.256139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7000e5-68db-4e5f-a307-75daf8e4a517 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:03.281839 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2216a-660c-4a54-9fb6-7e9ad4c0d0fd None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:03.284142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-9b7000e5-68db-4e5f-a307-75daf8e4a517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:03.284142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:03.284142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:03.284142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:03.284142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:03.284142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:03.284142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:03.284142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:03.284142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:03.284142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:03.284142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:03.284142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:03.284142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:03.284142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:03.284142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:03.286007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:03.288003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:03.288003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:03.288003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:03.288003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:03.288461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 329/687] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:03.297611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7000e5-68db-4e5f-a307-75daf8e4a517 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:03.331924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:03.345315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4039c84-70c6-435e-8e88-1426fbc83b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:03.345974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4039c84-70c6-435e-8e88-1426fbc83b22 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:03.346257 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4039c84-70c6-435e-8e88-1426fbc83b22 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:03.346536 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4039c84-70c6-435e-8e88-1426fbc83b22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:03.424996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:03.451712 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4039c84-70c6-435e-8e88-1426fbc83b22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:03.457583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4039c84-70c6-435e-8e88-1426fbc83b22 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:03.504150 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7000e5-68db-4e5f-a307-75daf8e4a517 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:03.577369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b49941-c7ee-4f1f-b8a2-15bd19a185ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:03.578556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b49941-c7ee-4f1f-b8a2-15bd19a185ac None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:03.579004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b49941-c7ee-4f1f-b8a2-15bd19a185ac None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:03.579430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b49941-c7ee-4f1f-b8a2-15bd19a185ac None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:03.580300 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b49941-c7ee-4f1f-b8a2-15bd19a185ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:03.580779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b49941-c7ee-4f1f-b8a2-15bd19a185ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:03.582270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b49941-c7ee-4f1f-b8a2-15bd19a185ac None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:03.609277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 330/688] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:03.615441 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b49941-c7ee-4f1f-b8a2-15bd19a185ac None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:03.659471 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 359/689] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:38:03.665431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4039c84-70c6-435e-8e88-1426fbc83b22 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:03.726391 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:03.752796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b49941-c7ee-4f1f-b8a2-15bd19a185ac None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:03.792123 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cbe3d-d332-4eed-bea6-2c3875df59df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:03.793778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cbe3d-d332-4eed-bea6-2c3875df59df None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:03.794391 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cbe3d-d332-4eed-bea6-2c3875df59df None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:03.795796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cbe3d-d332-4eed-bea6-2c3875df59df None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:03.796938 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cbe3d-d332-4eed-bea6-2c3875df59df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:03.799292 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cbe3d-d332-4eed-bea6-2c3875df59df None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:03.841338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:03.854239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4039c84-70c6-435e-8e88-1426fbc83b22 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:03.891192 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 331/690] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:38:03 2022] POST /identity/v3/users => generated 254 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:38:03.899837 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad9057-d2cb-44be-85ae-ff6ea6b041b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:03.900668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad9057-d2cb-44be-85ae-ff6ea6b041b1 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:03.900964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad9057-d2cb-44be-85ae-ff6ea6b041b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:03.901244 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad9057-d2cb-44be-85ae-ff6ea6b041b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:03.905161 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e708c-797c-43c2-b25b-19df3e5106ff None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:03.905512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e708c-797c-43c2-b25b-19df3e5106ff None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:03.905793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e708c-797c-43c2-b25b-19df3e5106ff None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:03.907578 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 332/691] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:03.921236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023b3a4-7f6f-4497-ae72-9c9eee1f1195 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:03.922070 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023b3a4-7f6f-4497-ae72-9c9eee1f1195 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:03.923411 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad9057-d2cb-44be-85ae-ff6ea6b041b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:03.923999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023b3a4-7f6f-4497-ae72-9c9eee1f1195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:03.927738 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad9057-d2cb-44be-85ae-ff6ea6b041b1 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:03.959230 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-a023b3a4-7f6f-4497-ae72-9c9eee1f1195 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:03.962219 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-a023b3a4-7f6f-4497-ae72-9c9eee1f1195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:03.964291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-76ad9057-d2cb-44be-85ae-ff6ea6b041b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:03.964291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:03.964291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:03.964291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:03.964291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:03.964291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:03.964291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:03.964291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:03.964291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:03.964291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:03.964291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:03.964291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:03.964291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:03.964291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:03.964291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:03.965862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:03.966800 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:03.966800 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:03.966800 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:03.966800 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:03.969159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 360/692] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:03.979902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad9057-d2cb-44be-85ae-ff6ea6b041b1 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:04.048492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 333/693] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:38:04.083056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023b3a4-7f6f-4497-ae72-9c9eee1f1195 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:04.151368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad9057-d2cb-44be-85ae-ff6ea6b041b1 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:04.161975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:04.191350 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7e321-951a-496f-8dc1-9db504ca0b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:04.192275 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7e321-951a-496f-8dc1-9db504ca0b33 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:04.192765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7e321-951a-496f-8dc1-9db504ca0b33 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:04.193039 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7e321-951a-496f-8dc1-9db504ca0b33 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:04.193766 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7e321-951a-496f-8dc1-9db504ca0b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:04.194069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7e321-951a-496f-8dc1-9db504ca0b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:04.195413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7e321-951a-496f-8dc1-9db504ca0b33 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:04.205530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:04.210207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 361/694] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:04.216625 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7e321-951a-496f-8dc1-9db504ca0b33 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:04.221139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023b3a4-7f6f-4497-ae72-9c9eee1f1195 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:04.268318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf8476-2203-4cab-bd6b-f704308a179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:04.270657 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf8476-2203-4cab-bd6b-f704308a179f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:04.271455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf8476-2203-4cab-bd6b-f704308a179f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:04.271899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf8476-2203-4cab-bd6b-f704308a179f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:04.287776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf8476-2203-4cab-bd6b-f704308a179f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-71cf8476-2203-4cab-bd6b-f704308a179f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:04.298399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:04.299503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:04.300574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:04.300574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:04.300574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:04.300574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:04.300574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:04.300574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:04.300574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:04.300574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:04.300574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:04.300574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:04.300574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:04.300574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:04.303692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 334/695] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:38:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:04.310457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf8476-2203-4cab-bd6b-f704308a179f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:04.369225 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7e321-951a-496f-8dc1-9db504ca0b33 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:04.437364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b2dbf-1797-4101-af48-ef02d9ec6463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:04.438451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b2dbf-1797-4101-af48-ef02d9ec6463 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:04.438896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b2dbf-1797-4101-af48-ef02d9ec6463 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:04.439168 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b2dbf-1797-4101-af48-ef02d9ec6463 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:04.450387 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b2dbf-1797-4101-af48-ef02d9ec6463 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:04.451939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b2dbf-1797-4101-af48-ef02d9ec6463 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:04.467656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-f15b2dbf-1797-4101-af48-ef02d9ec6463 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:04.467656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:04.467656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:04.467656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:04.467656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:04.467656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:04.467656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:04.467656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:04.467656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:04.467656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:04.467656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:04.467656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:04.467656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:04.467656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:04.467656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:04.468580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:04.469518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:04.469518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:04.469518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:04.469518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:04.469518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:04.469518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:04.469518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:04.469518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:04.469518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 362/696] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:04.474739 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b2dbf-1797-4101-af48-ef02d9ec6463 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:04.495792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf8476-2203-4cab-bd6b-f704308a179f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:04.531886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:04.537630 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:04.561910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fe351-7eaa-429d-9e65-a7f4ede39866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:04.562578 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fe351-7eaa-429d-9e65-a7f4ede39866 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:04.569024 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fe351-7eaa-429d-9e65-a7f4ede39866 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:04.569309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fe351-7eaa-429d-9e65-a7f4ede39866 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:04.570083 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fe351-7eaa-429d-9e65-a7f4ede39866 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:04.570390 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fe351-7eaa-429d-9e65-a7f4ede39866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:04.571759 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fe351-7eaa-429d-9e65-a7f4ede39866 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:04.578915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b2dbf-1797-4101-af48-ef02d9ec6463 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:04.584201 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 335/697] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:38:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:04.589563 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fe351-7eaa-429d-9e65-a7f4ede39866 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:04.614166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791fc9d-ff31-4d3b-af59-a1bfad6e5a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:04.614828 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791fc9d-ff31-4d3b-af59-a1bfad6e5a80 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:04.615113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791fc9d-ff31-4d3b-af59-a1bfad6e5a80 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:04.615519 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791fc9d-ff31-4d3b-af59-a1bfad6e5a80 None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:04.616413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791fc9d-ff31-4d3b-af59-a1bfad6e5a80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:04.616753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791fc9d-ff31-4d3b-af59-a1bfad6e5a80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:04.618166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791fc9d-ff31-4d3b-af59-a1bfad6e5a80 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:04.631909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 363/698] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:04.637703 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791fc9d-ff31-4d3b-af59-a1bfad6e5a80 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:04.766405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fe351-7eaa-429d-9e65-a7f4ede39866 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:04.805429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581249fe-a173-4992-8a3e-d67d36b61f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:04.806142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581249fe-a173-4992-8a3e-d67d36b61f15 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:04.806425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581249fe-a173-4992-8a3e-d67d36b61f15 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:04.807486 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581249fe-a173-4992-8a3e-d67d36b61f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:04.815076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791fc9d-ff31-4d3b-af59-a1bfad6e5a80 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:04.831281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581249fe-a173-4992-8a3e-d67d36b61f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:04.832757 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581249fe-a173-4992-8a3e-d67d36b61f15 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:04.857045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:04.863357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-581249fe-a173-4992-8a3e-d67d36b61f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:04.863357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:04.863357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:04.863357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:04.863357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:04.863357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:04.863357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:04.863357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:04.863357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:04.863357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:04.863357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:04.863357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:04.863357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:04.863357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:04.863357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:04.884170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:04.885128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:04.885128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:04.885128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:04.885128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:04.885128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 336/699] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:04.885128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581249fe-a173-4992-8a3e-d67d36b61f15 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:04.897422 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed3bd9-9fe0-423a-af14-d151a20f54c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:04.898099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed3bd9-9fe0-423a-af14-d151a20f54c9 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:04.898747 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed3bd9-9fe0-423a-af14-d151a20f54c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:04.898992 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed3bd9-9fe0-423a-af14-d151a20f54c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:04.899849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed3bd9-9fe0-423a-af14-d151a20f54c9 None admin] RBAC: Adding query filter params (role.id=81973b552fbc46a4ad31c60d8f099564, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=482c11dafd8541e28d50705f7651fd15) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:04.900141 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed3bd9-9fe0-423a-af14-d151a20f54c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:04.901587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed3bd9-9fe0-423a-af14-d151a20f54c9 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:04.909746 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 364/700] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:04 2022] GET /identity/v3/role_assignments?user.id=482c11dafd8541e28d50705f7651fd15&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=81973b552fbc46a4ad31c60d8f099564 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:04.910443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:05.003329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581249fe-a173-4992-8a3e-d67d36b61f15 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:05.059417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da77268-f93b-4e34-835a-7aa82ff27a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:05.059999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da77268-f93b-4e34-835a-7aa82ff27a69 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:05.060270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da77268-f93b-4e34-835a-7aa82ff27a69 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:05.060542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da77268-f93b-4e34-835a-7aa82ff27a69 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:05.061314 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da77268-f93b-4e34-835a-7aa82ff27a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:05.061621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da77268-f93b-4e34-835a-7aa82ff27a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:05.063002 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da77268-f93b-4e34-835a-7aa82ff27a69 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:05.076985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 337/701] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:05.082010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed3bd9-9fe0-423a-af14-d151a20f54c9 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:05.207414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed3bd9-9fe0-423a-af14-d151a20f54c9 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:05.245640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9591cf-312d-4961-9421-94fa68140f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:05.247507 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9591cf-312d-4961-9421-94fa68140f78 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:05.247829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9591cf-312d-4961-9421-94fa68140f78 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:05.248138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9591cf-312d-4961-9421-94fa68140f78 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:05.256079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9591cf-312d-4961-9421-94fa68140f78 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:05.257582 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9591cf-312d-4961-9421-94fa68140f78 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-9c9591cf-312d-4961-9421-94fa68140f78 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:05.272212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:05.274487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:05.276666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:05.276666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:05.276666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:05.276666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:05.276666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:05.276666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:05.276666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:05.276666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:05.276666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:38:05.276666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:05.276666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 365/702] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Jun 27 14:38:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:05.281670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da77268-f93b-4e34-835a-7aa82ff27a69 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:05.400385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:05.409275 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da77268-f93b-4e34-835a-7aa82ff27a69 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:05.454748 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920ffd5-6d29-43af-b46f-7cc9f02be80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:05.455435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ffd5-6d29-43af-b46f-7cc9f02be80b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:05.455719 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ffd5-6d29-43af-b46f-7cc9f02be80b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:05.455999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ffd5-6d29-43af-b46f-7cc9f02be80b None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:05.456911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920ffd5-6d29-43af-b46f-7cc9f02be80b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:05.457227 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920ffd5-6d29-43af-b46f-7cc9f02be80b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:05.458656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920ffd5-6d29-43af-b46f-7cc9f02be80b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:05.478774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 338/703] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Jun 27 14:38:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:05.484237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9591cf-312d-4961-9421-94fa68140f78 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:05.541185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a27fd-39c9-4284-a07c-ccf6f66585f8 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:05.541511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a27fd-39c9-4284-a07c-ccf6f66585f8 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:05.541756 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a27fd-39c9-4284-a07c-ccf6f66585f8 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:05.543309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 339/704] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:05.544262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc490d-6c6c-4718-8e6e-a9b9f4987d87 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:05.544540 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc490d-6c6c-4718-8e6e-a9b9f4987d87 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:05.544858 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc490d-6c6c-4718-8e6e-a9b9f4987d87 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:05.546159 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 340/705] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:05.551070 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de149b6-9342-4996-bffb-bc7455ca1939 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:05.551366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de149b6-9342-4996-bffb-bc7455ca1939 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:05.551644 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de149b6-9342-4996-bffb-bc7455ca1939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:05.567236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:05.569985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-0de149b6-9342-4996-bffb-bc7455ca1939 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:05.571169 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0de149b6-9342-4996-bffb-bc7455ca1939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:05.630056 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9591cf-312d-4961-9421-94fa68140f78 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:05.648766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 341/706] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:38:05.650457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dba5d-e3c9-46bd-b917-60a19b066ea8 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:05.650691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dba5d-e3c9-46bd-b917-60a19b066ea8 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:05.650969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dba5d-e3c9-46bd-b917-60a19b066ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:05.670264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6b26e-8888-4531-9d74-dc450edd6dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:05.670917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6b26e-8888-4531-9d74-dc450edd6dd3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:05.671205 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6b26e-8888-4531-9d74-dc450edd6dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:05.671482 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6b26e-8888-4531-9d74-dc450edd6dd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:05.682182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-565dba5d-e3c9-46bd-b917-60a19b066ea8 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:05.683542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-565dba5d-e3c9-46bd-b917-60a19b066ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:05.757971 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6b26e-8888-4531-9d74-dc450edd6dd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:05.759595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6b26e-8888-4531-9d74-dc450edd6dd3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:05.765572 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 342/707] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:38:05.766526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dba5d-e3c9-46bd-b917-60a19b066ea8 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:05.781184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:05.841176 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:05.871680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dba5d-e3c9-46bd-b917-60a19b066ea8 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:05.895098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 366/708] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:38:05.896002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6b26e-8888-4531-9d74-dc450edd6dd3 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:05.909146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936e3cb-acd2-49c0-8454-3553cd2f567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:05.909992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936e3cb-acd2-49c0-8454-3553cd2f567a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:05.910360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936e3cb-acd2-49c0-8454-3553cd2f567a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:05.910701 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936e3cb-acd2-49c0-8454-3553cd2f567a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:05.911436 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936e3cb-acd2-49c0-8454-3553cd2f567a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:05.912963 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936e3cb-acd2-49c0-8454-3553cd2f567a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-d936e3cb-acd2-49c0-8454-3553cd2f567a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:05.927960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:05.936514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:05.937448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 343/709] 10.222.0.44 () {56 vars in 1129 bytes} [Mon Jun 27 14:38:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:05.938314 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936e3cb-acd2-49c0-8454-3553cd2f567a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:06.006750 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6b26e-8888-4531-9d74-dc450edd6dd3 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:06.029206 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:06.041848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936e3cb-acd2-49c0-8454-3553cd2f567a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:06.054122 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47a4cd-9acf-46aa-ba88-986e38342503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:06.055194 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47a4cd-9acf-46aa-ba88-986e38342503 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:06.055475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47a4cd-9acf-46aa-ba88-986e38342503 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:06.055749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47a4cd-9acf-46aa-ba88-986e38342503 None admin] PATH_INFO: `/v3/services/network` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:06.056561 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47a4cd-9acf-46aa-ba88-986e38342503 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:06.058583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47a4cd-9acf-46aa-ba88-986e38342503 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-7a47a4cd-9acf-46aa-ba88-986e38342503 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:06.077503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:06.078779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:06.079871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:06.079871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:06.079871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:06.079871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:06.079871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:06.079871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:06.079871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:06.079871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:06.079871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:06.079871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:06.079871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:06.079871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:06.079871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 14:38:06.079871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:06.079871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 367/710] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:05 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:06.080892 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47a4cd-9acf-46aa-ba88-986e38342503 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:06.089216 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cbeff-462d-451b-b018-e0ee4d64f051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:06.089216 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cbeff-462d-451b-b018-e0ee4d64f051 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:06.089216 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cbeff-462d-451b-b018-e0ee4d64f051 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:06.089216 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cbeff-462d-451b-b018-e0ee4d64f051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:06.093107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:06.110485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cbeff-462d-451b-b018-e0ee4d64f051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:06.112200 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cbeff-462d-451b-b018-e0ee4d64f051 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:06.131196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-076cbeff-462d-451b-b018-e0ee4d64f051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:06.131196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:06.131196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:06.131196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:06.131196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:06.131196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:06.131196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:06.131196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:06.131196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:06.131196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:06.131196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:06.131196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:06.131196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:06.131196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:06.131196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:06.132148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:06.133106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:06.133106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:06.133106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:06.133106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:06.136266 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 344/711] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:06.138281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cbeff-462d-451b-b018-e0ee4d64f051 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:06.206319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47a4cd-9acf-46aa-ba88-986e38342503 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:06.250456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14e1ab-c565-4dc9-ac3e-ebafe472d79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:06.251131 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14e1ab-c565-4dc9-ac3e-ebafe472d79d None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:06.251393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14e1ab-c565-4dc9-ac3e-ebafe472d79d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:06.251671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14e1ab-c565-4dc9-ac3e-ebafe472d79d None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:06.252685 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14e1ab-c565-4dc9-ac3e-ebafe472d79d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:06.253013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14e1ab-c565-4dc9-ac3e-ebafe472d79d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:06.254619 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14e1ab-c565-4dc9-ac3e-ebafe472d79d None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:06.255982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cbeff-462d-451b-b018-e0ee4d64f051 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:06.260602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 368/712] 10.222.0.44 () {56 vars in 1124 bytes} [Mon Jun 27 14:38:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:06.261416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14e1ab-c565-4dc9-ac3e-ebafe472d79d None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:06.286861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:06.296773 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287ef8a-e0be-4256-938f-9e090f5e9c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:06.298135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287ef8a-e0be-4256-938f-9e090f5e9c6c None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:06.298453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287ef8a-e0be-4256-938f-9e090f5e9c6c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:06.299019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287ef8a-e0be-4256-938f-9e090f5e9c6c None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:06.299934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287ef8a-e0be-4256-938f-9e090f5e9c6c None admin] RBAC: Adding query filter params (name=network) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:06.300445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287ef8a-e0be-4256-938f-9e090f5e9c6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:06.302171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287ef8a-e0be-4256-938f-9e090f5e9c6c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:06.312447 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 345/713] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Jun 27 14:38:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:06.313742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287ef8a-e0be-4256-938f-9e090f5e9c6c None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:06.344885 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:06.385546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14e1ab-c565-4dc9-ac3e-ebafe472d79d None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:06.424463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dd07c-0444-4e63-8f42-89fcacf3a6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:06.425616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dd07c-0444-4e63-8f42-89fcacf3a6e3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:06.426108 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dd07c-0444-4e63-8f42-89fcacf3a6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:06.426590 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dd07c-0444-4e63-8f42-89fcacf3a6e3 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:06.427530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dd07c-0444-4e63-8f42-89fcacf3a6e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:06.428210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dd07c-0444-4e63-8f42-89fcacf3a6e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:06.429830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dd07c-0444-4e63-8f42-89fcacf3a6e3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:06.444239 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287ef8a-e0be-4256-938f-9e090f5e9c6c None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:06.450344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 369/714] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:06.451687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dd07c-0444-4e63-8f42-89fcacf3a6e3 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:06.485950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ef565-d18b-4003-a7b3-bbf666719e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:06.487452 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ef565-d18b-4003-a7b3-bbf666719e68 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:06.487802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ef565-d18b-4003-a7b3-bbf666719e68 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:06.488093 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ef565-d18b-4003-a7b3-bbf666719e68 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:06.488839 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ef565-d18b-4003-a7b3-bbf666719e68 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:06.489149 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ef565-d18b-4003-a7b3-bbf666719e68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:06.490518 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ef565-d18b-4003-a7b3-bbf666719e68 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:06.497151 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 346/715] 10.222.0.44 () {56 vars in 1124 bytes} [Mon Jun 27 14:38:06 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:06.498268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ef565-d18b-4003-a7b3-bbf666719e68 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:06.566720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:06.573008 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dd07c-0444-4e63-8f42-89fcacf3a6e3 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:06.618014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:06.625113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668bace-a18c-42da-8737-f6c6078af690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:06.625473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ef565-d18b-4003-a7b3-bbf666719e68 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:06.626095 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668bace-a18c-42da-8737-f6c6078af690 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:06.626453 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668bace-a18c-42da-8737-f6c6078af690 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:06.626788 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668bace-a18c-42da-8737-f6c6078af690 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:06.627587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668bace-a18c-42da-8737-f6c6078af690 None admin] RBAC: Adding query filter params (type=network) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:06.628075 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668bace-a18c-42da-8737-f6c6078af690 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:06.629932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668bace-a18c-42da-8737-f6c6078af690 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:06.636217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 370/716] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Jun 27 14:38:06 2022] GET /identity/v3/services?type=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:06.642597 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9065cd1-e627-4140-b35f-9b6f409e0626 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:06.642968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9065cd1-e627-4140-b35f-9b6f409e0626 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:06.643323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9065cd1-e627-4140-b35f-9b6f409e0626 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:06.645334 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 371/717] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:06.651304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243f3ed-ace0-4064-adc0-1ee124af436d None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:06.651675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243f3ed-ace0-4064-adc0-1ee124af436d None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:06.652031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243f3ed-ace0-4064-adc0-1ee124af436d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:06.670973 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b99b1-995a-4d8b-9c6f-c5525c851b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:06.672043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b99b1-995a-4d8b-9c6f-c5525c851b29 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:06.672470 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b99b1-995a-4d8b-9c6f-c5525c851b29 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:06.672938 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b99b1-995a-4d8b-9c6f-c5525c851b29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:06.681144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b99b1-995a-4d8b-9c6f-c5525c851b29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:06.682913 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b99b1-995a-4d8b-9c6f-c5525c851b29 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:06.689832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-9243f3ed-ace0-4064-adc0-1ee124af436d None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:06.691067 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9243f3ed-ace0-4064-adc0-1ee124af436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:06.700280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-e06b99b1-995a-4d8b-9c6f-c5525c851b29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:06.700280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:06.700280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:06.700280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:06.700280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:06.700280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:06.700280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:06.700280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:06.700280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:06.700280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:06.700280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:06.700280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:06.700280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:06.700280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:06.700280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:06.701484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:06.702872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:06.702872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:06.702872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:06.702872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:06.702872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:06.702872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:06.702872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:06.702872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:06.702872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 347/718] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:06.712709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b99b1-995a-4d8b-9c6f-c5525c851b29 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:06.797667 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 372/719] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:38:06.838584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b99b1-995a-4d8b-9c6f-c5525c851b29 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:06.841127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243f3ed-ace0-4064-adc0-1ee124af436d None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:06.864589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:06.897374 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c084d4c-170d-4afb-8386-d98133d61762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:06.898681 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c084d4c-170d-4afb-8386-d98133d61762 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:06.898681 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c084d4c-170d-4afb-8386-d98133d61762 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:06.898681 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c084d4c-170d-4afb-8386-d98133d61762 None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:06.899413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c084d4c-170d-4afb-8386-d98133d61762 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:06.899719 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c084d4c-170d-4afb-8386-d98133d61762 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:06.901514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c084d4c-170d-4afb-8386-d98133d61762 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:06.915008 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 348/720] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:06.920722 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c084d4c-170d-4afb-8386-d98133d61762 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:07.086755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243f3ed-ace0-4064-adc0-1ee124af436d None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:07.092669 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c084d4c-170d-4afb-8386-d98133d61762 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:07.142203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5be57d-9d12-43da-807e-1e9628338694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:07.143011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5be57d-9d12-43da-807e-1e9628338694 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:07.143296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5be57d-9d12-43da-807e-1e9628338694 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:07.143571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5be57d-9d12-43da-807e-1e9628338694 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:07.144416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5be57d-9d12-43da-807e-1e9628338694 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=08529776af224c36ab560c13f5941e0a) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:07.144755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5be57d-9d12-43da-807e-1e9628338694 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:07.147823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:07.149128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5be57d-9d12-43da-807e-1e9628338694 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:07.160335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 349/721] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:06 2022] GET /identity/v3/role_assignments?user.id=08529776af224c36ab560c13f5941e0a&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=6036efe96c1948fb98d01c8703a0561a => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:07.165623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39d167-2f40-438f-9a1f-37e78e507ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:07.165623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39d167-2f40-438f-9a1f-37e78e507ccc None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:07.165623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39d167-2f40-438f-9a1f-37e78e507ccc None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:07.165623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39d167-2f40-438f-9a1f-37e78e507ccc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:07.177471 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39d167-2f40-438f-9a1f-37e78e507ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-cf39d167-2f40-438f-9a1f-37e78e507ccc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:07.186298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:07.187331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:07.188188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:07.188188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:07.188188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:07.188188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:07.188188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:07.188188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:07.188188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:07.188188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:07.188188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:07.188188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:07.188188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:38:07.188188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:07.188188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 373/722] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:38:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:07.193614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5be57d-9d12-43da-807e-1e9628338694 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:07.257285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:07.315024 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5be57d-9d12-43da-807e-1e9628338694 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:07.365015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b21d1a-f1c5-4e4a-8482-f34f1d13a3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:07.365616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b21d1a-f1c5-4e4a-8482-f34f1d13a3b2 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:07.365896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b21d1a-f1c5-4e4a-8482-f34f1d13a3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:07.366170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b21d1a-f1c5-4e4a-8482-f34f1d13a3b2 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:07.366937 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b21d1a-f1c5-4e4a-8482-f34f1d13a3b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:07.367243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b21d1a-f1c5-4e4a-8482-f34f1d13a3b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:07.368667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b21d1a-f1c5-4e4a-8482-f34f1d13a3b2 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:07.380473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 350/723] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:38:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:07.387158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39d167-2f40-438f-9a1f-37e78e507ccc None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:07.509767 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39d167-2f40-438f-9a1f-37e78e507ccc None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:07.558057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47892ab6-31b1-4d66-b462-7a9b996971a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:07.559546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47892ab6-31b1-4d66-b462-7a9b996971a9 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:07.559873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47892ab6-31b1-4d66-b462-7a9b996971a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:07.560143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47892ab6-31b1-4d66-b462-7a9b996971a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:07.578684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47892ab6-31b1-4d66-b462-7a9b996971a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:07.580132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47892ab6-31b1-4d66-b462-7a9b996971a9 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:07.594199 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89336ea6-5751-48d7-a59b-1cb4ec9508e9 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:07.594508 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89336ea6-5751-48d7-a59b-1cb4ec9508e9 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:07.594752 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89336ea6-5751-48d7-a59b-1cb4ec9508e9 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:07.596109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 351/724] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:07.601358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067647ea-abd2-4ab1-ab1c-428ba0deb3d7 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:07.601487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-47892ab6-31b1-4d66-b462-7a9b996971a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:07.601487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:07.601487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:07.601487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:07.601487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:07.601487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:07.601487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:07.601487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:07.601487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:07.601487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:07.601487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:07.601487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:07.601487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:07.601487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:07.601487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:07.602415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:07.603313 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:07.603313 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:07.603313 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:07.603313 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:07.603546 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067647ea-abd2-4ab1-ab1c-428ba0deb3d7 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:07.603546 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067647ea-abd2-4ab1-ab1c-428ba0deb3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:07.603681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 374/725] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:07.610925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47892ab6-31b1-4d66-b462-7a9b996971a9 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:07.639835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-067647ea-abd2-4ab1-ab1c-428ba0deb3d7 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:07.640981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-067647ea-abd2-4ab1-ab1c-428ba0deb3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:07.675000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:07.739429 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47892ab6-31b1-4d66-b462-7a9b996971a9 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:07.773678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95c6ec-100e-4885-89bc-5614831280b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:07.774384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95c6ec-100e-4885-89bc-5614831280b9 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:07.774669 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95c6ec-100e-4885-89bc-5614831280b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:07.774942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95c6ec-100e-4885-89bc-5614831280b9 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:07.775664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95c6ec-100e-4885-89bc-5614831280b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:07.775964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95c6ec-100e-4885-89bc-5614831280b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:07.777850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95c6ec-100e-4885-89bc-5614831280b9 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:07.789820 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 375/726] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:07.794983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 352/727] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 14:38:07.813151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95c6ec-100e-4885-89bc-5614831280b9 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:07.821793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067647ea-abd2-4ab1-ab1c-428ba0deb3d7 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:07.914592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:07.923909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95c6ec-100e-4885-89bc-5614831280b9 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:07.926504 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:07.972621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490e6f0-1a7c-4770-b556-8b158f2d656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:07.973471 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490e6f0-1a7c-4770-b556-8b158f2d656e None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:07.973751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490e6f0-1a7c-4770-b556-8b158f2d656e None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:07.974024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490e6f0-1a7c-4770-b556-8b158f2d656e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:07.991864 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490e6f0-1a7c-4770-b556-8b158f2d656e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:07.993341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490e6f0-1a7c-4770-b556-8b158f2d656e None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-8490e6f0-1a7c-4770-b556-8b158f2d656e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:08.020700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:08.021722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:08.022661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:08.022661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:08.022661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:08.022661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:08.022661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:08.022661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:08.022661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:08.022661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:08.022661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 14:38:08.022661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:08.030493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 376/728] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Jun 27 14:38:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:08.041751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490e6f0-1a7c-4770-b556-8b158f2d656e None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:08.053359 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067647ea-abd2-4ab1-ab1c-428ba0deb3d7 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:08.137426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752302ee-822f-4411-811f-9dc14f0ef087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:08.138271 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752302ee-822f-4411-811f-9dc14f0ef087 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:08.138554 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752302ee-822f-4411-811f-9dc14f0ef087 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:08.138826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752302ee-822f-4411-811f-9dc14f0ef087 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:08.154368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752302ee-822f-4411-811f-9dc14f0ef087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-752302ee-822f-4411-811f-9dc14f0ef087 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:08.161835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:08.162784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:08.163640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:08.163640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:08.163640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:08.163640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:08.163640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:08.163640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:08.163640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:08.163640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:08.163640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:08.163640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:08.163640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:08.163640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:08.163640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 353/729] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:38:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:08.171396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752302ee-822f-4411-811f-9dc14f0ef087 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:08.237443 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490e6f0-1a7c-4770-b556-8b158f2d656e None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:08.289766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:08.304401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752302ee-822f-4411-811f-9dc14f0ef087 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:08.305317 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cda90-1376-4875-9b12-0345c976072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:08.306236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cda90-1376-4875-9b12-0345c976072a None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:08.306731 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cda90-1376-4875-9b12-0345c976072a None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:08.307806 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cda90-1376-4875-9b12-0345c976072a None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:08.310601 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cda90-1376-4875-9b12-0345c976072a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:08.315168 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cda90-1376-4875-9b12-0345c976072a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:08.315168 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cda90-1376-4875-9b12-0345c976072a None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:08.352079 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3001ddb-ff32-45f5-a534-7294390745bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:08.352757 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 377/730] 10.222.0.44 () {56 vars in 1149 bytes} [Mon Jun 27 14:38:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:08.353629 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3001ddb-ff32-45f5-a534-7294390745bb None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:08.354115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3001ddb-ff32-45f5-a534-7294390745bb None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:08.354577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3001ddb-ff32-45f5-a534-7294390745bb None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:08.356799 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cda90-1376-4875-9b12-0345c976072a None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:08.356962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3001ddb-ff32-45f5-a534-7294390745bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:08.357307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3001ddb-ff32-45f5-a534-7294390745bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:08.364420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3001ddb-ff32-45f5-a534-7294390745bb None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:08.381791 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 354/731] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:38:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:08.397566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3001ddb-ff32-45f5-a534-7294390745bb None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:08.410083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:08.550962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cda90-1376-4875-9b12-0345c976072a None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:08.592559 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3001ddb-ff32-45f5-a534-7294390745bb None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:08.603674 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350de88-9c6f-404d-857e-d288012cdb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:08.604335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350de88-9c6f-404d-857e-d288012cdb5d None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:08.604622 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350de88-9c6f-404d-857e-d288012cdb5d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:08.604929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350de88-9c6f-404d-857e-d288012cdb5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:08.669400 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c8776-1e40-4e18-93a8-9fd470f17922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:08.670617 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c8776-1e40-4e18-93a8-9fd470f17922 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:08.671112 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c8776-1e40-4e18-93a8-9fd470f17922 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:08.671610 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c8776-1e40-4e18-93a8-9fd470f17922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:08.697273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c8776-1e40-4e18-93a8-9fd470f17922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:08.698990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c8776-1e40-4e18-93a8-9fd470f17922 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:08.706577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350de88-9c6f-404d-857e-d288012cdb5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:08.708041 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350de88-9c6f-404d-857e-d288012cdb5d None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:08.726313 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:08.727110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-fd7c8776-1e40-4e18-93a8-9fd470f17922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:08.727110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:08.727110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:08.727110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:08.727110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:08.727110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:08.727110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:08.727110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:08.727110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:08.727110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:08.727110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:08.727110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:08.727110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:08.727110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:08.727110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:08.728006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:08.728951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:08.728951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:08.728951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:08.728951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:08.728951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 355/732] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:08.737841 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c8776-1e40-4e18-93a8-9fd470f17922 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:08.749001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:08.839576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 378/733] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:38:08.850787 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350de88-9c6f-404d-857e-d288012cdb5d None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:08.955857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350de88-9c6f-404d-857e-d288012cdb5d None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:08.973558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:08.995106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c8776-1e40-4e18-93a8-9fd470f17922 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:08.997989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7a855-b6f7-48f4-8a14-aa878b997804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:08.998798 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7a855-b6f7-48f4-8a14-aa878b997804 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:08.999083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7a855-b6f7-48f4-8a14-aa878b997804 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:08.999362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7a855-b6f7-48f4-8a14-aa878b997804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:09.022295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7a855-b6f7-48f4-8a14-aa878b997804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:09.023766 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7a855-b6f7-48f4-8a14-aa878b997804 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:09.051064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-4dc7a855-b6f7-48f4-8a14-aa878b997804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:09.051064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:09.051064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:09.051064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:09.051064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:09.051064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:09.051064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:09.051064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:09.051064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:09.051064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:09.051064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:09.051064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:09.051064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:09.051064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:09.051064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:09.052105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:09.053606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:09.053606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:09.053606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:09.053606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:09.053606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 379/734] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:09.060633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7a855-b6f7-48f4-8a14-aa878b997804 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:09.077364 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527aec5f-5269-47b1-a4aa-b7fa0f9bc5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:09.078048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aec5f-5269-47b1-a4aa-b7fa0f9bc5c3 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:09.078335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aec5f-5269-47b1-a4aa-b7fa0f9bc5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:09.078616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aec5f-5269-47b1-a4aa-b7fa0f9bc5c3 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:09.079362 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527aec5f-5269-47b1-a4aa-b7fa0f9bc5c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:09.079672 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527aec5f-5269-47b1-a4aa-b7fa0f9bc5c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:09.081750 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527aec5f-5269-47b1-a4aa-b7fa0f9bc5c3 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:09.106368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 356/735] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:09.107975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f43ff-e9e7-4445-aae6-734cf6e0c72d None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:09.108325 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f43ff-e9e7-4445-aae6-734cf6e0c72d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:09.108708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f43ff-e9e7-4445-aae6-734cf6e0c72d None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:09.114413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 357/736] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:09.114413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f43ff-e9e7-4445-aae6-734cf6e0c72d None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:09.188270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:09.193761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7a855-b6f7-48f4-8a14-aa878b997804 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:09.225629 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f43ff-e9e7-4445-aae6-734cf6e0c72d None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:09.229319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd0cc6-a4a5-4110-8983-9caf9e5c4910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:09.229985 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd0cc6-a4a5-4110-8983-9caf9e5c4910 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:09.230267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd0cc6-a4a5-4110-8983-9caf9e5c4910 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:09.230580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd0cc6-a4a5-4110-8983-9caf9e5c4910 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:09.231451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd0cc6-a4a5-4110-8983-9caf9e5c4910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:09.231757 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd0cc6-a4a5-4110-8983-9caf9e5c4910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:09.233603 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd0cc6-a4a5-4110-8983-9caf9e5c4910 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:09.251830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 380/737] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:09.251830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7de0a3-4a98-48cd-a657-869abe74a67d None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:09.251830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7de0a3-4a98-48cd-a657-869abe74a67d None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:09.251830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7de0a3-4a98-48cd-a657-869abe74a67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:09.265945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436c92d-852a-453a-a272-d73f6513a394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:09.266726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436c92d-852a-453a-a272-d73f6513a394 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:09.267006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436c92d-852a-453a-a272-d73f6513a394 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:09.267276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436c92d-852a-453a-a272-d73f6513a394 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:09.267503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-ce7de0a3-4a98-48cd-a657-869abe74a67d None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:09.268716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-ce7de0a3-4a98-48cd-a657-869abe74a67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:09.274399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436c92d-852a-453a-a272-d73f6513a394 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:09.275832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436c92d-852a-453a-a272-d73f6513a394 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-6436c92d-852a-453a-a272-d73f6513a394 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:09.290236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:09.291254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:09.292883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:09.292883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:09.292883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:09.292883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:09.292883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:09.292883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:09.292883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:09.292883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:09.292883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 14:38:09.292883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:09.292883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 358/738] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:38:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:09.293898 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea640f-10cf-40c8-a7b3-8f51bd856bd9 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:09.293898 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea640f-10cf-40c8-a7b3-8f51bd856bd9 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:09.293898 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea640f-10cf-40c8-a7b3-8f51bd856bd9 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:09.294922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 359/739] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:09.295439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea640f-10cf-40c8-a7b3-8f51bd856bd9 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:09.301764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:09.356403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 381/740] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:38:09.356403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7de0a3-4a98-48cd-a657-869abe74a67d None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:09.414614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea640f-10cf-40c8-a7b3-8f51bd856bd9 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:09.443667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:09.453490 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002f959-2d8c-41c4-be23-6f0568574d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:09.454283 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002f959-2d8c-41c4-be23-6f0568574d7c None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:09.454582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002f959-2d8c-41c4-be23-6f0568574d7c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:09.454847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002f959-2d8c-41c4-be23-6f0568574d7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:09.460837 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7de0a3-4a98-48cd-a657-869abe74a67d None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:09.461970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002f959-2d8c-41c4-be23-6f0568574d7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:09.463455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002f959-2d8c-41c4-be23-6f0568574d7c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:09.478021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-1002f959-2d8c-41c4-be23-6f0568574d7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:09.478021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:09.478021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:09.478021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:09.478021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:09.478021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:09.478021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:09.478021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:09.478021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:09.478021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:09.478021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:09.478021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:09.478021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:09.478021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:09.478021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:09.479142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:09.480427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:09.480427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:09.480427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:09.480427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:09.480427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:09.480427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:09.480427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:09.480427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:09.483988 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 360/741] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:09.485274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafddf04-210b-4c5b-8106-70dcd9cf8132 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:09.485565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafddf04-210b-4c5b-8106-70dcd9cf8132 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:09.485846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafddf04-210b-4c5b-8106-70dcd9cf8132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:09.502369 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177ea2c-3e08-4d83-8618-b1f09d4e68c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:09.502901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-aafddf04-210b-4c5b-8106-70dcd9cf8132 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:09.503114 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ea2c-3e08-4d83-8618-b1f09d4e68c7 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:09.503401 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ea2c-3e08-4d83-8618-b1f09d4e68c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:09.503676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ea2c-3e08-4d83-8618-b1f09d4e68c7 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:09.504085 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-aafddf04-210b-4c5b-8106-70dcd9cf8132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:09.504512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ea2c-3e08-4d83-8618-b1f09d4e68c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:09.504860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ea2c-3e08-4d83-8618-b1f09d4e68c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:09.506263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ea2c-3e08-4d83-8618-b1f09d4e68c7 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:09.524741 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 382/742] 10.222.0.44 () {56 vars in 1135 bytes} [Mon Jun 27 14:38:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:09.526339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177ea2c-3e08-4d83-8618-b1f09d4e68c7 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:09.547236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:09.572713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 361/743] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 14:38:09.573834 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafddf04-210b-4c5b-8106-70dcd9cf8132 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:09.630551 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177ea2c-3e08-4d83-8618-b1f09d4e68c7 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:09.663835 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22109e88-9b1f-408b-8097-9a2f5a22268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:09.664486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22109e88-9b1f-408b-8097-9a2f5a22268d None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:09.664798 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22109e88-9b1f-408b-8097-9a2f5a22268d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:09.665076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22109e88-9b1f-408b-8097-9a2f5a22268d None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:09.665784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22109e88-9b1f-408b-8097-9a2f5a22268d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:09.667134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22109e88-9b1f-408b-8097-9a2f5a22268d None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:09.672198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafddf04-210b-4c5b-8106-70dcd9cf8132 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:09.688216 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:09.705805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe9bb6-a8f8-4f6c-aa4e-2a9f3c6cce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:09.706456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe9bb6-a8f8-4f6c-aa4e-2a9f3c6cce7d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:09.706738 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe9bb6-a8f8-4f6c-aa4e-2a9f3c6cce7d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:09.707010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe9bb6-a8f8-4f6c-aa4e-2a9f3c6cce7d None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:09.707792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe9bb6-a8f8-4f6c-aa4e-2a9f3c6cce7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:09.708100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe9bb6-a8f8-4f6c-aa4e-2a9f3c6cce7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:09.709537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe9bb6-a8f8-4f6c-aa4e-2a9f3c6cce7d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:09.721512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 362/744] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:09.722278 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe9bb6-a8f8-4f6c-aa4e-2a9f3c6cce7d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:09.769810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 383/745] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Jun 27 14:38:09 2022] POST /identity/v3/services => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:38:09.771132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84954676-70d7-4edf-b70e-1707c0022eac None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:09.771422 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84954676-70d7-4edf-b70e-1707c0022eac None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:09.771698 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84954676-70d7-4edf-b70e-1707c0022eac None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:09.773136 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 384/746] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:09.778671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84954676-70d7-4edf-b70e-1707c0022eac None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:09.831664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe9bb6-a8f8-4f6c-aa4e-2a9f3c6cce7d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:09.873175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:09.874886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a9313-5728-433b-8fd9-6f7b8516991f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:09.875553 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a9313-5728-433b-8fd9-6f7b8516991f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:09.875836 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a9313-5728-433b-8fd9-6f7b8516991f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:09.876114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a9313-5728-433b-8fd9-6f7b8516991f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:09.899781 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84954676-70d7-4edf-b70e-1707c0022eac None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:09.924056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:09.960776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a9313-5728-433b-8fd9-6f7b8516991f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:09.962285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a9313-5728-433b-8fd9-6f7b8516991f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:10.049064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284dbfa-cc80-4b71-8cd4-13b644ad2147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:10.050048 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284dbfa-cc80-4b71-8cd4-13b644ad2147 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:10.050333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284dbfa-cc80-4b71-8cd4-13b644ad2147 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:10.050610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284dbfa-cc80-4b71-8cd4-13b644ad2147 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:10.051339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284dbfa-cc80-4b71-8cd4-13b644ad2147 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:10.052705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284dbfa-cc80-4b71-8cd4-13b644ad2147 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:10.070897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 363/747] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:09 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 14:38:10.071794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a9313-5728-433b-8fd9-6f7b8516991f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:10.119923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 385/748] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Jun 27 14:38:09 2022] POST /identity/v3/services => generated 240 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:38:10.122081 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6232e6-9068-4122-853f-0a28ec251b8e None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:10.122751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6232e6-9068-4122-853f-0a28ec251b8e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:10.123194 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6232e6-9068-4122-853f-0a28ec251b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:10.143872 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-4c6232e6-9068-4122-853f-0a28ec251b8e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:10.152917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4c6232e6-9068-4122-853f-0a28ec251b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:10.164403 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:10.200494 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a9313-5728-433b-8fd9-6f7b8516991f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:10.245587 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60d135-e60c-4113-85bc-2ca99ad74a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:10.246824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60d135-e60c-4113-85bc-2ca99ad74a54 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:10.247107 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60d135-e60c-4113-85bc-2ca99ad74a54 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:10.247384 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60d135-e60c-4113-85bc-2ca99ad74a54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:10.248208 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60d135-e60c-4113-85bc-2ca99ad74a54 None admin] RBAC: Adding query filter params (role.id=81973b552fbc46a4ad31c60d8f099564, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=d87edb187b2f4d6194cb7c94a3d690e6) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:10.248515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60d135-e60c-4113-85bc-2ca99ad74a54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:10.250002 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60d135-e60c-4113-85bc-2ca99ad74a54 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:10.261123 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 364/750] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:10 2022] GET /identity/v3/role_assignments?user.id=d87edb187b2f4d6194cb7c94a3d690e6&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=81973b552fbc46a4ad31c60d8f099564 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:10.261319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 386/750] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:10.262776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60d135-e60c-4113-85bc-2ca99ad74a54 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:10.285512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6232e6-9068-4122-853f-0a28ec251b8e None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:10.365335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:10.383923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60d135-e60c-4113-85bc-2ca99ad74a54 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:10.415361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6232e6-9068-4122-853f-0a28ec251b8e None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:10.422383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299301e-545a-4077-b27e-7dd6a2935bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:10.423951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299301e-545a-4077-b27e-7dd6a2935bb7 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:10.423951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299301e-545a-4077-b27e-7dd6a2935bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:10.423951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299301e-545a-4077-b27e-7dd6a2935bb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:10.425006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:10.437413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299301e-545a-4077-b27e-7dd6a2935bb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:10.438885 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299301e-545a-4077-b27e-7dd6a2935bb7 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:10.458458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a4d9d-cc34-4f48-855c-f336955cc0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:10.459178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-9299301e-545a-4077-b27e-7dd6a2935bb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:10.459178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:10.459178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:10.459178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:10.459178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:10.459178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:10.459178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:10.459178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:10.459178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:10.459178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:10.459178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:10.459178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:10.459178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:10.459178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:10.459178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:10.460043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:10.460985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:10.460985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:10.460985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:10.460985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:10.462283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a4d9d-cc34-4f48-855c-f336955cc0ab None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:10.463114 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a4d9d-cc34-4f48-855c-f336955cc0ab None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:10.463601 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a4d9d-cc34-4f48-855c-f336955cc0ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:10.464828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 365/751] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:10.466893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299301e-545a-4077-b27e-7dd6a2935bb7 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:10.476247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a4d9d-cc34-4f48-855c-f336955cc0ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-065a4d9d-cc34-4f48-855c-f336955cc0ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:10.486270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:10.495109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:10.496001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:10.496001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:10.496001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:10.496001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:10.496001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:10.496001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:10.496001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:10.496001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:10.496001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:10.496001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:10.496001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:10.496001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:10.496001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 387/752] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:38:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:10.496001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a4d9d-cc34-4f48-855c-f336955cc0ab None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:10.575235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299301e-545a-4077-b27e-7dd6a2935bb7 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:10.606171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a4d9d-cc34-4f48-855c-f336955cc0ab None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:10.610990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca761e-164c-4918-9751-08eb11ceaad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:10.611649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca761e-164c-4918-9751-08eb11ceaad6 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:10.611931 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca761e-164c-4918-9751-08eb11ceaad6 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:10.612203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca761e-164c-4918-9751-08eb11ceaad6 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:10.612978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca761e-164c-4918-9751-08eb11ceaad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:10.613282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca761e-164c-4918-9751-08eb11ceaad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:10.614637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca761e-164c-4918-9751-08eb11ceaad6 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:10.627583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 366/753] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:10.632796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca761e-164c-4918-9751-08eb11ceaad6 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:10.634647 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:10.647235 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069a683-9f75-4c3b-ae09-f8c82f7a42e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:10.648303 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069a683-9f75-4c3b-ae09-f8c82f7a42e3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:10.648809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069a683-9f75-4c3b-ae09-f8c82f7a42e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:10.649250 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069a683-9f75-4c3b-ae09-f8c82f7a42e3 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:10.650161 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069a683-9f75-4c3b-ae09-f8c82f7a42e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:10.656522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069a683-9f75-4c3b-ae09-f8c82f7a42e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:10.656522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069a683-9f75-4c3b-ae09-f8c82f7a42e3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:10.661813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 388/754] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:38:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:10.667506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069a683-9f75-4c3b-ae09-f8c82f7a42e3 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:10.698292 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:10.737947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca761e-164c-4918-9751-08eb11ceaad6 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:10.773432 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48a6fe-0274-4b6f-825d-6904d111c28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:10.774322 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48a6fe-0274-4b6f-825d-6904d111c28e None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:10.774717 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48a6fe-0274-4b6f-825d-6904d111c28e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:10.774996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48a6fe-0274-4b6f-825d-6904d111c28e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:10.782327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48a6fe-0274-4b6f-825d-6904d111c28e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:10.783734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48a6fe-0274-4b6f-825d-6904d111c28e None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:10.790992 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069a683-9f75-4c3b-ae09-f8c82f7a42e3 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:10.799467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-cf48a6fe-0274-4b6f-825d-6904d111c28e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:10.799467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:10.799467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:10.799467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:10.799467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:10.799467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:10.799467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:10.799467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:10.799467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:10.799467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:10.799467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:10.799467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:10.799467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:10.799467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:10.799467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:10.800383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:10.801323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:10.801323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:10.801323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:10.801323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:10.801323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:10.801323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:10.801323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:10.801323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:10.801323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 367/755] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:10.808928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48a6fe-0274-4b6f-825d-6904d111c28e None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:10.851557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08835521-6b9a-40a2-814d-6cf0af0b7f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:10.852664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08835521-6b9a-40a2-814d-6cf0af0b7f39 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:10.853096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08835521-6b9a-40a2-814d-6cf0af0b7f39 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:10.853516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08835521-6b9a-40a2-814d-6cf0af0b7f39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:10.877098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08835521-6b9a-40a2-814d-6cf0af0b7f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:10.877098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08835521-6b9a-40a2-814d-6cf0af0b7f39 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:10.906909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-08835521-6b9a-40a2-814d-6cf0af0b7f39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:10.906909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:10.906909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:10.906909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:10.906909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:10.906909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:10.906909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:10.906909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:10.906909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:10.906909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:10.906909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:10.906909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:10.906909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:10.906909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:10.906909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:10.910693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:10.911675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:10.911675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:10.911675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:10.911675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:10.913876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48a6fe-0274-4b6f-825d-6904d111c28e None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:10.916978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:10.919608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 389/756] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:10.925040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08835521-6b9a-40a2-814d-6cf0af0b7f39 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:10.951306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbde027-6459-4665-baf1-d71b67557e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:10.952082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbde027-6459-4665-baf1-d71b67557e51 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:10.952511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbde027-6459-4665-baf1-d71b67557e51 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:10.952772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbde027-6459-4665-baf1-d71b67557e51 None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:10.953635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbde027-6459-4665-baf1-d71b67557e51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:10.954004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbde027-6459-4665-baf1-d71b67557e51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:10.955574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbde027-6459-4665-baf1-d71b67557e51 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:10.969958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 368/757] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:10.975523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbde027-6459-4665-baf1-d71b67557e51 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:11.011259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:11.111785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbde027-6459-4665-baf1-d71b67557e51 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:11.126556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08835521-6b9a-40a2-814d-6cf0af0b7f39 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:11.169867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13652961-1d27-4a7e-a02c-b28208f17d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:11.170470 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13652961-1d27-4a7e-a02c-b28208f17d15 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:11.176664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13652961-1d27-4a7e-a02c-b28208f17d15 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:11.176664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13652961-1d27-4a7e-a02c-b28208f17d15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:11.176664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13652961-1d27-4a7e-a02c-b28208f17d15 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=482c11dafd8541e28d50705f7651fd15) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:11.176664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13652961-1d27-4a7e-a02c-b28208f17d15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:11.176664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13652961-1d27-4a7e-a02c-b28208f17d15 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:11.179896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 369/758] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:10 2022] GET /identity/v3/role_assignments?user.id=482c11dafd8541e28d50705f7651fd15&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=6036efe96c1948fb98d01c8703a0561a => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:11.188218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a36ae7-0cf7-421c-92bf-bcdce60e81d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:11.189295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a36ae7-0cf7-421c-92bf-bcdce60e81d6 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:11.189822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a36ae7-0cf7-421c-92bf-bcdce60e81d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:11.190304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a36ae7-0cf7-421c-92bf-bcdce60e81d6 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:11.191262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a36ae7-0cf7-421c-92bf-bcdce60e81d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:11.191795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a36ae7-0cf7-421c-92bf-bcdce60e81d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:11.193444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a36ae7-0cf7-421c-92bf-bcdce60e81d6 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:11.207994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 390/759] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:11.214039 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13652961-1d27-4a7e-a02c-b28208f17d15 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:11.262426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:11.350460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13652961-1d27-4a7e-a02c-b28208f17d15 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:11.389456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947b38e-aa39-4cb3-8bcc-c5fb5fac625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:11.390317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947b38e-aa39-4cb3-8bcc-c5fb5fac625f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:11.390600 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947b38e-aa39-4cb3-8bcc-c5fb5fac625f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:11.390872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947b38e-aa39-4cb3-8bcc-c5fb5fac625f None admin] PATH_INFO: `/v3/users/nova` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:11.398999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947b38e-aa39-4cb3-8bcc-c5fb5fac625f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:11.400440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947b38e-aa39-4cb3-8bcc-c5fb5fac625f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-a947b38e-aa39-4cb3-8bcc-c5fb5fac625f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:11.415684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:11.416676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:11.417664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:11.417664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:11.417664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:11.417664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:11.417664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:11.417664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:11.417664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:11.417664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:11.417664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:38:11.417664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:11.417664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 370/760] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Jun 27 14:38:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:11.424726 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a36ae7-0cf7-421c-92bf-bcdce60e81d6 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:11.527097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:11.537047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a36ae7-0cf7-421c-92bf-bcdce60e81d6 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:11.581508 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d8fcc-775b-4c28-8e6c-660bd0555316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:11.582242 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d8fcc-775b-4c28-8e6c-660bd0555316 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:11.582535 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d8fcc-775b-4c28-8e6c-660bd0555316 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:11.582815 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d8fcc-775b-4c28-8e6c-660bd0555316 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:11.583662 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d8fcc-775b-4c28-8e6c-660bd0555316 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:11.583974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d8fcc-775b-4c28-8e6c-660bd0555316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:11.585421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d8fcc-775b-4c28-8e6c-660bd0555316 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:11.604480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 391/761] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Jun 27 14:38:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:11.610730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947b38e-aa39-4cb3-8bcc-c5fb5fac625f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:11.725717 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:11.736888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947b38e-aa39-4cb3-8bcc-c5fb5fac625f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:11.771312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783d281-b725-42a8-bebd-83f8880bccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:11.772102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783d281-b725-42a8-bebd-83f8880bccac None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:11.772382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783d281-b725-42a8-bebd-83f8880bccac None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:11.772668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783d281-b725-42a8-bebd-83f8880bccac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:11.783531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783d281-b725-42a8-bebd-83f8880bccac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:11.785009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783d281-b725-42a8-bebd-83f8880bccac None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:11.804312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-e783d281-b725-42a8-bebd-83f8880bccac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:11.804312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:11.804312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:11.804312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:11.804312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:11.804312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:11.804312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:11.804312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:11.804312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:11.804312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:11.804312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:11.804312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:11.804312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:11.804312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:11.804312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:11.805282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:11.806218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:11.806218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:11.806218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:11.806218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:11.806218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 371/762] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:11.812552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d8fcc-775b-4c28-8e6c-660bd0555316 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:11.923323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d8fcc-775b-4c28-8e6c-660bd0555316 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:11.960698 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd410e7d-80cd-4a68-9ddd-ec9385f2de6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:11.961754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd410e7d-80cd-4a68-9ddd-ec9385f2de6b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:11.962315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd410e7d-80cd-4a68-9ddd-ec9385f2de6b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:11.962835 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd410e7d-80cd-4a68-9ddd-ec9385f2de6b None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:11.963771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd410e7d-80cd-4a68-9ddd-ec9385f2de6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:11.964298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd410e7d-80cd-4a68-9ddd-ec9385f2de6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:11.966481 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd410e7d-80cd-4a68-9ddd-ec9385f2de6b None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:11.979215 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 392/763] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:11.984920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783d281-b725-42a8-bebd-83f8880bccac None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:12.111832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783d281-b725-42a8-bebd-83f8880bccac None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:12.146308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1cfa1-49c8-47d4-91cf-f62523f06694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:12.147102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1cfa1-49c8-47d4-91cf-f62523f06694 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:12.147379 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1cfa1-49c8-47d4-91cf-f62523f06694 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:12.147651 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1cfa1-49c8-47d4-91cf-f62523f06694 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:12.155110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1cfa1-49c8-47d4-91cf-f62523f06694 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:12.156765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1cfa1-49c8-47d4-91cf-f62523f06694 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:12.159352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:12.173947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-23a1cfa1-49c8-47d4-91cf-f62523f06694 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:12.173947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:12.173947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:12.173947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:12.173947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:12.173947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:12.173947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:12.173947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:12.173947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:12.173947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:12.173947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:12.173947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:12.173947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:12.173947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:12.173947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:12.175095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:12.176138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:12.176138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:12.176138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:12.176138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:12.176138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:12.176138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:12.176138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:12.176138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:12.182011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 372/764] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:12.188203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd410e7d-80cd-4a68-9ddd-ec9385f2de6b None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:12.211431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:12.237790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876b7ad-92b3-4e13-aba7-da1fcc5d513d None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:12.238064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876b7ad-92b3-4e13-aba7-da1fcc5d513d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:12.238329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876b7ad-92b3-4e13-aba7-da1fcc5d513d None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:12.239935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 373/765] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:38:12.254408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8207176-3cec-443c-83b0-d0aa81c6a09d None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:12.254828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8207176-3cec-443c-83b0-d0aa81c6a09d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:12.255223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8207176-3cec-443c-83b0-d0aa81c6a09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:12.279135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-c8207176-3cec-443c-83b0-d0aa81c6a09d None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:12.280327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-c8207176-3cec-443c-83b0-d0aa81c6a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:12.376339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd410e7d-80cd-4a68-9ddd-ec9385f2de6b None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:12.416801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 374/766] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:12.428307 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75217e-d903-4ba9-8e1e-b65df1264dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:12.428990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75217e-d903-4ba9-8e1e-b65df1264dfc None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:12.429280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75217e-d903-4ba9-8e1e-b65df1264dfc None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:12.429534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75217e-d903-4ba9-8e1e-b65df1264dfc None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:12.430323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75217e-d903-4ba9-8e1e-b65df1264dfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:12.430627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75217e-d903-4ba9-8e1e-b65df1264dfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:12.432076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75217e-d903-4ba9-8e1e-b65df1264dfc None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:12.445136 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 393/767] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:12.453650 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8207176-3cec-443c-83b0-d0aa81c6a09d None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:12.462386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75217e-d903-4ba9-8e1e-b65df1264dfc None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:12.612095 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:12.625322 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8207176-3cec-443c-83b0-d0aa81c6a09d None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:12.669012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:12.673250 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75217e-d903-4ba9-8e1e-b65df1264dfc None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:12.677935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005018e9-42dc-4695-af9c-e94c7e374ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:12.683115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005018e9-42dc-4695-af9c-e94c7e374ff8 None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:12.683115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005018e9-42dc-4695-af9c-e94c7e374ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:12.683115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005018e9-42dc-4695-af9c-e94c7e374ff8 None admin] PATH_INFO: `/v3/projects/af4d24603fa24a62946a57fabb774756/users/08529776af224c36ab560c13f5941e0a/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:12.686071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005018e9-42dc-4695-af9c-e94c7e374ff8 None admin] RBAC: Authorizing `identity:create_grant(project_id=af4d24603fa24a62946a57fabb774756, user_id=08529776af224c36ab560c13f5941e0a, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:12.687531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005018e9-42dc-4695-af9c-e94c7e374ff8 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:12.722368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d933cfe-4191-45c8-9e89-37bd2b6cb966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:12.723195 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d933cfe-4191-45c8-9e89-37bd2b6cb966 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:12.723524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d933cfe-4191-45c8-9e89-37bd2b6cb966 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:12.723806 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d933cfe-4191-45c8-9e89-37bd2b6cb966 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:12.724604 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d933cfe-4191-45c8-9e89-37bd2b6cb966 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:12.726059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d933cfe-4191-45c8-9e89-37bd2b6cb966 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:12.748112 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 375/768] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:38:12 2022] PUT /identity/v3/projects/af4d24603fa24a62946a57fabb774756/users/08529776af224c36ab560c13f5941e0a/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-6d933cfe-4191-45c8-9e89-37bd2b6cb966 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:12.749577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:12.750490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:12.751374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 394/769] 10.222.0.44 () {56 vars in 1129 bytes} [Mon Jun 27 14:38:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:12.762406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005018e9-42dc-4695-af9c-e94c7e374ff8 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:12.802697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c839df-73c2-4e9f-ab4a-507f750a4538 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:12.802993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c839df-73c2-4e9f-ab4a-507f750a4538 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:12.803331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c839df-73c2-4e9f-ab4a-507f750a4538 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:12.804812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 395/770] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:12.812991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d20840-a36c-4c50-be3f-05ab561feab1 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:12.813323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d20840-a36c-4c50-be3f-05ab561feab1 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:12.813554 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d20840-a36c-4c50-be3f-05ab561feab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:12.845815 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-51d20840-a36c-4c50-be3f-05ab561feab1 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:12.847055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-51d20840-a36c-4c50-be3f-05ab561feab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:12.894401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005018e9-42dc-4695-af9c-e94c7e374ff8 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:12.936884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba537d8c-63fe-43cf-b070-adf04d035691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:12.937692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba537d8c-63fe-43cf-b070-adf04d035691 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:12.937982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba537d8c-63fe-43cf-b070-adf04d035691 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:12.938263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba537d8c-63fe-43cf-b070-adf04d035691 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:12.938987 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba537d8c-63fe-43cf-b070-adf04d035691 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:12.939296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba537d8c-63fe-43cf-b070-adf04d035691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:12.941398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba537d8c-63fe-43cf-b070-adf04d035691 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:12.980593 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 376/771] 10.222.0.44 () {56 vars in 1124 bytes} [Mon Jun 27 14:38:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:12.986161 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba537d8c-63fe-43cf-b070-adf04d035691 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:12.990057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 396/772] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 14:38:13.018565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d20840-a36c-4c50-be3f-05ab561feab1 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:13.051028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:13.104044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba537d8c-63fe-43cf-b070-adf04d035691 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:13.111771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:13.151837 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afef60-c6bd-49c0-ba5e-592d96fb1a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:13.153552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afef60-c6bd-49c0-ba5e-592d96fb1a34 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:13.153835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afef60-c6bd-49c0-ba5e-592d96fb1a34 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:13.154109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afef60-c6bd-49c0-ba5e-592d96fb1a34 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:13.154822 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afef60-c6bd-49c0-ba5e-592d96fb1a34 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:13.155124 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afef60-c6bd-49c0-ba5e-592d96fb1a34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:13.157789 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afef60-c6bd-49c0-ba5e-592d96fb1a34 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:13.162990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d20840-a36c-4c50-be3f-05ab561feab1 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:13.176412 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 377/773] 10.222.0.44 () {56 vars in 1124 bytes} [Mon Jun 27 14:38:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:13.177717 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b6b8b-ef6c-4d78-b7fc-fa56c1e15501 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:13.178002 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b6b8b-ef6c-4d78-b7fc-fa56c1e15501 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:13.178272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b6b8b-ef6c-4d78-b7fc-fa56c1e15501 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:13.179685 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 378/774] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:13.180589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b6b8b-ef6c-4d78-b7fc-fa56c1e15501 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:13.212928 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdfb56-d7a2-4c90-bcfe-12ea9745adab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:13.213931 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdfb56-d7a2-4c90-bcfe-12ea9745adab None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:13.214236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdfb56-d7a2-4c90-bcfe-12ea9745adab None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:13.214514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdfb56-d7a2-4c90-bcfe-12ea9745adab None admin] PATH_INFO: `/v3/services/network` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:13.215798 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdfb56-d7a2-4c90-bcfe-12ea9745adab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:13.217547 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdfb56-d7a2-4c90-bcfe-12ea9745adab None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-c7fdfb56-d7a2-4c90-bcfe-12ea9745adab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:13.233086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:13.234148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:13.234991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:13.234991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:13.234991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:13.234991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:13.234991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:13.234991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:13.234991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:13.234991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:13.234991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:13.234991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:13.234991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:13.234991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:13.234991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 14:38:13.234991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:13.239299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 397/775] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:13 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:13.240565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9161bc-aa81-40a7-8f2f-011d317c6ef3 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:13.240894 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9161bc-aa81-40a7-8f2f-011d317c6ef3 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:13.241174 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9161bc-aa81-40a7-8f2f-011d317c6ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:13.264113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-7d9161bc-aa81-40a7-8f2f-011d317c6ef3 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:13.265946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7d9161bc-aa81-40a7-8f2f-011d317c6ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:13.317520 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b6b8b-ef6c-4d78-b7fc-fa56c1e15501 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:13.340374 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:13.358049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142efd97-9f03-4b1a-9558-0506670cfe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:13.359259 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142efd97-9f03-4b1a-9558-0506670cfe00 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:13.359763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142efd97-9f03-4b1a-9558-0506670cfe00 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:13.368664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 398/776] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:13.368664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9161bc-aa81-40a7-8f2f-011d317c6ef3 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:13.369142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142efd97-9f03-4b1a-9558-0506670cfe00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:13.370246 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142efd97-9f03-4b1a-9558-0506670cfe00 None admin] RBAC: Adding query filter params (interface=public, service_id=db6a2aae6e374cc881d12f8cb31c2a6b, region_id=RegionOne) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:13.370784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142efd97-9f03-4b1a-9558-0506670cfe00 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:13.372520 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142efd97-9f03-4b1a-9558-0506670cfe00 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:13.384740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 379/777] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Jun 27 14:38:13 2022] GET /identity/v3/endpoints?service_id=db6a2aae6e374cc881d12f8cb31c2a6b&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:13.392502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142efd97-9f03-4b1a-9558-0506670cfe00 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:13.437734 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:13.479171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9161bc-aa81-40a7-8f2f-011d317c6ef3 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:13.499360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142efd97-9f03-4b1a-9558-0506670cfe00 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:13.516128 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b9148-f097-4d14-a95f-02f1fcd98e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:13.517107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b9148-f097-4d14-a95f-02f1fcd98e4c None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:13.517602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b9148-f097-4d14-a95f-02f1fcd98e4c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:13.518022 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b9148-f097-4d14-a95f-02f1fcd98e4c None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:13.518877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b9148-f097-4d14-a95f-02f1fcd98e4c None admin] RBAC: Adding query filter params (name=network) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:13.519326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b9148-f097-4d14-a95f-02f1fcd98e4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:13.520847 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b9148-f097-4d14-a95f-02f1fcd98e4c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:13.526384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 399/778] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Jun 27 14:38:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:13.527990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b9148-f097-4d14-a95f-02f1fcd98e4c None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:13.539522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da98a9-0ef6-4543-aff5-aac8958669b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:13.540187 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da98a9-0ef6-4543-aff5-aac8958669b8 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:13.540465 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da98a9-0ef6-4543-aff5-aac8958669b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:13.540782 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da98a9-0ef6-4543-aff5-aac8958669b8 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:13.541466 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da98a9-0ef6-4543-aff5-aac8958669b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:13.543117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da98a9-0ef6-4543-aff5-aac8958669b8 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:13.556240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 380/779] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Jun 27 14:38:13 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:13.556240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da98a9-0ef6-4543-aff5-aac8958669b8 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:13.607356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:13.652939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b9148-f097-4d14-a95f-02f1fcd98e4c None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:13.666081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da98a9-0ef6-4543-aff5-aac8958669b8 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:13.685581 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:13.695933 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec59e87-bcfc-484d-8e17-1b9d559fdeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:13.697201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec59e87-bcfc-484d-8e17-1b9d559fdeda None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:13.697656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec59e87-bcfc-484d-8e17-1b9d559fdeda None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:13.698225 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec59e87-bcfc-484d-8e17-1b9d559fdeda None admin] PATH_INFO: `/v3/roles/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:13.713087 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec59e87-bcfc-484d-8e17-1b9d559fdeda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-6ec59e87-bcfc-484d-8e17-1b9d559fdeda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:13.722930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:13.723995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:13.724919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:13.724919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:13.724919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:13.724919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:13.724919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:13.724919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:13.724919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:13.724919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:13.724919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:13.724919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:13.724919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:38:13.724919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:13.727902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 400/780] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:38:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:13.733693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec59e87-bcfc-484d-8e17-1b9d559fdeda None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:13.741442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca542c-6ec3-466d-88c4-b5dd7b21bbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:13.742140 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca542c-6ec3-466d-88c4-b5dd7b21bbab None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:13.742428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca542c-6ec3-466d-88c4-b5dd7b21bbab None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:13.742706 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca542c-6ec3-466d-88c4-b5dd7b21bbab None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:13.743444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca542c-6ec3-466d-88c4-b5dd7b21bbab None admin] RBAC: Adding query filter params (type=network) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:13.743755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca542c-6ec3-466d-88c4-b5dd7b21bbab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:13.745198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca542c-6ec3-466d-88c4-b5dd7b21bbab None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:13.753760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 381/781] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Jun 27 14:38:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:13.755583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff32ac-4ab3-4dad-8724-3fb7ef9a2097 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:13.756012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff32ac-4ab3-4dad-8724-3fb7ef9a2097 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:13.756420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff32ac-4ab3-4dad-8724-3fb7ef9a2097 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:13.762771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 382/782] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:13.763994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff32ac-4ab3-4dad-8724-3fb7ef9a2097 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:13.861288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec59e87-bcfc-484d-8e17-1b9d559fdeda None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:13.897995 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff32ac-4ab3-4dad-8724-3fb7ef9a2097 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:13.904032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdf0fa-66c8-4e2c-b66c-4bddc59e3740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:13.904735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdf0fa-66c8-4e2c-b66c-4bddc59e3740 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:13.905020 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdf0fa-66c8-4e2c-b66c-4bddc59e3740 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:13.905291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdf0fa-66c8-4e2c-b66c-4bddc59e3740 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:13.906038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdf0fa-66c8-4e2c-b66c-4bddc59e3740 None admin] RBAC: Adding query filter params (name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:13.906339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdf0fa-66c8-4e2c-b66c-4bddc59e3740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:13.907687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdf0fa-66c8-4e2c-b66c-4bddc59e3740 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:13.912190 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:13.919575 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 401/783] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:38:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:13.921141 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ae15c-9d9e-45d0-bfe8-5fc11005bdf7 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:13.921734 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ae15c-9d9e-45d0-bfe8-5fc11005bdf7 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:13.922021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ae15c-9d9e-45d0-bfe8-5fc11005bdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:13.943438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-8f6ae15c-9d9e-45d0-bfe8-5fc11005bdf7 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:13.944265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8820ec-6de5-4842-9352-cf6c64799823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:13.944618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-8f6ae15c-9d9e-45d0-bfe8-5fc11005bdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:13.945154 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8820ec-6de5-4842-9352-cf6c64799823 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:13.945539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8820ec-6de5-4842-9352-cf6c64799823 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:13.945986 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8820ec-6de5-4842-9352-cf6c64799823 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:13.947181 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8820ec-6de5-4842-9352-cf6c64799823 None admin] RBAC: Adding query filter params (interface=public, service_id=ee199e61fbd84bca8e05067480324a6b, region_id=RegionOne) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:13.948779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8820ec-6de5-4842-9352-cf6c64799823 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:13.950633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8820ec-6de5-4842-9352-cf6c64799823 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:13.959245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 383/784] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Jun 27 14:38:13 2022] GET /identity/v3/endpoints?service_id=ee199e61fbd84bca8e05067480324a6b&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:13.960494 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8820ec-6de5-4842-9352-cf6c64799823 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:14.000797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:14.032738 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 402/785] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:14.033941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ae15c-9d9e-45d0-bfe8-5fc11005bdf7 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:14.114451 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8820ec-6de5-4842-9352-cf6c64799823 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:14.150723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a34db-02da-4dcc-bbe0-10a63930fa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:14.151542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a34db-02da-4dcc-bbe0-10a63930fa13 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:14.151826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a34db-02da-4dcc-bbe0-10a63930fa13 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:14.152141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a34db-02da-4dcc-bbe0-10a63930fa13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:14.166162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a34db-02da-4dcc-bbe0-10a63930fa13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:14.166835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a34db-02da-4dcc-bbe0-10a63930fa13 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:14.173761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ae15c-9d9e-45d0-bfe8-5fc11005bdf7 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:14.186801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-a76a34db-02da-4dcc-bbe0-10a63930fa13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:14.186801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:14.186801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:14.186801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:14.186801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:14.186801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:14.186801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:14.186801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:14.186801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:14.186801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:14.186801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:14.186801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:14.186801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:14.186801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:14.186801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:14.187784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:14.189352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:14.189352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:14.189352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:14.189352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:14.189352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 384/786] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:14.189352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a34db-02da-4dcc-bbe0-10a63930fa13 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:14.218101 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:14.219370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfee57-56f2-4c86-9330-5c5e8b61c865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:14.220373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfee57-56f2-4c86-9330-5c5e8b61c865 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:14.220903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfee57-56f2-4c86-9330-5c5e8b61c865 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:14.221404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfee57-56f2-4c86-9330-5c5e8b61c865 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:14.222305 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfee57-56f2-4c86-9330-5c5e8b61c865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:14.223883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfee57-56f2-4c86-9330-5c5e8b61c865 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:14.229974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 403/787] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Jun 27 14:38:14 2022] GET /identity/v3/services => generated 772 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:14.235117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfee57-56f2-4c86-9330-5c5e8b61c865 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:14.305096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:14.345272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a34db-02da-4dcc-bbe0-10a63930fa13 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:14.352321 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfee57-56f2-4c86-9330-5c5e8b61c865 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:14.393413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fa58d-479d-4d96-a044-1e1255ed1755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:14.394243 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fa58d-479d-4d96-a044-1e1255ed1755 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:14.394637 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fa58d-479d-4d96-a044-1e1255ed1755 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:14.395021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fa58d-479d-4d96-a044-1e1255ed1755 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:14.395867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fa58d-479d-4d96-a044-1e1255ed1755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:14.396282 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fa58d-479d-4d96-a044-1e1255ed1755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:14.397911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fa58d-479d-4d96-a044-1e1255ed1755 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:14.411571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 404/788] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:14.416865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fa58d-479d-4d96-a044-1e1255ed1755 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:14.417392 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f266fea-42bf-43d9-a356-461ce6e158a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:14.418724 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f266fea-42bf-43d9-a356-461ce6e158a6 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:14.419003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f266fea-42bf-43d9-a356-461ce6e158a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:14.419277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f266fea-42bf-43d9-a356-461ce6e158a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:14.432687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f266fea-42bf-43d9-a356-461ce6e158a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-7f266fea-42bf-43d9-a356-461ce6e158a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:14.441401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:14.442329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:14.443179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:14.443179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:14.443179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:14.443179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:14.443179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:14.443179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:14.443179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:14.443179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:14.443179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:14.443179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:14.443179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:14.443179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:14.443179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 385/789] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:38:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:14.453590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f266fea-42bf-43d9-a356-461ce6e158a6 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:14.551001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fa58d-479d-4d96-a044-1e1255ed1755 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:14.552612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:14.601158 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:14.616606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f266fea-42bf-43d9-a356-461ce6e158a6 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:14.618293 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aa4af-3ac2-4041-9f8a-a63b23ddfbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:14.619418 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aa4af-3ac2-4041-9f8a-a63b23ddfbcb None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:14.619897 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aa4af-3ac2-4041-9f8a-a63b23ddfbcb None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:14.620366 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aa4af-3ac2-4041-9f8a-a63b23ddfbcb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:14.634445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7aa4af-3ac2-4041-9f8a-a63b23ddfbcb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:14.635888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7aa4af-3ac2-4041-9f8a-a63b23ddfbcb None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-5c7aa4af-3ac2-4041-9f8a-a63b23ddfbcb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:14.661202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:14.662678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:14.663633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:14.663633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:14.663633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:14.663633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:14.663633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:14.663633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:14.663633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:14.663633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:14.663633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 14:38:14.663633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:14.663633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 405/790] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Jun 27 14:38:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:14.671200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aa4af-3ac2-4041-9f8a-a63b23ddfbcb None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:14.685947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebed58-941b-4fc8-9ea5-371fe05d56ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:14.686598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebed58-941b-4fc8-9ea5-371fe05d56ca None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:14.686883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebed58-941b-4fc8-9ea5-371fe05d56ca None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:14.687156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebed58-941b-4fc8-9ea5-371fe05d56ca None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:14.687913 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebed58-941b-4fc8-9ea5-371fe05d56ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:14.688217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebed58-941b-4fc8-9ea5-371fe05d56ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:14.689612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebed58-941b-4fc8-9ea5-371fe05d56ca None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:14.706003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 386/791] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:14.711795 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebed58-941b-4fc8-9ea5-371fe05d56ca None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:14.874847 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aa4af-3ac2-4041-9f8a-a63b23ddfbcb None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:14.935302 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebed58-941b-4fc8-9ea5-371fe05d56ca None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:14.971557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423d501-1932-4496-86c8-9d21572ee5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:14.972980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423d501-1932-4496-86c8-9d21572ee5d9 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:14.973629 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423d501-1932-4496-86c8-9d21572ee5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:14.974203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423d501-1932-4496-86c8-9d21572ee5d9 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:14.976048 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423d501-1932-4496-86c8-9d21572ee5d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:14.976771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423d501-1932-4496-86c8-9d21572ee5d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:14.980310 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423d501-1932-4496-86c8-9d21572ee5d9 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:15.018811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 406/792] 10.222.0.44 () {56 vars in 1149 bytes} [Mon Jun 27 14:38:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:15.025921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423d501-1932-4496-86c8-9d21572ee5d9 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:15.031841 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae870e35-380b-4984-995a-69fae021ae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:15.033217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae870e35-380b-4984-995a-69fae021ae9c None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:15.035071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae870e35-380b-4984-995a-69fae021ae9c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:15.035531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae870e35-380b-4984-995a-69fae021ae9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:15.072826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae870e35-380b-4984-995a-69fae021ae9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:15.079277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae870e35-380b-4984-995a-69fae021ae9c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:15.098895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:15.101490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:15.116043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-ae870e35-380b-4984-995a-69fae021ae9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:15.116043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:15.116043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:15.116043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:15.116043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:15.116043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:15.116043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:15.116043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:15.116043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:15.116043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:15.116043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:15.116043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:15.116043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:15.116043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:15.116043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:15.116991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:15.117899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:15.117899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:15.117899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:15.117899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:15.117899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 387/793] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:15.128693 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae870e35-380b-4984-995a-69fae021ae9c None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:15.243126 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423d501-1932-4496-86c8-9d21572ee5d9 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:15.278604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae870e35-380b-4984-995a-69fae021ae9c None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:15.288357 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f02e54-a4db-4906-a106-2d88770ea38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:15.289586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f02e54-a4db-4906-a106-2d88770ea38c None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:15.290072 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f02e54-a4db-4906-a106-2d88770ea38c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:15.290558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f02e54-a4db-4906-a106-2d88770ea38c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:15.302218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f02e54-a4db-4906-a106-2d88770ea38c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:15.303956 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f02e54-a4db-4906-a106-2d88770ea38c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:15.314109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b9b30-d56e-431e-96a0-35299edaff58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:15.314776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b9b30-d56e-431e-96a0-35299edaff58 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:15.315058 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b9b30-d56e-431e-96a0-35299edaff58 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:15.315374 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b9b30-d56e-431e-96a0-35299edaff58 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:15.316044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b9b30-d56e-431e-96a0-35299edaff58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:15.316349 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b9b30-d56e-431e-96a0-35299edaff58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:15.317724 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b9b30-d56e-431e-96a0-35299edaff58 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:15.325371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-c5f02e54-a4db-4906-a106-2d88770ea38c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:15.325371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:15.325371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:15.325371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:15.325371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:15.325371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:15.325371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:15.325371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:15.325371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:15.325371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:15.325371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:15.325371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:15.325371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:15.325371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:15.325371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:15.326246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:15.327138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:15.327138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:15.327138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:15.327138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:15.329503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 407/794] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:15.330743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 388/795] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:15.331259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ca7cf-1f49-47f8-a325-28d364cfea7d None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:15.331545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ca7cf-1f49-47f8-a325-28d364cfea7d None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:15.331875 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ca7cf-1f49-47f8-a325-28d364cfea7d None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:15.340695 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 408/796] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:15.340825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b9b30-d56e-431e-96a0-35299edaff58 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:15.340926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ca7cf-1f49-47f8-a325-28d364cfea7d None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:15.412145 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:15.437151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:15.463582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b9b30-d56e-431e-96a0-35299edaff58 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:15.478468 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ca7cf-1f49-47f8-a325-28d364cfea7d None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:15.506845 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0f47d-7d90-46b5-9ad2-7a9361a7a306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:15.507707 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0f47d-7d90-46b5-9ad2-7a9361a7a306 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:15.507889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0f47d-7d90-46b5-9ad2-7a9361a7a306 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:15.508155 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0f47d-7d90-46b5-9ad2-7a9361a7a306 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:15.508949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0f47d-7d90-46b5-9ad2-7a9361a7a306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:15.509316 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0f47d-7d90-46b5-9ad2-7a9361a7a306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:15.510706 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0f47d-7d90-46b5-9ad2-7a9361a7a306 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:15.517032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057643bb-1030-4793-a611-f1871995aa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:15.518064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057643bb-1030-4793-a611-f1871995aa8f None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:15.518521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057643bb-1030-4793-a611-f1871995aa8f None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:15.518968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057643bb-1030-4793-a611-f1871995aa8f None admin] PATH_INFO: `/v3/users/swift` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:15.528621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 389/797] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:15.528621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5440e-dcf6-4a0a-9b65-1fa4971a3eb2 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:15.528621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5440e-dcf6-4a0a-9b65-1fa4971a3eb2 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:15.528621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5440e-dcf6-4a0a-9b65-1fa4971a3eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:15.532471 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057643bb-1030-4793-a611-f1871995aa8f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:15.534136 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057643bb-1030-4793-a611-f1871995aa8f None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:15.544637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-8ee5440e-dcf6-4a0a-9b65-1fa4971a3eb2 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:15.545856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8ee5440e-dcf6-4a0a-9b65-1fa4971a3eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-057643bb-1030-4793-a611-f1871995aa8f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:15.549546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:15.550447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:15.551382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:15.551382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:15.551382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:15.551382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:15.551382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:15.551382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:15.551382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:15.551382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:15.551382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 14:38:15.551382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:15.559223 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 409/798] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:38:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:15.560283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057643bb-1030-4793-a611-f1871995aa8f None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:15.628695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 390/799] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:15.628695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5440e-dcf6-4a0a-9b65-1fa4971a3eb2 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:15.717466 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057643bb-1030-4793-a611-f1871995aa8f None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:15.758991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:15.766158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e0632-3fdb-4c35-a04a-d4c30d789ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:15.767071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e0632-3fdb-4c35-a04a-d4c30d789ffe None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:15.767430 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e0632-3fdb-4c35-a04a-d4c30d789ffe None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:15.767781 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e0632-3fdb-4c35-a04a-d4c30d789ffe None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:15.775892 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e0632-3fdb-4c35-a04a-d4c30d789ffe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:15.779686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e0632-3fdb-4c35-a04a-d4c30d789ffe None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:15.798576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-273e0632-3fdb-4c35-a04a-d4c30d789ffe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:15.798576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:15.798576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:15.798576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:15.798576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:15.798576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:15.798576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:15.798576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:15.798576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:15.798576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:15.798576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:15.798576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:15.798576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:15.798576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:15.798576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:15.799716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:15.805486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:15.805486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:15.805486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:15.805486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:15.805486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:15.805486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:15.805486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:15.805486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:15.805486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 410/800] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:15.805486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e0632-3fdb-4c35-a04a-d4c30d789ffe None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:15.826600 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:15.885357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5440e-dcf6-4a0a-9b65-1fa4971a3eb2 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:15.925292 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da230d2-c13c-44cb-b644-744767f3aa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:15.926369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da230d2-c13c-44cb-b644-744767f3aa9c None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:15.926804 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da230d2-c13c-44cb-b644-744767f3aa9c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:15.927354 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da230d2-c13c-44cb-b644-744767f3aa9c None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:15.928356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da230d2-c13c-44cb-b644-744767f3aa9c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:15.928840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da230d2-c13c-44cb-b644-744767f3aa9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:15.930525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da230d2-c13c-44cb-b644-744767f3aa9c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:15.930647 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e0632-3fdb-4c35-a04a-d4c30d789ffe None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:15.950916 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 391/801] 10.222.0.44 () {56 vars in 1135 bytes} [Mon Jun 27 14:38:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:15.951991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da230d2-c13c-44cb-b644-744767f3aa9c None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:15.978537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d98de-d595-4648-9986-a66eab78d053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:15.979349 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d98de-d595-4648-9986-a66eab78d053 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:15.979723 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d98de-d595-4648-9986-a66eab78d053 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:15.980058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d98de-d595-4648-9986-a66eab78d053 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:15.992207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d98de-d595-4648-9986-a66eab78d053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-3b1d98de-d595-4648-9986-a66eab78d053 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:16.004090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:16.005374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:16.006456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:16.006456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:16.006456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:16.006456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:16.006456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:16.006456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:16.006456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:16.006456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:16.006456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:16.006456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:16.006456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:16.006456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:16.013987 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 411/802] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:38:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:16.014994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d98de-d595-4648-9986-a66eab78d053 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:16.076880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:16.078501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da230d2-c13c-44cb-b644-744767f3aa9c None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:16.094412 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:16.126365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79d121-5867-4caa-8d85-e9ca891e04ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:16.127052 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79d121-5867-4caa-8d85-e9ca891e04ec None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:16.127324 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79d121-5867-4caa-8d85-e9ca891e04ec None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:16.127604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79d121-5867-4caa-8d85-e9ca891e04ec None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:16.128512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79d121-5867-4caa-8d85-e9ca891e04ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:16.128975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79d121-5867-4caa-8d85-e9ca891e04ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:16.130402 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79d121-5867-4caa-8d85-e9ca891e04ec None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:16.131915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d98de-d595-4648-9986-a66eab78d053 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:16.145349 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 392/803] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:16.146189 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79d121-5867-4caa-8d85-e9ca891e04ec None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:16.185454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455d033-f066-4364-8d2a-3a1a98118a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:16.186342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455d033-f066-4364-8d2a-3a1a98118a95 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:16.186631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455d033-f066-4364-8d2a-3a1a98118a95 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:16.186911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455d033-f066-4364-8d2a-3a1a98118a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:16.203036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455d033-f066-4364-8d2a-3a1a98118a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:16.205652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455d033-f066-4364-8d2a-3a1a98118a95 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:16.224809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-f455d033-f066-4364-8d2a-3a1a98118a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:16.224809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:16.224809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:16.224809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:16.224809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:16.224809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:16.224809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:16.224809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:16.224809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:16.224809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:16.224809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:16.224809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:16.224809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:16.224809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:16.224809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:16.225765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:16.226677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:16.226677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:16.226677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:16.226677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:16.226677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 412/804] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:16.227265 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209384df-e0b3-41a4-b243-6fc4f2263a45 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:16.227554 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209384df-e0b3-41a4-b243-6fc4f2263a45 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:16.227837 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209384df-e0b3-41a4-b243-6fc4f2263a45 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:16.229339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 413/805] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:16.229791 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209384df-e0b3-41a4-b243-6fc4f2263a45 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:16.266263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79d121-5867-4caa-8d85-e9ca891e04ec None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:16.303486 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ac774-09ff-4af4-9e51-6814e9fcabbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:16.304160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ac774-09ff-4af4-9e51-6814e9fcabbc None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:16.304461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ac774-09ff-4af4-9e51-6814e9fcabbc None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:16.304758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ac774-09ff-4af4-9e51-6814e9fcabbc None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:16.305525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ac774-09ff-4af4-9e51-6814e9fcabbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:16.305835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ac774-09ff-4af4-9e51-6814e9fcabbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:16.307194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ac774-09ff-4af4-9e51-6814e9fcabbc None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:16.318508 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 393/806] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:38:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:16.319360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ac774-09ff-4af4-9e51-6814e9fcabbc None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:16.353370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209384df-e0b3-41a4-b243-6fc4f2263a45 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:16.354939 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:16.358305 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:16.393049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ceedc-2760-42c5-8434-80d7c6f040c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:16.394040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ceedc-2760-42c5-8434-80d7c6f040c5 None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:16.394326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ceedc-2760-42c5-8434-80d7c6f040c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:16.394601 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ceedc-2760-42c5-8434-80d7c6f040c5 None admin] PATH_INFO: `/v3/projects/af4d24603fa24a62946a57fabb774756/users/d87edb187b2f4d6194cb7c94a3d690e6/roles/81973b552fbc46a4ad31c60d8f099564` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:16.410818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ceedc-2760-42c5-8434-80d7c6f040c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=af4d24603fa24a62946a57fabb774756, user_id=d87edb187b2f4d6194cb7c94a3d690e6, role_id=81973b552fbc46a4ad31c60d8f099564)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:16.412739 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ceedc-2760-42c5-8434-80d7c6f040c5 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:16.438256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ac774-09ff-4af4-9e51-6814e9fcabbc None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:16.473798 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc78427-5972-4bc9-a69b-5fa324aef3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:16.474462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc78427-5972-4bc9-a69b-5fa324aef3cc None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:16.474745 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc78427-5972-4bc9-a69b-5fa324aef3cc None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:16.475021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc78427-5972-4bc9-a69b-5fa324aef3cc None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:16.475759 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc78427-5972-4bc9-a69b-5fa324aef3cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:16.476048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc78427-5972-4bc9-a69b-5fa324aef3cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:16.477597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc78427-5972-4bc9-a69b-5fa324aef3cc None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:16.492786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 414/807] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:38:16 2022] PUT /identity/v3/projects/af4d24603fa24a62946a57fabb774756/users/d87edb187b2f4d6194cb7c94a3d690e6/roles/81973b552fbc46a4ad31c60d8f099564 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:38:16.492786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01251ee2-5443-45f3-b040-7890294509f0 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:16.492786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01251ee2-5443-45f3-b040-7890294509f0 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:16.492786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01251ee2-5443-45f3-b040-7890294509f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:16.493413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 394/808] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:16.493413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc78427-5972-4bc9-a69b-5fa324aef3cc None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:16.519129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-01251ee2-5443-45f3-b040-7890294509f0 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:16.520922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-01251ee2-5443-45f3-b040-7890294509f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:16.616272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:16.625111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 415/809] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:16.626100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01251ee2-5443-45f3-b040-7890294509f0 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:16.626901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc78427-5972-4bc9-a69b-5fa324aef3cc None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:16.672334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad51f60-f478-46b1-92c7-e82a0dcc0050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:16.673200 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad51f60-f478-46b1-92c7-e82a0dcc0050 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:16.673502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad51f60-f478-46b1-92c7-e82a0dcc0050 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:16.673776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad51f60-f478-46b1-92c7-e82a0dcc0050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:16.687115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad51f60-f478-46b1-92c7-e82a0dcc0050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:16.688573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad51f60-f478-46b1-92c7-e82a0dcc0050 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:16.708382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-dad51f60-f478-46b1-92c7-e82a0dcc0050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:16.708382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:16.708382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:16.708382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:16.708382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:16.708382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:16.708382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:16.708382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:16.708382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:16.708382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:16.708382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:16.708382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:16.708382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:16.708382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:16.708382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:16.709564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:16.710509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:16.710509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:16.710509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:16.710509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:16.710509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 395/810] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:16.710795 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad51f60-f478-46b1-92c7-e82a0dcc0050 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:16.756447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:16.774072 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01251ee2-5443-45f3-b040-7890294509f0 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:16.810108 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121b02c-d3fe-45fd-ba55-73b376d91d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:16.811201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121b02c-d3fe-45fd-ba55-73b376d91d93 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:16.811483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121b02c-d3fe-45fd-ba55-73b376d91d93 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:16.811754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121b02c-d3fe-45fd-ba55-73b376d91d93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:16.820668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121b02c-d3fe-45fd-ba55-73b376d91d93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:16.822875 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121b02c-d3fe-45fd-ba55-73b376d91d93 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:16.832343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad51f60-f478-46b1-92c7-e82a0dcc0050 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:16.841361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-9121b02c-d3fe-45fd-ba55-73b376d91d93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:16.841361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:16.841361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:16.841361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:16.841361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:16.841361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:16.841361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:16.841361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:16.841361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:16.841361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:16.841361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:16.841361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:16.841361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:16.841361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:16.841361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:16.842332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:16.843239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:16.843239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:16.843239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:16.843239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:16.843239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:16.843239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:16.843239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:16.843239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:16.846285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 416/811] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:16.847235 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121b02c-d3fe-45fd-ba55-73b376d91d93 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:16.871355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafd4f1-efd1-40fc-8c45-b723b346c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:16.872408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafd4f1-efd1-40fc-8c45-b723b346c731 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:16.872719 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafd4f1-efd1-40fc-8c45-b723b346c731 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:16.872998 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafd4f1-efd1-40fc-8c45-b723b346c731 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:16.873649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafd4f1-efd1-40fc-8c45-b723b346c731 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:16.875235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafd4f1-efd1-40fc-8c45-b723b346c731 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-3dafd4f1-efd1-40fc-8c45-b723b346c731 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:16.891368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:16.892388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:16.893920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 396/812] 10.222.0.44 () {56 vars in 1129 bytes} [Mon Jun 27 14:38:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:16.894835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287f3e4-2bda-4b2b-85c6-5dbed6fb0a66 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:16.895187 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287f3e4-2bda-4b2b-85c6-5dbed6fb0a66 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:16.895357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287f3e4-2bda-4b2b-85c6-5dbed6fb0a66 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:16.897439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 397/813] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:16.898126 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287f3e4-2bda-4b2b-85c6-5dbed6fb0a66 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:16.909814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:16.963218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121b02c-d3fe-45fd-ba55-73b376d91d93 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:16.997239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86100f-cda6-43e2-9a88-2284bdd39793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:16.997903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86100f-cda6-43e2-9a88-2284bdd39793 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:16.998185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86100f-cda6-43e2-9a88-2284bdd39793 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:16.998458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86100f-cda6-43e2-9a88-2284bdd39793 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:16.999193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86100f-cda6-43e2-9a88-2284bdd39793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:16.999499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86100f-cda6-43e2-9a88-2284bdd39793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:17.000879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86100f-cda6-43e2-9a88-2284bdd39793 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:17.012696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287f3e4-2bda-4b2b-85c6-5dbed6fb0a66 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:17.014346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 417/814] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:17.015046 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86100f-cda6-43e2-9a88-2284bdd39793 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:17.020165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:17.054126 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197a019-b819-4533-a593-e1bc42d690f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:17.054788 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197a019-b819-4533-a593-e1bc42d690f2 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:17.055068 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197a019-b819-4533-a593-e1bc42d690f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:17.055340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197a019-b819-4533-a593-e1bc42d690f2 None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:17.056153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197a019-b819-4533-a593-e1bc42d690f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:17.056475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197a019-b819-4533-a593-e1bc42d690f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:17.057903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197a019-b819-4533-a593-e1bc42d690f2 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:17.071094 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 398/815] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:17.072308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9bb70-0fb6-493f-a3fb-5f2807b2fbf9 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:17.072594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9bb70-0fb6-493f-a3fb-5f2807b2fbf9 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:17.072901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9bb70-0fb6-493f-a3fb-5f2807b2fbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:17.092179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-33c9bb70-0fb6-493f-a3fb-5f2807b2fbf9 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:17.093396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-33c9bb70-0fb6-493f-a3fb-5f2807b2fbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:17.135024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86100f-cda6-43e2-9a88-2284bdd39793 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:17.158399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:17.166174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 399/816] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:17.166969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9bb70-0fb6-493f-a3fb-5f2807b2fbf9 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:17.186889 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f9be7-d3de-4d26-b7cd-321fdc53a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:17.187887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f9be7-d3de-4d26-b7cd-321fdc53a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:17.188366 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f9be7-d3de-4d26-b7cd-321fdc53a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:17.189285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f9be7-d3de-4d26-b7cd-321fdc53a4c6 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:17.190497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f9be7-d3de-4d26-b7cd-321fdc53a4c6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:17.191006 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f9be7-d3de-4d26-b7cd-321fdc53a4c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:17.193321 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f9be7-d3de-4d26-b7cd-321fdc53a4c6 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:17.203762 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 418/817] 10.222.0.44 () {56 vars in 1124 bytes} [Mon Jun 27 14:38:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:17.203762 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f9be7-d3de-4d26-b7cd-321fdc53a4c6 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:17.275340 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:17.277087 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9bb70-0fb6-493f-a3fb-5f2807b2fbf9 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:17.311319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f9be7-d3de-4d26-b7cd-321fdc53a4c6 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:17.313176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25630bf5-8af8-4fc8-8f40-59d34d4b412e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:17.313962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25630bf5-8af8-4fc8-8f40-59d34d4b412e None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:17.314229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25630bf5-8af8-4fc8-8f40-59d34d4b412e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:17.314502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25630bf5-8af8-4fc8-8f40-59d34d4b412e None admin] PATH_INFO: `/v3/users/nova` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:17.321645 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25630bf5-8af8-4fc8-8f40-59d34d4b412e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:17.323062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25630bf5-8af8-4fc8-8f40-59d34d4b412e None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-25630bf5-8af8-4fc8-8f40-59d34d4b412e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:17.338245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:17.339233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:17.340226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:17.340226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:17.340226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:17.340226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:17.340226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:17.340226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:17.340226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:17.340226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:17.340226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:38:17.340226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:17.340226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 400/818] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Jun 27 14:38:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:17.340226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25630bf5-8af8-4fc8-8f40-59d34d4b412e None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:17.352533 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5351edf-8926-4817-9b4b-227a46bbc6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:17.353744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5351edf-8926-4817-9b4b-227a46bbc6b0 None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:17.354029 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5351edf-8926-4817-9b4b-227a46bbc6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:17.354304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5351edf-8926-4817-9b4b-227a46bbc6b0 None admin] PATH_INFO: `/v3/projects/af4d24603fa24a62946a57fabb774756/users/482c11dafd8541e28d50705f7651fd15/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:17.356921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5351edf-8926-4817-9b4b-227a46bbc6b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=af4d24603fa24a62946a57fabb774756, user_id=482c11dafd8541e28d50705f7651fd15, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:17.358455 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5351edf-8926-4817-9b4b-227a46bbc6b0 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:17.397600 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:17.436905 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 419/819] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:38:17 2022] PUT /identity/v3/projects/af4d24603fa24a62946a57fabb774756/users/482c11dafd8541e28d50705f7651fd15/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:38:17.437867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5351edf-8926-4817-9b4b-227a46bbc6b0 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:17.439438 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25630bf5-8af8-4fc8-8f40-59d34d4b412e None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:17.486877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb7766-f39c-4a5a-a65f-b66d2b92cb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:17.487889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb7766-f39c-4a5a-a65f-b66d2b92cb76 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:17.488170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb7766-f39c-4a5a-a65f-b66d2b92cb76 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:17.488441 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb7766-f39c-4a5a-a65f-b66d2b92cb76 None admin] PATH_INFO: `/v3/services/network` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:17.489176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb7766-f39c-4a5a-a65f-b66d2b92cb76 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:17.490866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb7766-f39c-4a5a-a65f-b66d2b92cb76 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-b9bb7766-f39c-4a5a-a65f-b66d2b92cb76 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:17.504887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:17.505969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:17.506801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:17.506801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:17.506801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:17.506801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:17.506801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:17.506801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:17.506801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:17.506801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:17.506801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:17.506801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:17.506801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:17.506801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:17.506801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 14:38:17.506801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:17.511310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 401/820] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:17 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:17.512908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb7766-f39c-4a5a-a65f-b66d2b92cb76 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:17.591604 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5351edf-8926-4817-9b4b-227a46bbc6b0 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:17.623397 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:17.634628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e2e98-0ec8-47f4-914d-00ebfda7a426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:17.637155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e2e98-0ec8-47f4-914d-00ebfda7a426 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:17.637155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e2e98-0ec8-47f4-914d-00ebfda7a426 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:17.637461 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e2e98-0ec8-47f4-914d-00ebfda7a426 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:17.638347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e2e98-0ec8-47f4-914d-00ebfda7a426 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:17.638657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e2e98-0ec8-47f4-914d-00ebfda7a426 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:17.639449 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb7766-f39c-4a5a-a65f-b66d2b92cb76 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:17.640013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e2e98-0ec8-47f4-914d-00ebfda7a426 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:17.646560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 420/821] 10.222.0.44 () {56 vars in 1124 bytes} [Mon Jun 27 14:38:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:17.648097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e2e98-0ec8-47f4-914d-00ebfda7a426 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:17.665805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:17.680131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6ad8e-ca4f-4ee4-bfc8-20137566611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:17.680866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6ad8e-ca4f-4ee4-bfc8-20137566611d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:17.681153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6ad8e-ca4f-4ee4-bfc8-20137566611d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:17.681479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6ad8e-ca4f-4ee4-bfc8-20137566611d None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:17.682388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6ad8e-ca4f-4ee4-bfc8-20137566611d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:17.682701 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6ad8e-ca4f-4ee4-bfc8-20137566611d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:17.684876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6ad8e-ca4f-4ee4-bfc8-20137566611d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:17.709280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 402/822] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Jun 27 14:38:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:17.709280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6ad8e-ca4f-4ee4-bfc8-20137566611d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:17.783321 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e2e98-0ec8-47f4-914d-00ebfda7a426 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:17.818485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6ad8e-ca4f-4ee4-bfc8-20137566611d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:17.821066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c557e15-038a-4bf6-a130-180955531757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:17.821993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c557e15-038a-4bf6-a130-180955531757 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:17.822395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c557e15-038a-4bf6-a130-180955531757 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:17.822770 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c557e15-038a-4bf6-a130-180955531757 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:17.824476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c557e15-038a-4bf6-a130-180955531757 None admin] RBAC: Adding query filter params (name=network) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:17.824919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c557e15-038a-4bf6-a130-180955531757 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:17.826387 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c557e15-038a-4bf6-a130-180955531757 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:17.831961 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 421/823] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Jun 27 14:38:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:17.832899 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c557e15-038a-4bf6-a130-180955531757 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:17.856945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797dcf1-fb46-4306-a677-b998a5434e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:17.857597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797dcf1-fb46-4306-a677-b998a5434e92 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:17.857938 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797dcf1-fb46-4306-a677-b998a5434e92 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:17.858218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797dcf1-fb46-4306-a677-b998a5434e92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:17.859075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797dcf1-fb46-4306-a677-b998a5434e92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:17.860485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797dcf1-fb46-4306-a677-b998a5434e92 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:17.897117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:17.942709 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c557e15-038a-4bf6-a130-180955531757 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:17.979863 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 403/824] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Jun 27 14:38:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:38:17.982065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797dcf1-fb46-4306-a677-b998a5434e92 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:17.986307 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b14cf8-c499-42c3-8600-d604f47e064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:17.986965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b14cf8-c499-42c3-8600-d604f47e064b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:17.987249 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b14cf8-c499-42c3-8600-d604f47e064b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:17.987525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b14cf8-c499-42c3-8600-d604f47e064b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:18.060287 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:18.118504 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b14cf8-c499-42c3-8600-d604f47e064b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:18.119955 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b14cf8-c499-42c3-8600-d604f47e064b None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:18.165533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797dcf1-fb46-4306-a677-b998a5434e92 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:18.178311 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:18.205346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba57015-e8bb-4062-be5c-fd56b4e6ddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:18.206062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba57015-e8bb-4062-be5c-fd56b4e6ddcb None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:18.206348 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba57015-e8bb-4062-be5c-fd56b4e6ddcb None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:18.206617 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba57015-e8bb-4062-be5c-fd56b4e6ddcb None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:18.207327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba57015-e8bb-4062-be5c-fd56b4e6ddcb None admin] RBAC: Adding query filter params (type=network) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:18.207629 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba57015-e8bb-4062-be5c-fd56b4e6ddcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:18.209508 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba57015-e8bb-4062-be5c-fd56b4e6ddcb None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:18.215678 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 404/825] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Jun 27 14:38:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:18.225761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba57015-e8bb-4062-be5c-fd56b4e6ddcb None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:18.237502 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 422/826] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:38:18.246053 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b14cf8-c499-42c3-8600-d604f47e064b None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:18.328250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:18.332456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba57015-e8bb-4062-be5c-fd56b4e6ddcb None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:18.355987 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b14cf8-c499-42c3-8600-d604f47e064b None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:18.372324 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bce47-9680-4086-938e-6df6cb87536d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:18.373120 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bce47-9680-4086-938e-6df6cb87536d None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:18.373586 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bce47-9680-4086-938e-6df6cb87536d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:18.374049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bce47-9680-4086-938e-6df6cb87536d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:18.375336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bce47-9680-4086-938e-6df6cb87536d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:18.377313 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bce47-9680-4086-938e-6df6cb87536d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:18.395961 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b89e93-b41f-4b68-bef9-58e5c6d7efea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:18.399832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89e93-b41f-4b68-bef9-58e5c6d7efea None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:18.399832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89e93-b41f-4b68-bef9-58e5c6d7efea None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:18.399832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89e93-b41f-4b68-bef9-58e5c6d7efea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:18.408713 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b89e93-b41f-4b68-bef9-58e5c6d7efea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:18.410177 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b89e93-b41f-4b68-bef9-58e5c6d7efea None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:18.431092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-c7b89e93-b41f-4b68-bef9-58e5c6d7efea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:18.431092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:18.431092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:18.431092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:18.431092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:18.431092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:18.431092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:18.431092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:18.431092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:18.431092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:18.431092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:18.431092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:18.431092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:18.431092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:18.431092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:18.441650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:18.443097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:18.443097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:18.443097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:18.443097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:18.443097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 423/827] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:18.443097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b89e93-b41f-4b68-bef9-58e5c6d7efea None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:18.443097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:18.474641 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 405/828] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Jun 27 14:38:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:38:18.574743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b89e93-b41f-4b68-bef9-58e5c6d7efea None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:18.617865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4d000-a3b3-4a71-beaf-7e3b634d11e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:18.618548 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4d000-a3b3-4a71-beaf-7e3b634d11e3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:18.618878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4d000-a3b3-4a71-beaf-7e3b634d11e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:18.619152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4d000-a3b3-4a71-beaf-7e3b634d11e3 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:18.619893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4d000-a3b3-4a71-beaf-7e3b634d11e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:18.620197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4d000-a3b3-4a71-beaf-7e3b634d11e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:18.622255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4d000-a3b3-4a71-beaf-7e3b634d11e3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:18.635420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 424/829] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:18.641741 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bce47-9680-4086-938e-6df6cb87536d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:18.707724 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb6184-e034-4df2-8236-c8e2a75f3148 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:18.708079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb6184-e034-4df2-8236-c8e2a75f3148 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:18.708270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb6184-e034-4df2-8236-c8e2a75f3148 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:18.709893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 425/830] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:38:18.715560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004f14f-dd40-4bc3-9939-428dfc57be78 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:18.715933 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004f14f-dd40-4bc3-9939-428dfc57be78 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:18.716135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004f14f-dd40-4bc3-9939-428dfc57be78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:18.733100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-e004f14f-dd40-4bc3-9939-428dfc57be78 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:18.734775 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e004f14f-dd40-4bc3-9939-428dfc57be78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:18.784155 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bce47-9680-4086-938e-6df6cb87536d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:18.809868 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 426/831] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 14:38:18.813175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:18.834004 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004f14f-dd40-4bc3-9939-428dfc57be78 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:18.854547 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9a185-b9b2-46e5-a764-021f7c422de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:18.855440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9a185-b9b2-46e5-a764-021f7c422de7 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:18.855729 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9a185-b9b2-46e5-a764-021f7c422de7 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:18.856006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9a185-b9b2-46e5-a764-021f7c422de7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:18.864280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9a185-b9b2-46e5-a764-021f7c422de7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:18.865811 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9a185-b9b2-46e5-a764-021f7c422de7 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:18.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-95e9a185-b9b2-46e5-a764-021f7c422de7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:18.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:18.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:18.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:18.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:18.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:18.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:18.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:18.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:18.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:18.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:18.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:18.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:18.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:18.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:18.884911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:18.885850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:18.885850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:18.885850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:18.885850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:18.885850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:18.885850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:18.885850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:18.885850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:18.889520 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 406/832] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:18.895812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9a185-b9b2-46e5-a764-021f7c422de7 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:18.913066 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:18.967032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004f14f-dd40-4bc3-9939-428dfc57be78 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:19.017876 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6852271-a578-4bb5-8cd9-f2dab70f82cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:19.018711 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6852271-a578-4bb5-8cd9-f2dab70f82cc None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:19.018993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6852271-a578-4bb5-8cd9-f2dab70f82cc None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:19.019271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6852271-a578-4bb5-8cd9-f2dab70f82cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:19.028930 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9a185-b9b2-46e5-a764-021f7c422de7 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:19.035568 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6852271-a578-4bb5-8cd9-f2dab70f82cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-a6852271-a578-4bb5-8cd9-f2dab70f82cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:19.047066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:19.048014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:19.048917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:19.048917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:19.048917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:19.048917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:19.048917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:19.048917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:19.048917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:19.048917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:19.048917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:19.048917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:19.048917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:38:19.048917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:19.048917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 427/833] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:38:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:19.055702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6852271-a578-4bb5-8cd9-f2dab70f82cc None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:19.076281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc67bf1-e5b0-437b-ab13-12c59a5bb45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:19.076982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc67bf1-e5b0-437b-ab13-12c59a5bb45d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:19.077263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc67bf1-e5b0-437b-ab13-12c59a5bb45d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:19.077536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc67bf1-e5b0-437b-ab13-12c59a5bb45d None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:19.078430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc67bf1-e5b0-437b-ab13-12c59a5bb45d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:19.078748 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc67bf1-e5b0-437b-ab13-12c59a5bb45d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:19.080271 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc67bf1-e5b0-437b-ab13-12c59a5bb45d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:19.095421 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 407/834] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:19.108627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc67bf1-e5b0-437b-ab13-12c59a5bb45d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:19.121459 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:19.178925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6852271-a578-4bb5-8cd9-f2dab70f82cc None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:19.191818 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:19.216698 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d802a-80ed-4f4c-a7f5-8c0b02c4e017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:19.217636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d802a-80ed-4f4c-a7f5-8c0b02c4e017 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:19.218143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d802a-80ed-4f4c-a7f5-8c0b02c4e017 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:19.218602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d802a-80ed-4f4c-a7f5-8c0b02c4e017 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:19.219521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d802a-80ed-4f4c-a7f5-8c0b02c4e017 None admin] RBAC: Adding query filter params (name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:19.219830 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc67bf1-e5b0-437b-ab13-12c59a5bb45d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:19.220234 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d802a-80ed-4f4c-a7f5-8c0b02c4e017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:19.221797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d802a-80ed-4f4c-a7f5-8c0b02c4e017 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:19.234992 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 428/835] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:38:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:19.240658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d802a-80ed-4f4c-a7f5-8c0b02c4e017 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:19.264079 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd02677-b6cf-4d66-9e00-d588ad62484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:19.265130 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd02677-b6cf-4d66-9e00-d588ad62484b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:19.265610 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd02677-b6cf-4d66-9e00-d588ad62484b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:19.266128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd02677-b6cf-4d66-9e00-d588ad62484b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:19.267835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd02677-b6cf-4d66-9e00-d588ad62484b None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=08529776af224c36ab560c13f5941e0a) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:19.268367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd02677-b6cf-4d66-9e00-d588ad62484b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:19.270809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd02677-b6cf-4d66-9e00-d588ad62484b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:19.284870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 408/836] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:19 2022] GET /identity/v3/role_assignments?user.id=08529776af224c36ab560c13f5941e0a&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=6036efe96c1948fb98d01c8703a0561a => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:19.360775 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d802a-80ed-4f4c-a7f5-8c0b02c4e017 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:19.376012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:19.399262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0453ef-a47b-4a40-ad8c-239e4dc7e3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:19.400076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0453ef-a47b-4a40-ad8c-239e4dc7e3ea None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:19.400358 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0453ef-a47b-4a40-ad8c-239e4dc7e3ea None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:19.400700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0453ef-a47b-4a40-ad8c-239e4dc7e3ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:19.413696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0453ef-a47b-4a40-ad8c-239e4dc7e3ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:19.415157 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0453ef-a47b-4a40-ad8c-239e4dc7e3ea None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:19.434951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-5f0453ef-a47b-4a40-ad8c-239e4dc7e3ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:19.434951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:19.434951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:19.434951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:19.434951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:19.434951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:19.434951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:19.434951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:19.434951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:19.434951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:19.434951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:19.434951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:19.434951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:19.434951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:19.434951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:19.435867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:19.436786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:19.436786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:19.436786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:19.436786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:19.436786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 429/837] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:19.443206 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd02677-b6cf-4d66-9e00-d588ad62484b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:19.560699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd02677-b6cf-4d66-9e00-d588ad62484b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:19.595604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1815f-1b71-4c4c-b527-9d10ea3221b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:19.596268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1815f-1b71-4c4c-b527-9d10ea3221b0 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:19.596542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1815f-1b71-4c4c-b527-9d10ea3221b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:19.596849 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1815f-1b71-4c4c-b527-9d10ea3221b0 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:19.597574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1815f-1b71-4c4c-b527-9d10ea3221b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:19.597879 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1815f-1b71-4c4c-b527-9d10ea3221b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:19.599238 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1815f-1b71-4c4c-b527-9d10ea3221b0 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:19.607276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:19.613460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 409/838] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:19.618686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0453ef-a47b-4a40-ad8c-239e4dc7e3ea None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:19.726792 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0453ef-a47b-4a40-ad8c-239e4dc7e3ea None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:19.743731 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991db0a6-4033-4002-ac56-b2458eb153fe None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:19.744007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991db0a6-4033-4002-ac56-b2458eb153fe None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:19.744284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991db0a6-4033-4002-ac56-b2458eb153fe None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:19.747045 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 410/839] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:19.751197 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca862e73-2c58-495b-9eaf-a8b44b618e48 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:19.751406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca862e73-2c58-495b-9eaf-a8b44b618e48 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:19.751659 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca862e73-2c58-495b-9eaf-a8b44b618e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:19.765656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e658f7-0632-4072-83a8-9a57f6b5f55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:19.766806 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e658f7-0632-4072-83a8-9a57f6b5f55a None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:19.767295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e658f7-0632-4072-83a8-9a57f6b5f55a None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:19.767881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e658f7-0632-4072-83a8-9a57f6b5f55a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:19.768469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-ca862e73-2c58-495b-9eaf-a8b44b618e48 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:19.769752 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ca862e73-2c58-495b-9eaf-a8b44b618e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:19.778490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e658f7-0632-4072-83a8-9a57f6b5f55a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:19.780589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e658f7-0632-4072-83a8-9a57f6b5f55a None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-30e658f7-0632-4072-83a8-9a57f6b5f55a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:19.802270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:19.803286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:19.804206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:19.804206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:19.804206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:19.804206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:19.804206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:19.804206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:19.804206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:19.804206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:19.804206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 14:38:19.804206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:19.806305 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 430/840] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Jun 27 14:38:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:19.812481 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e658f7-0632-4072-83a8-9a57f6b5f55a None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:19.848997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:19.857282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 411/841] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 14:38:19.874038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca862e73-2c58-495b-9eaf-a8b44b618e48 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:19.937601 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e658f7-0632-4072-83a8-9a57f6b5f55a None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:19.976689 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca862e73-2c58-495b-9eaf-a8b44b618e48 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:19.983725 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd3e16-bd04-4dfe-a3f8-02bfeb4f1d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:19.984743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd3e16-bd04-4dfe-a3f8-02bfeb4f1d60 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:19.985223 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd3e16-bd04-4dfe-a3f8-02bfeb4f1d60 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:19.986140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd3e16-bd04-4dfe-a3f8-02bfeb4f1d60 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:19.987207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd3e16-bd04-4dfe-a3f8-02bfeb4f1d60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:19.988056 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd3e16-bd04-4dfe-a3f8-02bfeb4f1d60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:19.990285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd3e16-bd04-4dfe-a3f8-02bfeb4f1d60 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:20.005489 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:20.013497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 431/842] 10.222.0.44 () {56 vars in 1149 bytes} [Mon Jun 27 14:38:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:20.019002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd3e16-bd04-4dfe-a3f8-02bfeb4f1d60 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:20.022737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab776c32-3cde-4476-899b-1089c2e1f1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:20.023563 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab776c32-3cde-4476-899b-1089c2e1f1b9 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:20.023916 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab776c32-3cde-4476-899b-1089c2e1f1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:20.024937 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab776c32-3cde-4476-899b-1089c2e1f1b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:20.041780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab776c32-3cde-4476-899b-1089c2e1f1b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-ab776c32-3cde-4476-899b-1089c2e1f1b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:20.053205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:20.054137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:20.054982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:20.054982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:20.054982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:20.054982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:20.054982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:20.054982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:20.054982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:20.054982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:20.054982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:20.054982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:20.054982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:20.054982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:20.057932 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 412/843] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:38:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:20.064472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab776c32-3cde-4476-899b-1089c2e1f1b9 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:20.123699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:20.147789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd3e16-bd04-4dfe-a3f8-02bfeb4f1d60 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:20.180859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab776c32-3cde-4476-899b-1089c2e1f1b9 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:20.192986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d457d7-a569-4ebe-80c1-7e92ed0b5562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:20.193634 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d457d7-a569-4ebe-80c1-7e92ed0b5562 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:20.193937 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d457d7-a569-4ebe-80c1-7e92ed0b5562 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:20.194505 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d457d7-a569-4ebe-80c1-7e92ed0b5562 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:20.224059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e224682-b6fa-4f44-8022-3381e0a497e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:20.225168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e224682-b6fa-4f44-8022-3381e0a497e2 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:20.225655 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e224682-b6fa-4f44-8022-3381e0a497e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:20.226148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e224682-b6fa-4f44-8022-3381e0a497e2 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:20.227186 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e224682-b6fa-4f44-8022-3381e0a497e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:20.227778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e224682-b6fa-4f44-8022-3381e0a497e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:20.229347 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e224682-b6fa-4f44-8022-3381e0a497e2 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:20.243379 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 413/844] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:20.244928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e224682-b6fa-4f44-8022-3381e0a497e2 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:20.279137 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d457d7-a569-4ebe-80c1-7e92ed0b5562 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:20.281174 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d457d7-a569-4ebe-80c1-7e92ed0b5562 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:20.303417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:20.371616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:20.376043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e224682-b6fa-4f44-8022-3381e0a497e2 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:20.395338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 432/845] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:20 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:38:20.396246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d457d7-a569-4ebe-80c1-7e92ed0b5562 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:20.423513 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c6d05-44aa-4537-8225-a98d7a4b3f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:20.424300 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c6d05-44aa-4537-8225-a98d7a4b3f9b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:20.424577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c6d05-44aa-4537-8225-a98d7a4b3f9b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:20.424880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c6d05-44aa-4537-8225-a98d7a4b3f9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:20.436242 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c6d05-44aa-4537-8225-a98d7a4b3f9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:20.437695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c6d05-44aa-4537-8225-a98d7a4b3f9b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:20.456131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-c03c6d05-44aa-4537-8225-a98d7a4b3f9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:20.456131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:20.456131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:20.456131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:20.456131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:20.456131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:20.456131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:20.456131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:20.456131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:20.456131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:20.456131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:20.456131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:20.456131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:20.456131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:20.456131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:20.457118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:20.458012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:20.458012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:20.458012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:20.458012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:20.463175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 414/846] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:20.463676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c6d05-44aa-4537-8225-a98d7a4b3f9b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:20.526717 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d457d7-a569-4ebe-80c1-7e92ed0b5562 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:20.563523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4887690-4303-496c-8ea2-b43f769be864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:20.564382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4887690-4303-496c-8ea2-b43f769be864 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:20.564678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4887690-4303-496c-8ea2-b43f769be864 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:20.564962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4887690-4303-496c-8ea2-b43f769be864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:20.569560 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c6d05-44aa-4537-8225-a98d7a4b3f9b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:20.571486 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:20.577608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4887690-4303-496c-8ea2-b43f769be864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:20.579074 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4887690-4303-496c-8ea2-b43f769be864 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:20.597526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-e4887690-4303-496c-8ea2-b43f769be864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:20.597526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:20.597526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:20.597526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:20.597526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:20.597526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:20.597526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:20.597526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:20.597526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:20.597526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:20.597526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:20.597526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:20.597526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:20.597526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:20.597526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:20.598640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:20.599721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:20.599721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:20.599721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:20.599721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:20.603136 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 433/847] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:20.604462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b79109-1f6a-4c50-bbe0-15274b0da824 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:20.604773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b79109-1f6a-4c50-bbe0-15274b0da824 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:20.605264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b79109-1f6a-4c50-bbe0-15274b0da824 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:20.608745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 434/848] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:20.608745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b79109-1f6a-4c50-bbe0-15274b0da824 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:20.612444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9e040-263b-4f5c-bed2-a2ae992bfe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:20.613142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9e040-263b-4f5c-bed2-a2ae992bfe0c None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:20.613421 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9e040-263b-4f5c-bed2-a2ae992bfe0c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:20.613694 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9e040-263b-4f5c-bed2-a2ae992bfe0c None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:20.614420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9e040-263b-4f5c-bed2-a2ae992bfe0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:20.614722 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9e040-263b-4f5c-bed2-a2ae992bfe0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:20.616075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9e040-263b-4f5c-bed2-a2ae992bfe0c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:20.629244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 415/849] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:20.630477 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0a5c5-ac1b-4ecc-a64b-92dba4ab692e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:20.630763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0a5c5-ac1b-4ecc-a64b-92dba4ab692e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:20.631036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0a5c5-ac1b-4ecc-a64b-92dba4ab692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:20.648534 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-a6a0a5c5-ac1b-4ecc-a64b-92dba4ab692e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:20.649857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-a6a0a5c5-ac1b-4ecc-a64b-92dba4ab692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:20.655942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:20.726451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b79109-1f6a-4c50-bbe0-15274b0da824 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:20.728772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 416/850] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:20.729688 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0a5c5-ac1b-4ecc-a64b-92dba4ab692e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:20.764776 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cf6d3-d28f-4612-8849-f569d7cac152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:20.765439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cf6d3-d28f-4612-8849-f569d7cac152 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:20.765718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cf6d3-d28f-4612-8849-f569d7cac152 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:20.765996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cf6d3-d28f-4612-8849-f569d7cac152 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:20.766716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cf6d3-d28f-4612-8849-f569d7cac152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:20.767030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cf6d3-d28f-4612-8849-f569d7cac152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:20.768395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cf6d3-d28f-4612-8849-f569d7cac152 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:20.780822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 435/851] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:20.781546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cf6d3-d28f-4612-8849-f569d7cac152 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:20.833688 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:20.843821 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0a5c5-ac1b-4ecc-a64b-92dba4ab692e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:20.878558 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4925d-d4ce-4153-b2f6-f0feb73c3b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:20.879340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4925d-d4ce-4153-b2f6-f0feb73c3b9c None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:20.879621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4925d-d4ce-4153-b2f6-f0feb73c3b9c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:20.879894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4925d-d4ce-4153-b2f6-f0feb73c3b9c None admin] PATH_INFO: `/v3/users/swift` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:20.887684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4925d-d4ce-4153-b2f6-f0feb73c3b9c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:20.889205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4925d-d4ce-4153-b2f6-f0feb73c3b9c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:20.894845 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:20.898879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cf6d3-d28f-4612-8849-f569d7cac152 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-7fe4925d-d4ce-4153-b2f6-f0feb73c3b9c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:20.904306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:20.905268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:20.919262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:20.919262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:20.919262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:20.919262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:20.919262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:20.919262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:20.919262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:20.919262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:20.919262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 14:38:20.919262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:20.919262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 417/852] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:38:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:20.919262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4925d-d4ce-4153-b2f6-f0feb73c3b9c None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:20.939337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f549e5-d01a-4b1b-9573-5b2259de59ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:20.940775 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f549e5-d01a-4b1b-9573-5b2259de59ea None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:20.941086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f549e5-d01a-4b1b-9573-5b2259de59ea None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:20.941754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f549e5-d01a-4b1b-9573-5b2259de59ea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:20.942480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f549e5-d01a-4b1b-9573-5b2259de59ea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:20.943927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f549e5-d01a-4b1b-9573-5b2259de59ea None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-e4f549e5-d01a-4b1b-9573-5b2259de59ea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:20.956702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:20.957743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:20.958609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:20.958609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:20.958609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:20.958609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:20.958609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:20.958609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:20.958609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:20.958609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:20.958609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:20.958609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:20.958609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:20.958609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:20.958609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 14:38:20.958609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:20.962960 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 436/853] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:38:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:20.963793 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f549e5-d01a-4b1b-9573-5b2259de59ea None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:21.018336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4925d-d4ce-4153-b2f6-f0feb73c3b9c None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:21.054799 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b86d4e-3289-4021-8314-d6e944a9dccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:21.055516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b86d4e-3289-4021-8314-d6e944a9dccc None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:21.055800 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b86d4e-3289-4021-8314-d6e944a9dccc None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:21.056079 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b86d4e-3289-4021-8314-d6e944a9dccc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:21.064486 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b86d4e-3289-4021-8314-d6e944a9dccc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:21.066395 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b86d4e-3289-4021-8314-d6e944a9dccc None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:21.069772 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f549e5-d01a-4b1b-9573-5b2259de59ea None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:21.083304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-e4b86d4e-3289-4021-8314-d6e944a9dccc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:21.083304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:21.083304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:21.083304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:21.083304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:21.083304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:21.083304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:21.083304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:21.083304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:21.083304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:21.083304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:21.083304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:21.083304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:21.083304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:21.083304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:21.084237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:21.085245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:21.085245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:21.085245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:21.085245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:21.085245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:21.085245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:21.085245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:21.085245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:21.087085 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 418/854] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:21.088110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b86d4e-3289-4021-8314-d6e944a9dccc None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:21.106933 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:21.118498 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87861078-74d5-42c8-b04c-22132ff20cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:21.119230 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87861078-74d5-42c8-b04c-22132ff20cb7 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:21.119514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87861078-74d5-42c8-b04c-22132ff20cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:21.119796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87861078-74d5-42c8-b04c-22132ff20cb7 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:21.120710 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87861078-74d5-42c8-b04c-22132ff20cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:21.121195 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87861078-74d5-42c8-b04c-22132ff20cb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:21.122625 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87861078-74d5-42c8-b04c-22132ff20cb7 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:21.146620 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 437/855] 10.222.0.44 () {56 vars in 1135 bytes} [Mon Jun 27 14:38:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:21.146620 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87861078-74d5-42c8-b04c-22132ff20cb7 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:21.163189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:21.201964 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b86d4e-3289-4021-8314-d6e944a9dccc None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:21.236689 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ffadf-e2bf-4816-a63c-c3b8a54add40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:21.237349 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ffadf-e2bf-4816-a63c-c3b8a54add40 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:21.237626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ffadf-e2bf-4816-a63c-c3b8a54add40 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:21.237899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ffadf-e2bf-4816-a63c-c3b8a54add40 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:21.238597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ffadf-e2bf-4816-a63c-c3b8a54add40 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:21.238898 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ffadf-e2bf-4816-a63c-c3b8a54add40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:21.240272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ffadf-e2bf-4816-a63c-c3b8a54add40 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:21.244844 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 419/856] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:38:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:21.245443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ffadf-e2bf-4816-a63c-c3b8a54add40 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:21.251011 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87861078-74d5-42c8-b04c-22132ff20cb7 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:21.287403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54936c-9bb2-43e0-8576-9d71c1e68ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:21.288532 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54936c-9bb2-43e0-8576-9d71c1e68ece None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:21.289475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54936c-9bb2-43e0-8576-9d71c1e68ece None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:21.289969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54936c-9bb2-43e0-8576-9d71c1e68ece None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:21.291582 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54936c-9bb2-43e0-8576-9d71c1e68ece None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:21.292146 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54936c-9bb2-43e0-8576-9d71c1e68ece None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:21.294508 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54936c-9bb2-43e0-8576-9d71c1e68ece None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:21.312113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 438/857] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:21.312113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54936c-9bb2-43e0-8576-9d71c1e68ece None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:21.332619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:21.356379 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ffadf-e2bf-4816-a63c-c3b8a54add40 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:21.392457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4f649-219d-4191-b026-9a5a6eb72374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:21.393223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4f649-219d-4191-b026-9a5a6eb72374 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:21.393520 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4f649-219d-4191-b026-9a5a6eb72374 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:21.393793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4f649-219d-4191-b026-9a5a6eb72374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:21.394307 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:21.421151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54936c-9bb2-43e0-8576-9d71c1e68ece None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:21.457989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a08f27-3ee6-4299-a34b-61cc45f54be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:21.458651 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a08f27-3ee6-4299-a34b-61cc45f54be4 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:21.458924 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a08f27-3ee6-4299-a34b-61cc45f54be4 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:21.459197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a08f27-3ee6-4299-a34b-61cc45f54be4 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:21.459897 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a08f27-3ee6-4299-a34b-61cc45f54be4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:21.460201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a08f27-3ee6-4299-a34b-61cc45f54be4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:21.461572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a08f27-3ee6-4299-a34b-61cc45f54be4 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:21.466931 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 439/858] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:38:21 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:21.467537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a08f27-3ee6-4299-a34b-61cc45f54be4 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:21.473602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4f649-219d-4191-b026-9a5a6eb72374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:21.475066 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4f649-219d-4191-b026-9a5a6eb72374 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:21.567958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:21.598652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 420/859] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:21 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:38:21.598652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279380a-8d64-400c-92a1-206831859489 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:21.598652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279380a-8d64-400c-92a1-206831859489 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:21.598966 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a08f27-3ee6-4299-a34b-61cc45f54be4 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:21.599044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279380a-8d64-400c-92a1-206831859489 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:21.599044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 421/860] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:21.599726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279380a-8d64-400c-92a1-206831859489 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:21.642755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eba86e-c6c2-4b74-b9c4-cdca99dd794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:21.644135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eba86e-c6c2-4b74-b9c4-cdca99dd794c None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:21.644135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eba86e-c6c2-4b74-b9c4-cdca99dd794c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:21.644135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eba86e-c6c2-4b74-b9c4-cdca99dd794c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:21.644798 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eba86e-c6c2-4b74-b9c4-cdca99dd794c None admin] RBAC: Adding query filter params (role.id=81973b552fbc46a4ad31c60d8f099564, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=d87edb187b2f4d6194cb7c94a3d690e6) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:21.645117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eba86e-c6c2-4b74-b9c4-cdca99dd794c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:21.646534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eba86e-c6c2-4b74-b9c4-cdca99dd794c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:21.653679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 440/861] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:21 2022] GET /identity/v3/role_assignments?user.id=d87edb187b2f4d6194cb7c94a3d690e6&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=81973b552fbc46a4ad31c60d8f099564 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:21.655010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf007c-890f-4cd9-8a46-621e7bad9240 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:21.655360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf007c-890f-4cd9-8a46-621e7bad9240 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:21.655692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf007c-890f-4cd9-8a46-621e7bad9240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:21.677636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:21.681443 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-7aaf007c-890f-4cd9-8a46-621e7bad9240 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:21.682677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7aaf007c-890f-4cd9-8a46-621e7bad9240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:21.728612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279380a-8d64-400c-92a1-206831859489 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:21.765921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 441/862] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:21.772766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846dcfe-3ee7-43f0-9070-fde238ab3dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:21.772766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846dcfe-3ee7-43f0-9070-fde238ab3dc9 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:21.772766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846dcfe-3ee7-43f0-9070-fde238ab3dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:21.772766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846dcfe-3ee7-43f0-9070-fde238ab3dc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:21.787070 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846dcfe-3ee7-43f0-9070-fde238ab3dc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:21.789599 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf007c-890f-4cd9-8a46-621e7bad9240 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:21.790405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846dcfe-3ee7-43f0-9070-fde238ab3dc9 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:21.811265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-a846dcfe-3ee7-43f0-9070-fde238ab3dc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:21.811265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:21.811265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:21.811265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:21.811265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:21.811265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:21.811265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:21.811265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:21.811265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:21.811265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:21.811265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:21.811265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:21.811265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:21.811265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:21.811265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:21.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:21.813616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:21.813616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:21.813616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:21.813616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:21.815562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 422/863] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:21.821460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846dcfe-3ee7-43f0-9070-fde238ab3dc9 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:21.859531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:21.927839 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf007c-890f-4cd9-8a46-621e7bad9240 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:21.966637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846dcfe-3ee7-43f0-9070-fde238ab3dc9 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:21.974875 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d00108-cda7-4c02-bfd0-b5347708d1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:21.975694 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d00108-cda7-4c02-bfd0-b5347708d1ed None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:21.975974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d00108-cda7-4c02-bfd0-b5347708d1ed None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:21.976247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d00108-cda7-4c02-bfd0-b5347708d1ed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:21.976964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d00108-cda7-4c02-bfd0-b5347708d1ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:21.978328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d00108-cda7-4c02-bfd0-b5347708d1ed None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:21.980623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-a5d00108-cda7-4c02-bfd0-b5347708d1ed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:21.991975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:21.995237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:21.997220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 442/864] 10.222.0.44 () {56 vars in 1132 bytes} [Mon Jun 27 14:38:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:22.000101 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d00108-cda7-4c02-bfd0-b5347708d1ed None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:22.012089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253ff51-92ea-40c4-a648-2a8148f196ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:22.013094 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253ff51-92ea-40c4-a648-2a8148f196ff None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:22.013518 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253ff51-92ea-40c4-a648-2a8148f196ff None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:22.013962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253ff51-92ea-40c4-a648-2a8148f196ff None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:22.014834 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253ff51-92ea-40c4-a648-2a8148f196ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:22.015302 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253ff51-92ea-40c4-a648-2a8148f196ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:22.016824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253ff51-92ea-40c4-a648-2a8148f196ff None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:22.031369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 423/865] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:22.037589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253ff51-92ea-40c4-a648-2a8148f196ff None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:22.138656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d00108-cda7-4c02-bfd0-b5347708d1ed None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:22.149952 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:22.168513 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253ff51-92ea-40c4-a648-2a8148f196ff None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:22.177245 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15b53d-f06c-4c77-ad08-383c06bc5480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:22.178170 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b53d-f06c-4c77-ad08-383c06bc5480 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:22.178647 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b53d-f06c-4c77-ad08-383c06bc5480 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:22.179139 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b53d-f06c-4c77-ad08-383c06bc5480 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:22.180038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15b53d-f06c-4c77-ad08-383c06bc5480 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:22.180537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15b53d-f06c-4c77-ad08-383c06bc5480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:22.182111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15b53d-f06c-4c77-ad08-383c06bc5480 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:22.187721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 443/866] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Jun 27 14:38:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:22.193077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15b53d-f06c-4c77-ad08-383c06bc5480 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:22.212341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dbf90-5f56-4a2d-86d1-1f9820a040b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:22.213558 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dbf90-5f56-4a2d-86d1-1f9820a040b7 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:22.214039 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dbf90-5f56-4a2d-86d1-1f9820a040b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:22.215021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dbf90-5f56-4a2d-86d1-1f9820a040b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:22.222940 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dbf90-5f56-4a2d-86d1-1f9820a040b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:22.224621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dbf90-5f56-4a2d-86d1-1f9820a040b7 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:22.240119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-6a2dbf90-5f56-4a2d-86d1-1f9820a040b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:22.240119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:22.240119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:22.240119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:22.240119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:22.240119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:22.240119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:22.240119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:22.240119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:22.240119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:22.240119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:22.240119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:22.240119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:22.240119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:22.240119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:22.241077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:22.241949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:22.241949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:22.241949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:22.241949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:22.241949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:22.241949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:22.241949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:22.241949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:22.248863 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 424/867] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:22.250571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dbf90-5f56-4a2d-86d1-1f9820a040b7 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:22.269401 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:22.327700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15b53d-f06c-4c77-ad08-383c06bc5480 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:22.371647 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dbf90-5f56-4a2d-86d1-1f9820a040b7 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:22.373694 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa56818-2191-4ddc-80fe-9a4dc9b73e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:22.375427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa56818-2191-4ddc-80fe-9a4dc9b73e67 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:22.375890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa56818-2191-4ddc-80fe-9a4dc9b73e67 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:22.376361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa56818-2191-4ddc-80fe-9a4dc9b73e67 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:22.377270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa56818-2191-4ddc-80fe-9a4dc9b73e67 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:22.377796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa56818-2191-4ddc-80fe-9a4dc9b73e67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:22.379799 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa56818-2191-4ddc-80fe-9a4dc9b73e67 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:22.386454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 444/868] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Jun 27 14:38:22 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:22.419808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9000f1d-2137-4a63-b279-cf9ebfc15fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:22.420957 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9000f1d-2137-4a63-b279-cf9ebfc15fe3 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:22.421460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9000f1d-2137-4a63-b279-cf9ebfc15fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:22.421928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9000f1d-2137-4a63-b279-cf9ebfc15fe3 None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:22.422934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9000f1d-2137-4a63-b279-cf9ebfc15fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:22.423472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9000f1d-2137-4a63-b279-cf9ebfc15fe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:22.425291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9000f1d-2137-4a63-b279-cf9ebfc15fe3 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:22.440776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 425/869] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:22.447293 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa56818-2191-4ddc-80fe-9a4dc9b73e67 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:22.564572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa56818-2191-4ddc-80fe-9a4dc9b73e67 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:22.591790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:22.601561 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae24e8-9668-4968-a096-394d733a7815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:22.602497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae24e8-9668-4968-a096-394d733a7815 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:22.602940 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae24e8-9668-4968-a096-394d733a7815 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:22.603381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae24e8-9668-4968-a096-394d733a7815 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:22.622912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae24e8-9668-4968-a096-394d733a7815 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=482c11dafd8541e28d50705f7651fd15) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:22.622912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae24e8-9668-4968-a096-394d733a7815 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:22.622912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae24e8-9668-4968-a096-394d733a7815 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:22.622912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 445/870] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:22 2022] GET /identity/v3/role_assignments?user.id=482c11dafd8541e28d50705f7651fd15&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=6036efe96c1948fb98d01c8703a0561a => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:23.582550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b3d7e-1483-47ef-b391-488e0bf6201e None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:23.583081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b3d7e-1483-47ef-b391-488e0bf6201e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:23.583081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b3d7e-1483-47ef-b391-488e0bf6201e None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:23.584675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 426/871] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:23.590169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11460ff-035f-4e33-8830-907d3ee80247 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:23.590583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11460ff-035f-4e33-8830-907d3ee80247 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:23.590778 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11460ff-035f-4e33-8830-907d3ee80247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:23.607661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d11460ff-035f-4e33-8830-907d3ee80247 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:23.608874 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d11460ff-035f-4e33-8830-907d3ee80247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:23.678976 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 446/872] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:23.702273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b3d7e-1483-47ef-b391-488e0bf6201e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:23.713515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:23.810389 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b3d7e-1483-47ef-b391-488e0bf6201e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:23.846617 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b92c3-1047-4169-be93-f3e16768ad7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:23.847195 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b92c3-1047-4169-be93-f3e16768ad7b None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:23.847474 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b92c3-1047-4169-be93-f3e16768ad7b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:23.847745 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b92c3-1047-4169-be93-f3e16768ad7b None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:23.848471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b92c3-1047-4169-be93-f3e16768ad7b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:23.849854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b92c3-1047-4169-be93-f3e16768ad7b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:23.868045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce4009-07f9-40f0-ad2e-8d99d65a6aaa None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:23.868545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce4009-07f9-40f0-ad2e-8d99d65a6aaa None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:23.874630 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce4009-07f9-40f0-ad2e-8d99d65a6aaa None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:23.874630 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 447/873] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:38:23.875163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2a13a-a2f7-4bae-b5b5-5508121b0d4f None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:23.875451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2a13a-a2f7-4bae-b5b5-5508121b0d4f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:23.875731 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2a13a-a2f7-4bae-b5b5-5508121b0d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:23.893279 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-23e2a13a-a2f7-4bae-b5b5-5508121b0d4f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:23.894454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-23e2a13a-a2f7-4bae-b5b5-5508121b0d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:23.932804 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 427/874] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Jun 27 14:38:23 2022] POST /identity/v3/services => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:38:23.986332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 448/875] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:23 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 14:38:24.007473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b92c3-1047-4169-be93-f3e16768ad7b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:24.096923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:24.138463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b92c3-1047-4169-be93-f3e16768ad7b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:24.174735 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c08c0b-a8ce-4352-b889-68ceb217dd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:24.175846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c08c0b-a8ce-4352-b889-68ceb217dd0a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:24.176304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c08c0b-a8ce-4352-b889-68ceb217dd0a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:24.176776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c08c0b-a8ce-4352-b889-68ceb217dd0a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:24.187976 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c08c0b-a8ce-4352-b889-68ceb217dd0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-08c08c0b-a8ce-4352-b889-68ceb217dd0a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:24.196417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:24.197597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:24.199599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:24.199599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:24.199599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:24.199599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:24.199599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:24.199599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:24.199599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:24.199599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:24.199599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:24.199599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:24.199599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 14:38:24.199599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:24.202084 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 428/876] 10.222.0.44 () {56 vars in 1120 bytes} [Mon Jun 27 14:38:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:24.208696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2a13a-a2f7-4bae-b5b5-5508121b0d4f None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:24.257704 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:24.313403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2a13a-a2f7-4bae-b5b5-5508121b0d4f None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:24.349266 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651265e-317a-4ebe-ae47-b6f6c9578588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:24.349861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651265e-317a-4ebe-ae47-b6f6c9578588 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:24.350148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651265e-317a-4ebe-ae47-b6f6c9578588 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:24.350429 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651265e-317a-4ebe-ae47-b6f6c9578588 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:24.351184 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651265e-317a-4ebe-ae47-b6f6c9578588 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:24.351494 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651265e-317a-4ebe-ae47-b6f6c9578588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:24.352888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651265e-317a-4ebe-ae47-b6f6c9578588 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:24.366290 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 449/877] 10.222.0.44 () {56 vars in 1115 bytes} [Mon Jun 27 14:38:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:24.367811 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c08c0b-a8ce-4352-b889-68ceb217dd0a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:24.478651 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c08c0b-a8ce-4352-b889-68ceb217dd0a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:24.506873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:24.515287 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d354f0-2151-4866-88da-99460daad5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:24.516079 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d354f0-2151-4866-88da-99460daad5db None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:24.516365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d354f0-2151-4866-88da-99460daad5db None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:24.516659 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d354f0-2151-4866-88da-99460daad5db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:24.527794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d354f0-2151-4866-88da-99460daad5db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:24.529299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d354f0-2151-4866-88da-99460daad5db None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:24.541861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7be73-0aba-4695-8e31-f36ae4dd0cc0 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:24.542250 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7be73-0aba-4695-8e31-f36ae4dd0cc0 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:24.543292 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7be73-0aba-4695-8e31-f36ae4dd0cc0 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:24.545353 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 450/878] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:24.546874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-52d354f0-2151-4866-88da-99460daad5db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:24.546874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:24.546874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:24.546874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:24.546874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:24.546874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:24.546874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:24.546874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:24.546874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:24.546874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:24.546874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:24.546874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:24.546874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:24.546874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:24.546874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:24.547786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:24.549344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:24.549344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:24.549344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:24.549344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:24.549344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 429/879] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:24.550416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7ae03-4903-4789-a16c-e6bc39a5563e None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:24.550794 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7ae03-4903-4789-a16c-e6bc39a5563e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:24.551161 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7ae03-4903-4789-a16c-e6bc39a5563e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:24.557303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d354f0-2151-4866-88da-99460daad5db None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:24.572084 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-b7e7ae03-4903-4789-a16c-e6bc39a5563e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:24.574142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b7e7ae03-4903-4789-a16c-e6bc39a5563e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:24.656419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 451/880] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:24 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:24.676839 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7ae03-4903-4789-a16c-e6bc39a5563e None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:24.682378 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d354f0-2151-4866-88da-99460daad5db None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:24.720978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc984e2f-6fbc-48c1-bf7a-4f0d7cc3cedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:24.721691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc984e2f-6fbc-48c1-bf7a-4f0d7cc3cedf None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:24.721981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc984e2f-6fbc-48c1-bf7a-4f0d7cc3cedf None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:24.722256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc984e2f-6fbc-48c1-bf7a-4f0d7cc3cedf None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:24.722988 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc984e2f-6fbc-48c1-bf7a-4f0d7cc3cedf None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:24.723295 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc984e2f-6fbc-48c1-bf7a-4f0d7cc3cedf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:24.724670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc984e2f-6fbc-48c1-bf7a-4f0d7cc3cedf None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:24.727149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:24.739111 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 430/881] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:24.745301 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc984e2f-6fbc-48c1-bf7a-4f0d7cc3cedf None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:24.796573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:24.798663 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7ae03-4903-4789-a16c-e6bc39a5563e None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:24.835946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2425cbe-87e2-4df2-839b-b7df8398d3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:24.836633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2425cbe-87e2-4df2-839b-b7df8398d3c5 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:24.836941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2425cbe-87e2-4df2-839b-b7df8398d3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:24.837221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2425cbe-87e2-4df2-839b-b7df8398d3c5 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:24.837948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2425cbe-87e2-4df2-839b-b7df8398d3c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:24.839920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2425cbe-87e2-4df2-839b-b7df8398d3c5 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:24.858152 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc984e2f-6fbc-48c1-bf7a-4f0d7cc3cedf None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:24.894032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db857-0311-45fa-8232-84045991c7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:24.894890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db857-0311-45fa-8232-84045991c7bc None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:24.895172 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db857-0311-45fa-8232-84045991c7bc None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:24.895446 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db857-0311-45fa-8232-84045991c7bc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:24.903288 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74db857-0311-45fa-8232-84045991c7bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:24.904762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74db857-0311-45fa-8232-84045991c7bc None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-f74db857-0311-45fa-8232-84045991c7bc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:24.920588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:24.926454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:24.927668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:24.927668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:24.927668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:24.927668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:24.927668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:24.927668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:24.927668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:24.927668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:24.927668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 14:38:24.927668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:24.927668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 431/882] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Jun 27 14:38:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:24.927668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442d2ef-613c-4e68-a56d-7a72a1bb2447 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:24.927668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442d2ef-613c-4e68-a56d-7a72a1bb2447 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:24.928771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442d2ef-613c-4e68-a56d-7a72a1bb2447 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:24.928771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 432/883] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:24.929688 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442d2ef-613c-4e68-a56d-7a72a1bb2447 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:24.941331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 452/884] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Jun 27 14:38:24 2022] POST /identity/v3/services => generated 269 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:38:24.942866 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354ba3c-08ea-411d-a6be-561fe50d4db1 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:24.943177 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354ba3c-08ea-411d-a6be-561fe50d4db1 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:24.943457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354ba3c-08ea-411d-a6be-561fe50d4db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:24.962759 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d354ba3c-08ea-411d-a6be-561fe50d4db1 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:24.964000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d354ba3c-08ea-411d-a6be-561fe50d4db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:25.053644 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:25.064867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442d2ef-613c-4e68-a56d-7a72a1bb2447 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:25.071909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 453/885] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:25.094842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354ba3c-08ea-411d-a6be-561fe50d4db1 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:25.114904 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63677ac5-b53e-4b69-9160-ef725608b574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:25.115939 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63677ac5-b53e-4b69-9160-ef725608b574 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:25.116444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63677ac5-b53e-4b69-9160-ef725608b574 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:25.117027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63677ac5-b53e-4b69-9160-ef725608b574 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:25.118187 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63677ac5-b53e-4b69-9160-ef725608b574 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:25.118704 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63677ac5-b53e-4b69-9160-ef725608b574 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:25.120369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63677ac5-b53e-4b69-9160-ef725608b574 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:25.127292 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:25.144565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 433/886] 10.222.0.44 () {56 vars in 1149 bytes} [Mon Jun 27 14:38:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:25.156865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63677ac5-b53e-4b69-9160-ef725608b574 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:25.239472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354ba3c-08ea-411d-a6be-561fe50d4db1 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:25.281138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63677ac5-b53e-4b69-9160-ef725608b574 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:25.285526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c196b6-964f-4808-a891-a4c398797413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:25.286575 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c196b6-964f-4808-a891-a4c398797413 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:25.287063 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c196b6-964f-4808-a891-a4c398797413 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:25.287555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c196b6-964f-4808-a891-a4c398797413 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:25.288408 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c196b6-964f-4808-a891-a4c398797413 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:25.290029 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c196b6-964f-4808-a891-a4c398797413 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-08c196b6-964f-4808-a891-a4c398797413 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:25.303295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:25.304344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:25.305237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:25.305237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:25.305237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:25.305237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:25.305237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:25.305237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:25.305237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:25.305237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:25.305237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:25.305237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:25.305237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:25.305237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:25.305237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 14:38:25.305237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:25.308178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 454/887] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Jun 27 14:38:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:25.314804 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c196b6-964f-4808-a891-a4c398797413 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:25.325245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11beaa-4385-4071-a625-255674d6fc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:25.325898 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11beaa-4385-4071-a625-255674d6fc90 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:25.326180 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11beaa-4385-4071-a625-255674d6fc90 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:25.326456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11beaa-4385-4071-a625-255674d6fc90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:25.353059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:25.406001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11beaa-4385-4071-a625-255674d6fc90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:25.407847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11beaa-4385-4071-a625-255674d6fc90 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:25.423945 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:25.439506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c196b6-964f-4808-a891-a4c398797413 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:25.485596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa767f-3bb8-46cf-8a39-d874183dd66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:25.486274 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa767f-3bb8-46cf-8a39-d874183dd66e None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:25.486559 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa767f-3bb8-46cf-8a39-d874183dd66e None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:25.486839 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa767f-3bb8-46cf-8a39-d874183dd66e None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:25.487557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa767f-3bb8-46cf-8a39-d874183dd66e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:25.487871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa767f-3bb8-46cf-8a39-d874183dd66e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:25.489830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa767f-3bb8-46cf-8a39-d874183dd66e None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:25.501152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 455/888] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Jun 27 14:38:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:25.505682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa767f-3bb8-46cf-8a39-d874183dd66e None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:25.524500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 434/889] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:25 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:38:25.525830 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11beaa-4385-4071-a625-255674d6fc90 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:25.591323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:25.691605 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa767f-3bb8-46cf-8a39-d874183dd66e None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:25.692133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11beaa-4385-4071-a625-255674d6fc90 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:25.742284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e93d8-bd65-4576-bb88-fc0bf8b40e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:25.742882 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e93d8-bd65-4576-bb88-fc0bf8b40e5f None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:25.743167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e93d8-bd65-4576-bb88-fc0bf8b40e5f None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:25.743447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e93d8-bd65-4576-bb88-fc0bf8b40e5f None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:25.744164 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e93d8-bd65-4576-bb88-fc0bf8b40e5f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:25.744472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e93d8-bd65-4576-bb88-fc0bf8b40e5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:25.749467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e93d8-bd65-4576-bb88-fc0bf8b40e5f None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:25.766180 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 456/890] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Jun 27 14:38:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:25.775535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99263247-478f-4982-9953-2b371046cccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:25.779369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99263247-478f-4982-9953-2b371046cccc None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:25.780541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99263247-478f-4982-9953-2b371046cccc None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:25.782614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99263247-478f-4982-9953-2b371046cccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:25.814487 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99263247-478f-4982-9953-2b371046cccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:25.821032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99263247-478f-4982-9953-2b371046cccc None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:25.863248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-99263247-478f-4982-9953-2b371046cccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:25.863248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:25.863248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:25.863248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:25.863248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:25.863248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:25.863248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:25.863248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:25.863248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:25.863248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:25.863248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:25.863248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:25.863248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:25.863248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:25.863248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:25.864210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:25.865134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:25.865134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:25.865134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:25.865134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:25.869303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 435/891] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:25.875952 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e93d8-bd65-4576-bb88-fc0bf8b40e5f None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:25.913116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:26.084807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e93d8-bd65-4576-bb88-fc0bf8b40e5f None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:26.107911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba745ca-eadf-4f6f-a91b-d7d2ee17dc2e None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:26.108252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba745ca-eadf-4f6f-a91b-d7d2ee17dc2e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:26.108477 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba745ca-eadf-4f6f-a91b-d7d2ee17dc2e None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:26.111022 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 436/892] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:26.114873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea6f27-a045-4384-8a46-ed1d49ff5429 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:26.115160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea6f27-a045-4384-8a46-ed1d49ff5429 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:26.115418 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea6f27-a045-4384-8a46-ed1d49ff5429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:26.124489 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08139c5-a0d5-4263-9a21-571e13460b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:26.125191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08139c5-a0d5-4263-9a21-571e13460b3e None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:26.125475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08139c5-a0d5-4263-9a21-571e13460b3e None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:26.125752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08139c5-a0d5-4263-9a21-571e13460b3e None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:26.126493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08139c5-a0d5-4263-9a21-571e13460b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:26.126796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08139c5-a0d5-4263-9a21-571e13460b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:26.128154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08139c5-a0d5-4263-9a21-571e13460b3e None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:26.134886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-7dea6f27-a045-4384-8a46-ed1d49ff5429 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:26.136577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7dea6f27-a045-4384-8a46-ed1d49ff5429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:26.142165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 457/893] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:26.152624 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08139c5-a0d5-4263-9a21-571e13460b3e None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:26.240562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 437/894] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:26.242969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:26.261270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea6f27-a045-4384-8a46-ed1d49ff5429 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:26.275285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08139c5-a0d5-4263-9a21-571e13460b3e None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:26.299989 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:26.320484 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590673a-992a-42eb-bcdb-90d7a7266ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:26.321436 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590673a-992a-42eb-bcdb-90d7a7266ce6 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:26.321715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590673a-992a-42eb-bcdb-90d7a7266ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:26.321989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590673a-992a-42eb-bcdb-90d7a7266ce6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:26.331456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590673a-992a-42eb-bcdb-90d7a7266ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:26.333083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590673a-992a-42eb-bcdb-90d7a7266ce6 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:26.353026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-8590673a-992a-42eb-bcdb-90d7a7266ce6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:26.353026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:26.353026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:26.353026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:26.353026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:26.353026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:26.353026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:26.353026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:26.353026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:26.353026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:26.353026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:26.353026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:26.353026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:26.353026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:26.353026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:26.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:26.356583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:26.356583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:26.356583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:26.356583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:26.356583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:26.356583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:26.356583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:26.356583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:26.356583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 458/895] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:26.361490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590673a-992a-42eb-bcdb-90d7a7266ce6 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:26.377669 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea6f27-a045-4384-8a46-ed1d49ff5429 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:26.418782 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89b09c-7e43-434f-b118-48f3257d758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:26.419705 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89b09c-7e43-434f-b118-48f3257d758e None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:26.420042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89b09c-7e43-434f-b118-48f3257d758e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:26.420331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89b09c-7e43-434f-b118-48f3257d758e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:26.421033 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89b09c-7e43-434f-b118-48f3257d758e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:26.422597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89b09c-7e43-434f-b118-48f3257d758e None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-ff89b09c-7e43-434f-b118-48f3257d758e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:26.435270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:26.437318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:26.438323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:26.438323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:26.438323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:26.438323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:26.438323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:26.438323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:26.438323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:26.438323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:26.438323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:26.438323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:26.438323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:26.438323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:26.438323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 14:38:26.438323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:26.438323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 438/896] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:38:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:26.442692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89b09c-7e43-434f-b118-48f3257d758e None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:26.494095 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590673a-992a-42eb-bcdb-90d7a7266ce6 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:26.538887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678dbef-f616-44c6-90c2-859817d33e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:26.540088 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678dbef-f616-44c6-90c2-859817d33e1b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:26.540369 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678dbef-f616-44c6-90c2-859817d33e1b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:26.540662 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678dbef-f616-44c6-90c2-859817d33e1b None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:26.541737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678dbef-f616-44c6-90c2-859817d33e1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:26.542047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678dbef-f616-44c6-90c2-859817d33e1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:26.544483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678dbef-f616-44c6-90c2-859817d33e1b None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:26.548353 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:26.551694 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:26.555111 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89b09c-7e43-434f-b118-48f3257d758e None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:26.567118 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 459/897] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:26.569620 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678dbef-f616-44c6-90c2-859817d33e1b None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:26.600156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709de66-44de-45b5-b5d5-0b34895d0f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:26.600972 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709de66-44de-45b5-b5d5-0b34895d0f2a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:26.601254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709de66-44de-45b5-b5d5-0b34895d0f2a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:26.601528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709de66-44de-45b5-b5d5-0b34895d0f2a None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:26.602547 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709de66-44de-45b5-b5d5-0b34895d0f2a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:26.602860 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709de66-44de-45b5-b5d5-0b34895d0f2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:26.604521 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709de66-44de-45b5-b5d5-0b34895d0f2a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:26.615935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 439/898] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:38:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:26.616865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709de66-44de-45b5-b5d5-0b34895d0f2a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:26.681051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678dbef-f616-44c6-90c2-859817d33e1b None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:26.718056 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e03ba-88cb-4930-9d13-f4ef82e775d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:26.719536 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e03ba-88cb-4930-9d13-f4ef82e775d7 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:26.720044 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e03ba-88cb-4930-9d13-f4ef82e775d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:26.720526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e03ba-88cb-4930-9d13-f4ef82e775d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:26.721607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e03ba-88cb-4930-9d13-f4ef82e775d7 None admin] RBAC: Adding query filter params (role.id=c9c2c328f42a430fa25f0ec124d672f1, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=d87edb187b2f4d6194cb7c94a3d690e6) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:26.722309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e03ba-88cb-4930-9d13-f4ef82e775d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:26.724007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e03ba-88cb-4930-9d13-f4ef82e775d7 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:26.731354 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709de66-44de-45b5-b5d5-0b34895d0f2a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:26.736357 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 460/899] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:26 2022] GET /identity/v3/role_assignments?user.id=d87edb187b2f4d6194cb7c94a3d690e6&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=c9c2c328f42a430fa25f0ec124d672f1 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:26.771274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62993ea6-2293-4a37-ae62-008064797984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:26.771948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62993ea6-2293-4a37-ae62-008064797984 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:26.772229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62993ea6-2293-4a37-ae62-008064797984 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:26.772501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62993ea6-2293-4a37-ae62-008064797984 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:26.773261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62993ea6-2293-4a37-ae62-008064797984 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:26.773550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62993ea6-2293-4a37-ae62-008064797984 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:26.774923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62993ea6-2293-4a37-ae62-008064797984 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:26.781989 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 440/900] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:38:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:26.787982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e03ba-88cb-4930-9d13-f4ef82e775d7 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:26.859944 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:26.907217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e03ba-88cb-4930-9d13-f4ef82e775d7 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:26.945744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9433f4f-af25-43da-9afa-e71d98d6a7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:26.946782 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433f4f-af25-43da-9afa-e71d98d6a7b2 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:26.947272 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433f4f-af25-43da-9afa-e71d98d6a7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:26.947754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433f4f-af25-43da-9afa-e71d98d6a7b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:26.950026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9433f4f-af25-43da-9afa-e71d98d6a7b2 None admin] RBAC: Adding query filter params (interface=public, service_id=596cf55a7f3642f089ff849cd5aeebe2, region_id=RegionOne) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:26.950556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9433f4f-af25-43da-9afa-e71d98d6a7b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:26.952138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9433f4f-af25-43da-9afa-e71d98d6a7b2 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:26.960860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 461/901] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Jun 27 14:38:26 2022] GET /identity/v3/endpoints?service_id=596cf55a7f3642f089ff849cd5aeebe2&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:26.966615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62993ea6-2293-4a37-ae62-008064797984 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:26.998406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:27.074459 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62993ea6-2293-4a37-ae62-008064797984 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:27.110083 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b4ebc-5ef7-42a4-b971-ab5babb56686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:27.110620 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4ebc-5ef7-42a4-b971-ab5babb56686 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:27.110900 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4ebc-5ef7-42a4-b971-ab5babb56686 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:27.111173 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4ebc-5ef7-42a4-b971-ab5babb56686 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:27.111854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b4ebc-5ef7-42a4-b971-ab5babb56686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:27.113248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b4ebc-5ef7-42a4-b971-ab5babb56686 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:27.119332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 441/902] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Jun 27 14:38:26 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:38:27.154951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff994f-518c-4725-9e5c-f2ae75bdb296 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:27.155279 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff994f-518c-4725-9e5c-f2ae75bdb296 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:27.155524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff994f-518c-4725-9e5c-f2ae75bdb296 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:27.157374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 462/903] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:27.165431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24fea3-daca-459b-ba14-0c4ca2c66566 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:27.165732 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24fea3-daca-459b-ba14-0c4ca2c66566 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:27.165986 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24fea3-daca-459b-ba14-0c4ca2c66566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:27.184505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-de24fea3-daca-459b-ba14-0c4ca2c66566 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:27.185751 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-de24fea3-daca-459b-ba14-0c4ca2c66566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:27.262181 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 442/904] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:27.285719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff994f-518c-4725-9e5c-f2ae75bdb296 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:27.397469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff994f-518c-4725-9e5c-f2ae75bdb296 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:27.422285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:27.433338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b33d5-e96f-4e5d-9df6-a68fe543d523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:27.434295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b33d5-e96f-4e5d-9df6-a68fe543d523 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:27.434583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b33d5-e96f-4e5d-9df6-a68fe543d523 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:27.434862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b33d5-e96f-4e5d-9df6-a68fe543d523 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:27.435578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b33d5-e96f-4e5d-9df6-a68fe543d523 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:27.437037 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b33d5-e96f-4e5d-9df6-a68fe543d523 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-824b33d5-e96f-4e5d-9df6-a68fe543d523 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:27.451345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:27.458444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:27.459299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 463/905] 10.222.0.44 () {56 vars in 1132 bytes} [Mon Jun 27 14:38:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:27.461162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24fea3-daca-459b-ba14-0c4ca2c66566 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:27.489908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:27.565611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24fea3-daca-459b-ba14-0c4ca2c66566 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:27.600738 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae6b16-d470-444b-8500-70cf2ef1db38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:27.601755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae6b16-d470-444b-8500-70cf2ef1db38 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:27.602275 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae6b16-d470-444b-8500-70cf2ef1db38 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:27.602753 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae6b16-d470-444b-8500-70cf2ef1db38 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:27.603645 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae6b16-d470-444b-8500-70cf2ef1db38 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:27.604148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae6b16-d470-444b-8500-70cf2ef1db38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:27.606387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae6b16-d470-444b-8500-70cf2ef1db38 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:27.611798 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 443/906] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Jun 27 14:38:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:27.617542 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b33d5-e96f-4e5d-9df6-a68fe543d523 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:27.725127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b33d5-e96f-4e5d-9df6-a68fe543d523 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:27.760369 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f110c2e-f157-4524-bc32-152e31ff911b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:27.761609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f110c2e-f157-4524-bc32-152e31ff911b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:27.761899 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f110c2e-f157-4524-bc32-152e31ff911b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:27.762284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f110c2e-f157-4524-bc32-152e31ff911b None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:27.762994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f110c2e-f157-4524-bc32-152e31ff911b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:27.763307 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f110c2e-f157-4524-bc32-152e31ff911b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:27.764683 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f110c2e-f157-4524-bc32-152e31ff911b None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:27.770069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 464/907] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Jun 27 14:38:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:27.775702 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae6b16-d470-444b-8500-70cf2ef1db38 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:27.868139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:27.886923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae6b16-d470-444b-8500-70cf2ef1db38 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:27.924827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a167e99-3991-4017-8f67-c65fcdd38b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:27.925829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a167e99-3991-4017-8f67-c65fcdd38b5d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:27.926296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a167e99-3991-4017-8f67-c65fcdd38b5d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:27.926762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a167e99-3991-4017-8f67-c65fcdd38b5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:27.927763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a167e99-3991-4017-8f67-c65fcdd38b5d None admin] RBAC: Adding query filter params (interface=public, service_id=599de873509941ec815e92f426c3b7f8, region_id=RegionOne) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:27.928260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a167e99-3991-4017-8f67-c65fcdd38b5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:27.929840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a167e99-3991-4017-8f67-c65fcdd38b5d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:27.936452 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 444/908] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Jun 27 14:38:27 2022] GET /identity/v3/endpoints?service_id=599de873509941ec815e92f426c3b7f8&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:27.942248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f110c2e-f157-4524-bc32-152e31ff911b None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:27.969821 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334b708-119b-4065-a4a4-6fa37654d28b None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:27.970126 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334b708-119b-4065-a4a4-6fa37654d28b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:27.970382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334b708-119b-4065-a4a4-6fa37654d28b None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:27.971854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 445/909] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:38:27.976766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad4e4b-d7fc-4477-b319-6b332ada65a1 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:27.977003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad4e4b-d7fc-4477-b319-6b332ada65a1 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:27.977279 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad4e4b-d7fc-4477-b319-6b332ada65a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:27.997098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-35ad4e4b-d7fc-4477-b319-6b332ada65a1 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:27.998293 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-35ad4e4b-d7fc-4477-b319-6b332ada65a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:28.011701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:28.088664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f110c2e-f157-4524-bc32-152e31ff911b None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:28.088852 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 446/910] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 14:38:28.109894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad4e4b-d7fc-4477-b319-6b332ada65a1 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:28.125573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fb568-f97c-4ef4-8160-1b5197052716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:28.126302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fb568-f97c-4ef4-8160-1b5197052716 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:28.126589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fb568-f97c-4ef4-8160-1b5197052716 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:28.126869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fb568-f97c-4ef4-8160-1b5197052716 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:28.127819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fb568-f97c-4ef4-8160-1b5197052716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:28.128989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fb568-f97c-4ef4-8160-1b5197052716 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:28.135115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 465/911] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Jun 27 14:38:27 2022] GET /identity/v3/services => generated 1268 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:38:28.205360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:28.227538 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad4e4b-d7fc-4477-b319-6b332ada65a1 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:28.272238 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9925d-21b9-4464-ae6c-1b7153352a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:28.273355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9925d-21b9-4464-ae6c-1b7153352a30 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:28.273845 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9925d-21b9-4464-ae6c-1b7153352a30 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:28.274323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9925d-21b9-4464-ae6c-1b7153352a30 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:28.275264 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9925d-21b9-4464-ae6c-1b7153352a30 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:28.277503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9925d-21b9-4464-ae6c-1b7153352a30 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:28.335691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 447/912] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Jun 27 14:38:28 2022] POST /identity/v3/services => generated 241 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:38:28.829237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb063523-5dcc-4559-b780-456ff1e46a22 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:28.829766 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb063523-5dcc-4559-b780-456ff1e46a22 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:28.829766 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb063523-5dcc-4559-b780-456ff1e46a22 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:28.831372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 466/913] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:28.836652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e356bde-fe25-4515-8a83-b1d2cea0083c None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:28.837075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e356bde-fe25-4515-8a83-b1d2cea0083c None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:28.837243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e356bde-fe25-4515-8a83-b1d2cea0083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:28.854148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-5e356bde-fe25-4515-8a83-b1d2cea0083c None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:28.855384 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-5e356bde-fe25-4515-8a83-b1d2cea0083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:28.934556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 448/914] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:28.957945 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb063523-5dcc-4559-b780-456ff1e46a22 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:29.061425 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb063523-5dcc-4559-b780-456ff1e46a22 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:29.078952 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:29.098321 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87801619-ee8e-4656-a595-e60416ea7102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:29.099100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87801619-ee8e-4656-a595-e60416ea7102 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:29.099480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87801619-ee8e-4656-a595-e60416ea7102 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:29.099756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87801619-ee8e-4656-a595-e60416ea7102 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:29.112668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87801619-ee8e-4656-a595-e60416ea7102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-87801619-ee8e-4656-a595-e60416ea7102 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:29.121363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:29.122315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:29.123166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:29.123166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:29.123166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:29.123166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:29.123166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:29.123166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:29.123166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:29.123166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:29.123166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:29.123166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:29.123166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 14:38:29.123166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:29.123166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 467/915] 10.222.0.44 () {56 vars in 1120 bytes} [Mon Jun 27 14:38:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:29.128565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e356bde-fe25-4515-8a83-b1d2cea0083c None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:29.199106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:29.234923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e356bde-fe25-4515-8a83-b1d2cea0083c None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:29.271003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce619e-4929-4a32-b98e-c3ad8fbbde54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:29.272015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce619e-4929-4a32-b98e-c3ad8fbbde54 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:29.272500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce619e-4929-4a32-b98e-c3ad8fbbde54 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:29.273026 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce619e-4929-4a32-b98e-c3ad8fbbde54 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:29.273979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce619e-4929-4a32-b98e-c3ad8fbbde54 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:29.274506 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce619e-4929-4a32-b98e-c3ad8fbbde54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:29.276086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce619e-4929-4a32-b98e-c3ad8fbbde54 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:29.281108 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914276dd-c6ac-4929-9318-280ff0ffe9af None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:29.281403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914276dd-c6ac-4929-9318-280ff0ffe9af None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:29.281690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914276dd-c6ac-4929-9318-280ff0ffe9af None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:29.284259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 468/916] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:29.286220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 449/917] 10.222.0.44 () {56 vars in 1115 bytes} [Mon Jun 27 14:38:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:29.288269 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d774ffd-235a-4791-b36a-645273b4a62a None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:29.288558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d774ffd-235a-4791-b36a-645273b4a62a None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:29.288879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d774ffd-235a-4791-b36a-645273b4a62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:29.292850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce619e-4929-4a32-b98e-c3ad8fbbde54 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:29.306590 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-6d774ffd-235a-4791-b36a-645273b4a62a None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:29.308329 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-6d774ffd-235a-4791-b36a-645273b4a62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:29.392994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 469/918] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:29.404289 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce619e-4929-4a32-b98e-c3ad8fbbde54 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:29.418220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d774ffd-235a-4791-b36a-645273b4a62a None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:29.432040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:29.441119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c569e6e-8fb1-4fb4-b65b-f0faa9850c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:29.442100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569e6e-8fb1-4fb4-b65b-f0faa9850c1d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:29.442550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569e6e-8fb1-4fb4-b65b-f0faa9850c1d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:29.443023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569e6e-8fb1-4fb4-b65b-f0faa9850c1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:29.454888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c569e6e-8fb1-4fb4-b65b-f0faa9850c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:29.456505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c569e6e-8fb1-4fb4-b65b-f0faa9850c1d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:29.480471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-6c569e6e-8fb1-4fb4-b65b-f0faa9850c1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:29.480471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:29.480471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:29.480471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:29.480471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:29.480471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:29.480471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:29.480471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:29.480471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:29.480471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:29.480471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:29.480471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:29.480471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:29.480471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:29.480471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:29.481590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:29.482525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:29.482525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:29.482525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:29.482525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:29.482525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 450/919] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:29.487338 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c569e6e-8fb1-4fb4-b65b-f0faa9850c1d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:29.535765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d774ffd-235a-4791-b36a-645273b4a62a None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:29.544573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:29.572923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb696fc-0701-48cd-89d6-639e8b2b6334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:29.574101 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb696fc-0701-48cd-89d6-639e8b2b6334 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:29.574734 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb696fc-0701-48cd-89d6-639e8b2b6334 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:29.575346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb696fc-0701-48cd-89d6-639e8b2b6334 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:29.576317 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb696fc-0701-48cd-89d6-639e8b2b6334 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:29.578254 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb696fc-0701-48cd-89d6-639e8b2b6334 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-fcb696fc-0701-48cd-89d6-639e8b2b6334 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:29.591509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:29.592795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:29.593862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:29.593862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:29.593862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:29.593862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:29.593862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:29.593862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:29.593862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:29.593862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:29.593862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:29.593862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:29.593862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:29.593862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:29.593862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 14:38:29.593862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:29.600758 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 470/920] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:38:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:29.602055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb696fc-0701-48cd-89d6-639e8b2b6334 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:29.605733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c569e6e-8fb1-4fb4-b65b-f0faa9850c1d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:29.645648 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837b551-7fe1-4dc4-83af-d3bc2f7b679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:29.646515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837b551-7fe1-4dc4-83af-d3bc2f7b679c None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:29.646946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837b551-7fe1-4dc4-83af-d3bc2f7b679c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:29.647385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837b551-7fe1-4dc4-83af-d3bc2f7b679c None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:29.648802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837b551-7fe1-4dc4-83af-d3bc2f7b679c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:29.649259 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837b551-7fe1-4dc4-83af-d3bc2f7b679c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:29.651192 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837b551-7fe1-4dc4-83af-d3bc2f7b679c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:29.668033 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 451/921] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:29.673612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837b551-7fe1-4dc4-83af-d3bc2f7b679c None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:29.718011 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb696fc-0701-48cd-89d6-639e8b2b6334 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:29.726714 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:29.765035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42e965-b1e6-465f-8bab-bc5d07af9339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:29.766529 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42e965-b1e6-465f-8bab-bc5d07af9339 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:29.767073 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42e965-b1e6-465f-8bab-bc5d07af9339 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:29.767625 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42e965-b1e6-465f-8bab-bc5d07af9339 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:29.768658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42e965-b1e6-465f-8bab-bc5d07af9339 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:29.769484 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42e965-b1e6-465f-8bab-bc5d07af9339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:29.771457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42e965-b1e6-465f-8bab-bc5d07af9339 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:29.778669 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 471/922] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:38:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:29.786536 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42e965-b1e6-465f-8bab-bc5d07af9339 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:29.790132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837b551-7fe1-4dc4-83af-d3bc2f7b679c None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:29.828024 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394764f2-f74b-4c95-97f0-bce24d282050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:29.828882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394764f2-f74b-4c95-97f0-bce24d282050 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:29.829166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394764f2-f74b-4c95-97f0-bce24d282050 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:29.829440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394764f2-f74b-4c95-97f0-bce24d282050 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:29.831126 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:29.841832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394764f2-f74b-4c95-97f0-bce24d282050 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:29.843494 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394764f2-f74b-4c95-97f0-bce24d282050 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-394764f2-f74b-4c95-97f0-bce24d282050 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:29.859522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:29.860730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:29.861691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:29.861691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:29.861691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:29.861691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:29.861691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:29.861691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:29.861691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:29.861691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:29.861691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 14:38:29.861691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:29.866342 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 452/923] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Jun 27 14:38:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:29.867590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394764f2-f74b-4c95-97f0-bce24d282050 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:29.915069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42e965-b1e6-465f-8bab-bc5d07af9339 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:29.959427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82978a02-914f-4617-8a73-14aca19cf502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:29.960132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82978a02-914f-4617-8a73-14aca19cf502 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:29.960419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82978a02-914f-4617-8a73-14aca19cf502 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:29.960722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82978a02-914f-4617-8a73-14aca19cf502 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:29.961443 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82978a02-914f-4617-8a73-14aca19cf502 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:29.961753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82978a02-914f-4617-8a73-14aca19cf502 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:29.963105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82978a02-914f-4617-8a73-14aca19cf502 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:29.974003 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 472/924] 10.222.0.44 () {56 vars in 1114 bytes} [Mon Jun 27 14:38:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:29.975175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82978a02-914f-4617-8a73-14aca19cf502 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:29.978574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:29.983280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394764f2-f74b-4c95-97f0-bce24d282050 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:30.027809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd26942-420f-409d-a463-fecc798a3fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:30.028609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd26942-420f-409d-a463-fecc798a3fa2 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:30.029005 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd26942-420f-409d-a463-fecc798a3fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:30.029405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd26942-420f-409d-a463-fecc798a3fa2 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:30.030340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd26942-420f-409d-a463-fecc798a3fa2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:30.030723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd26942-420f-409d-a463-fecc798a3fa2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:30.032367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd26942-420f-409d-a463-fecc798a3fa2 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:30.057226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 453/925] 10.222.0.44 () {56 vars in 1149 bytes} [Mon Jun 27 14:38:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:30.059221 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd26942-420f-409d-a463-fecc798a3fa2 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:30.098502 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:30.112036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82978a02-914f-4617-8a73-14aca19cf502 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:30.150469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e114b-f0a0-4829-b67a-ed7361ccc65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:30.151169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e114b-f0a0-4829-b67a-ed7361ccc65b None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:30.151536 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e114b-f0a0-4829-b67a-ed7361ccc65b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:30.151833 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e114b-f0a0-4829-b67a-ed7361ccc65b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:30.152635 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e114b-f0a0-4829-b67a-ed7361ccc65b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:30.154546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e114b-f0a0-4829-b67a-ed7361ccc65b None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:30.190315 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd26942-420f-409d-a463-fecc798a3fa2 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:30.226549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664b4cc-023c-4174-b736-4d680f6e734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:30.227590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664b4cc-023c-4174-b736-4d680f6e734b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:30.228032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664b4cc-023c-4174-b736-4d680f6e734b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:30.228531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664b4cc-023c-4174-b736-4d680f6e734b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:30.239905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664b4cc-023c-4174-b736-4d680f6e734b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:30.241565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664b4cc-023c-4174-b736-4d680f6e734b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:30.259480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-3664b4cc-023c-4174-b736-4d680f6e734b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:30.259480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:30.259480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:30.259480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:30.259480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:30.259480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:30.259480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:30.259480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:30.259480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:30.259480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:30.259480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:30.259480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:30.259480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:30.259480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:30.259480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:30.260625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:30.261865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:30.261865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:30.261865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:30.261865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:30.263883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 454/926] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:30.268713 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 473/927] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Jun 27 14:38:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:38:30.282788 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664b4cc-023c-4174-b736-4d680f6e734b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:30.298073 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:30.405394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664b4cc-023c-4174-b736-4d680f6e734b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:30.430492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2568c-e0e3-4f0c-9c5f-928a7d5f5b5e None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:30.430784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2568c-e0e3-4f0c-9c5f-928a7d5f5b5e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:30.431077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2568c-e0e3-4f0c-9c5f-928a7d5f5b5e None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:30.432726 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 474/928] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:38:30.438642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2950017-9ed6-4e11-a7b3-349295ab4d59 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:30.439293 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2950017-9ed6-4e11-a7b3-349295ab4d59 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:30.439786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2950017-9ed6-4e11-a7b3-349295ab4d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:30.456497 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485535dd-592d-49ef-b996-609c36df5602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:30.457608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485535dd-592d-49ef-b996-609c36df5602 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:30.458117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485535dd-592d-49ef-b996-609c36df5602 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:30.458603 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485535dd-592d-49ef-b996-609c36df5602 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:30.459532 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485535dd-592d-49ef-b996-609c36df5602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:30.459844 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485535dd-592d-49ef-b996-609c36df5602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:30.462290 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485535dd-592d-49ef-b996-609c36df5602 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:30.462427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-f2950017-9ed6-4e11-a7b3-349295ab4d59 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:30.463527 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f2950017-9ed6-4e11-a7b3-349295ab4d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:30.475174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 455/929] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:30.481964 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485535dd-592d-49ef-b996-609c36df5602 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:30.546960 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 475/930] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 14:38:30.553117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736db89-811d-4331-aa57-c602ebee3aa5 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:30.553795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736db89-811d-4331-aa57-c602ebee3aa5 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:30.554261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736db89-811d-4331-aa57-c602ebee3aa5 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:30.556521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 476/931] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:30.558402 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:30.562814 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2ff43-6040-4c81-8d99-9ea6d3fd6693 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:30.563101 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2ff43-6040-4c81-8d99-9ea6d3fd6693 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:30.563376 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2ff43-6040-4c81-8d99-9ea6d3fd6693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:30.581717 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-e1b2ff43-6040-4c81-8d99-9ea6d3fd6693 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:30.582891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e1b2ff43-6040-4c81-8d99-9ea6d3fd6693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:30.598215 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485535dd-592d-49ef-b996-609c36df5602 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:30.633117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a5f65-f91b-4d86-b145-469a2dc4fcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:30.633905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a5f65-f91b-4d86-b145-469a2dc4fcf1 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:30.634186 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a5f65-f91b-4d86-b145-469a2dc4fcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:30.634473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a5f65-f91b-4d86-b145-469a2dc4fcf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:30.641999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a5f65-f91b-4d86-b145-469a2dc4fcf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:30.643426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a5f65-f91b-4d86-b145-469a2dc4fcf1 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:30.658894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-b53a5f65-f91b-4d86-b145-469a2dc4fcf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:30.658894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:30.658894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:30.658894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:30.658894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:30.658894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:30.658894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:30.658894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:30.658894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:30.658894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:30.658894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:30.658894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:30.658894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:30.658894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:30.658894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:30.659922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:30.660949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:30.660949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:30.660949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:30.660949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:30.660949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:30.660949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:30.660949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:30.660949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:30.660949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 456/932] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:30.660949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a5f65-f91b-4d86-b145-469a2dc4fcf1 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:30.670970 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 477/933] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:30.672428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2ff43-6040-4c81-8d99-9ea6d3fd6693 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:30.700051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:30.768685 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a5f65-f91b-4d86-b145-469a2dc4fcf1 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:30.791855 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2ff43-6040-4c81-8d99-9ea6d3fd6693 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:30.797639 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:30.807251 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566a0ff-1f20-4729-9978-f217eee7025b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:30.816709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566a0ff-1f20-4729-9978-f217eee7025b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:30.816709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566a0ff-1f20-4729-9978-f217eee7025b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:30.816709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566a0ff-1f20-4729-9978-f217eee7025b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:30.816709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566a0ff-1f20-4729-9978-f217eee7025b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:30.816709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566a0ff-1f20-4729-9978-f217eee7025b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-f566a0ff-1f20-4729-9978-f217eee7025b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:30.824577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:30.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:30.826969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:30.826969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:30.826969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:30.826969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:30.826969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:30.826969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:30.826969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:30.826969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:30.826969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:30.826969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:30.826969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:30.826969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:30.826969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:30.826969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 14:38:30.826969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:30.830596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 457/934] 10.222.0.44 () {56 vars in 1132 bytes} [Mon Jun 27 14:38:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:30.831419 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566a0ff-1f20-4729-9978-f217eee7025b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:30.835679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d03d2-8450-4084-a8d1-6109cbdf0af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:30.836346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d03d2-8450-4084-a8d1-6109cbdf0af7 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:30.836631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d03d2-8450-4084-a8d1-6109cbdf0af7 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:30.836935 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d03d2-8450-4084-a8d1-6109cbdf0af7 None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:30.837728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d03d2-8450-4084-a8d1-6109cbdf0af7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:30.838039 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d03d2-8450-4084-a8d1-6109cbdf0af7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:30.840017 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d03d2-8450-4084-a8d1-6109cbdf0af7 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:30.852273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 478/935] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:30.857902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d03d2-8450-4084-a8d1-6109cbdf0af7 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:30.938386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:30.942612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566a0ff-1f20-4729-9978-f217eee7025b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:30.966400 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d03d2-8450-4084-a8d1-6109cbdf0af7 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:30.977847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7fbac-cedc-4641-9ad0-a25b5af518a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:30.978649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7fbac-cedc-4641-9ad0-a25b5af518a9 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:30.978935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7fbac-cedc-4641-9ad0-a25b5af518a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:30.979214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7fbac-cedc-4641-9ad0-a25b5af518a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:30.980173 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7fbac-cedc-4641-9ad0-a25b5af518a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:30.981772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7fbac-cedc-4641-9ad0-a25b5af518a9 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-f5f7fbac-cedc-4641-9ad0-a25b5af518a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:30.993772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:30.994792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:30.996483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:30.996483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:30.996483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:30.996483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:30.996483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:30.996483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:30.996483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:30.996483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:30.996483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:30.996483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:30.996483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:30.996483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:30.996483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 14:38:30.996483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:30.996483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 458/936] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Jun 27 14:38:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:31.003247 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7fbac-cedc-4641-9ad0-a25b5af518a9 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:31.008478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5d9b7-bb44-4927-b56d-1c7e0aae1f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:31.009478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5d9b7-bb44-4927-b56d-1c7e0aae1f3b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:31.009909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5d9b7-bb44-4927-b56d-1c7e0aae1f3b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:31.010185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5d9b7-bb44-4927-b56d-1c7e0aae1f3b None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:31.011492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5d9b7-bb44-4927-b56d-1c7e0aae1f3b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:31.011799 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5d9b7-bb44-4927-b56d-1c7e0aae1f3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:31.013214 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5d9b7-bb44-4927-b56d-1c7e0aae1f3b None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:31.018206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 479/937] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Jun 27 14:38:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:31.018948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5d9b7-bb44-4927-b56d-1c7e0aae1f3b None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:31.059738 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:31.113768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7fbac-cedc-4641-9ad0-a25b5af518a9 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:31.130557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5d9b7-bb44-4927-b56d-1c7e0aae1f3b None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:31.152450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cc33e-4f5e-49ff-9706-f51915568ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:31.153389 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cc33e-4f5e-49ff-9706-f51915568ea4 None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:31.153673 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cc33e-4f5e-49ff-9706-f51915568ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:31.153949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cc33e-4f5e-49ff-9706-f51915568ea4 None admin] PATH_INFO: `/v3/projects/af4d24603fa24a62946a57fabb774756/users/d87edb187b2f4d6194cb7c94a3d690e6/roles/c9c2c328f42a430fa25f0ec124d672f1` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:31.156169 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cc33e-4f5e-49ff-9706-f51915568ea4 None admin] RBAC: Authorizing `identity:create_grant(project_id=af4d24603fa24a62946a57fabb774756, user_id=d87edb187b2f4d6194cb7c94a3d690e6, role_id=c9c2c328f42a430fa25f0ec124d672f1)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:31.157753 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cc33e-4f5e-49ff-9706-f51915568ea4 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:31.167472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17a298-7583-49ca-abc3-1072856be992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:31.171333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17a298-7583-49ca-abc3-1072856be992 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:31.171333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17a298-7583-49ca-abc3-1072856be992 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:31.171333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17a298-7583-49ca-abc3-1072856be992 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:31.171333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17a298-7583-49ca-abc3-1072856be992 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:31.171333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17a298-7583-49ca-abc3-1072856be992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:31.171333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17a298-7583-49ca-abc3-1072856be992 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:31.175974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 480/938] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Jun 27 14:38:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:31.176755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17a298-7583-49ca-abc3-1072856be992 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:31.183400 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:31.284763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 459/939] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:38:30 2022] PUT /identity/v3/projects/af4d24603fa24a62946a57fabb774756/users/d87edb187b2f4d6194cb7c94a3d690e6/roles/c9c2c328f42a430fa25f0ec124d672f1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:38:31.284763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cc33e-4f5e-49ff-9706-f51915568ea4 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:31.285069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17a298-7583-49ca-abc3-1072856be992 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:31.320183 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571835d-1984-4828-aa9b-0926aa409833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:31.320893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571835d-1984-4828-aa9b-0926aa409833 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:31.321182 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571835d-1984-4828-aa9b-0926aa409833 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:31.321463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571835d-1984-4828-aa9b-0926aa409833 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:31.322281 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571835d-1984-4828-aa9b-0926aa409833 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:31.322582 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571835d-1984-4828-aa9b-0926aa409833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:31.325266 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571835d-1984-4828-aa9b-0926aa409833 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:31.335877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 481/940] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Jun 27 14:38:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:31.336859 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571835d-1984-4828-aa9b-0926aa409833 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:31.420009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:31.436709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cc33e-4f5e-49ff-9706-f51915568ea4 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:31.457548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:31.467437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571835d-1984-4828-aa9b-0926aa409833 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:31.480747 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38a84b-c6e1-40f3-bdd5-1488a91d508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:31.481584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38a84b-c6e1-40f3-bdd5-1488a91d508e None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:31.481726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38a84b-c6e1-40f3-bdd5-1488a91d508e None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:31.481927 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38a84b-c6e1-40f3-bdd5-1488a91d508e None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:31.482652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38a84b-c6e1-40f3-bdd5-1488a91d508e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:31.482961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38a84b-c6e1-40f3-bdd5-1488a91d508e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:31.484326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38a84b-c6e1-40f3-bdd5-1488a91d508e None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:31.490934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 460/941] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Jun 27 14:38:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:31.498362 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38a84b-c6e1-40f3-bdd5-1488a91d508e None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:31.511174 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9238c8-761f-456d-a673-70447f75e8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:31.512043 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9238c8-761f-456d-a673-70447f75e8c4 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:31.512328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9238c8-761f-456d-a673-70447f75e8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:31.512609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9238c8-761f-456d-a673-70447f75e8c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:31.513421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9238c8-761f-456d-a673-70447f75e8c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:31.514781 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9238c8-761f-456d-a673-70447f75e8c4 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:31.598104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 482/942] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Jun 27 14:38:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:38:31.621413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38a84b-c6e1-40f3-bdd5-1488a91d508e None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:31.668601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef36ad-334f-4dec-a617-e81807b37061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:31.669295 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef36ad-334f-4dec-a617-e81807b37061 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:31.669580 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef36ad-334f-4dec-a617-e81807b37061 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:31.669853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef36ad-334f-4dec-a617-e81807b37061 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:31.670654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef36ad-334f-4dec-a617-e81807b37061 None admin] RBAC: Adding query filter params (interface=public, service_id=32ca0db73062447485b3749da95983ed, region_id=RegionOne) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:31.670963 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef36ad-334f-4dec-a617-e81807b37061 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:31.672337 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef36ad-334f-4dec-a617-e81807b37061 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:31.678782 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 461/943] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Jun 27 14:38:31 2022] GET /identity/v3/endpoints?service_id=32ca0db73062447485b3749da95983ed&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:31.685275 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9238c8-761f-456d-a673-70447f75e8c4 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:31.798489 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9238c8-761f-456d-a673-70447f75e8c4 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:31.822824 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:31.835813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c13f64-9ec0-4b1d-99d5-9b90bfa30c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:31.839447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c13f64-9ec0-4b1d-99d5-9b90bfa30c3e None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:31.839447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c13f64-9ec0-4b1d-99d5-9b90bfa30c3e None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:31.839447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c13f64-9ec0-4b1d-99d5-9b90bfa30c3e None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:31.839447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c13f64-9ec0-4b1d-99d5-9b90bfa30c3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:31.839832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c13f64-9ec0-4b1d-99d5-9b90bfa30c3e None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:31.846288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 483/944] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Jun 27 14:38:31 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:38:32.414102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5a09-d842-4ead-a93f-de11d13d2aa3 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:32.414102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5a09-d842-4ead-a93f-de11d13d2aa3 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:32.414102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5a09-d842-4ead-a93f-de11d13d2aa3 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:32.415159 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 462/945] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:32.420680 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b72f18-2a5c-495f-92da-60062d0a41b9 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:32.421207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b72f18-2a5c-495f-92da-60062d0a41b9 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:32.421708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b72f18-2a5c-495f-92da-60062d0a41b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:32.438855 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-e1b72f18-2a5c-495f-92da-60062d0a41b9 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:32.440313 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e1b72f18-2a5c-495f-92da-60062d0a41b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:32.514149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 484/946] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:32.537382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5a09-d842-4ead-a93f-de11d13d2aa3 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:32.584668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:32.645113 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5a09-d842-4ead-a93f-de11d13d2aa3 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:32.679439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b79ec1-08c3-4e14-b375-4ee01b7649b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:32.680027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b79ec1-08c3-4e14-b375-4ee01b7649b8 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:32.680309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b79ec1-08c3-4e14-b375-4ee01b7649b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:32.680584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b79ec1-08c3-4e14-b375-4ee01b7649b8 None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:32.681312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b79ec1-08c3-4e14-b375-4ee01b7649b8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:32.683236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b79ec1-08c3-4e14-b375-4ee01b7649b8 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:32.684801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: WARNING keystone.server.flask.common [None req-38b79ec1-08c3-4e14-b375-4ee01b7649b8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 27 14:38:32.727767 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.sql.core [None req-38b79ec1-08c3-4e14-b375-4ee01b7649b8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 27 14:38:32.727767 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 27 14:38:32.727767 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [parameters: {'id': 'b95f8d8d8701426281fb75a80bbf0761', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 27 14:38:32.727767 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91927) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 27 14:38:32.745612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-38b79ec1-08c3-4e14-b375-4ee01b7649b8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b95f8d8d8701426281fb75a80bbf0761.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b95f8d8d8701426281fb75a80bbf0761. Jun 27 14:38:32.745612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:32.745612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 14:38:32.745612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 14:38:32.745612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 14:38:32.745612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 14:38:32.745612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 14:38:32.745612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 14:38:32.745612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 14:38:32.745612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application conn.query(q) Jun 27 14:38:32.745612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 14:38:32.745612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 14:38:32.745612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application result.read() Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 27 14:38:32.746509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application next(self.gen) Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application yield resource Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application next(self.gen) Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self.session.rollback() Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self.force_reraise() Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise self.value Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application session.commit() Jun 27 14:38:32.747467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._prepare_impl() Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self.session.flush() Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._flush(objects) Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application compat.raise_( Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application flush_context.execute() Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 27 14:38:32.748367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rec.execute(self) Jun 27 14:38:32.749297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 27 14:38:32.749297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 27 14:38:32.749297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 27 14:38:32.749297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 27 14:38:32.749297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 27 14:38:32.749297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 27 14:38:32.749297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 27 14:38:32.749297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 27 14:38:32.749297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 27 14:38:32.749297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 27 14:38:32.749297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 27 14:38:32.749297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 27 14:38:32.749297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 27 14:38:32.749297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 27 14:38:32.749297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application conn.query(q) Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application result.read() Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 14:38:32.750108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 14:38:32.750969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 14:38:32.750969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 14:38:32.750969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 14:38:32.750969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 14:38:32.750969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 14:38:32.750969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 14:38:32.750969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 27 14:38:32.750969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 27 14:38:32.750969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [parameters: {'id': 'b95f8d8d8701426281fb75a80bbf0761', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 27 14:38:32.750969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 27 14:38:32.750969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:32.750969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:32.750969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:32.750969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:32.750969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:32.751758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:32.756874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:32.756874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 27 14:38:32.756874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 27 14:38:32.756874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:32.756874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:32.756874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 27 14:38:32.756874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 27 14:38:32.756874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b95f8d8d8701426281fb75a80bbf0761. Jun 27 14:38:32.756874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:32.756874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 463/947] 10.222.0.44 () {60 vars in 1140 bytes} [Mon Jun 27 14:38:32 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:32.759271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b72f18-2a5c-495f-92da-60062d0a41b9 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:32.866666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b72f18-2a5c-495f-92da-60062d0a41b9 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:32.884665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:32.903562 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337956c-018f-4d95-aef0-269a4b7109ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:32.904359 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337956c-018f-4d95-aef0-269a4b7109ad None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:32.904661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337956c-018f-4d95-aef0-269a4b7109ad None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:32.904953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337956c-018f-4d95-aef0-269a4b7109ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:32.911990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337956c-018f-4d95-aef0-269a4b7109ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:32.913466 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337956c-018f-4d95-aef0-269a4b7109ad None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:32.928500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-e337956c-018f-4d95-aef0-269a4b7109ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:32.928500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:32.928500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:32.928500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:32.928500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:32.928500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:32.928500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:32.928500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:32.928500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:32.928500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:32.928500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:32.928500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:32.928500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:32.928500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:32.928500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:32.929524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:32.930427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:32.930427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:32.930427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:32.930427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:32.930427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:32.930427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:32.930427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:32.930427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:32.930427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 485/948] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:32.939095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b79ec1-08c3-4e14-b375-4ee01b7649b8 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:33.039658 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:33.047699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b79ec1-08c3-4e14-b375-4ee01b7649b8 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:33.084284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823a76d-f16f-43a0-8d98-db37802fffdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:33.084975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823a76d-f16f-43a0-8d98-db37802fffdf None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:33.085258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823a76d-f16f-43a0-8d98-db37802fffdf None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:33.085537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823a76d-f16f-43a0-8d98-db37802fffdf None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:33.086297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823a76d-f16f-43a0-8d98-db37802fffdf None admin] RBAC: Adding query filter params (name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:33.086604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823a76d-f16f-43a0-8d98-db37802fffdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:33.088256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823a76d-f16f-43a0-8d98-db37802fffdf None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:33.109448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 464/949] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Jun 27 14:38:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:33.526051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a43bb5-ce00-4120-bd88-9a6029e9fde7 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:33.526507 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a43bb5-ce00-4120-bd88-9a6029e9fde7 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:33.526820 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a43bb5-ce00-4120-bd88-9a6029e9fde7 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:33.528596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 486/950] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:33.533891 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f06b32-415e-4140-a76c-22e25b10cb77 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:33.534352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f06b32-415e-4140-a76c-22e25b10cb77 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:33.534444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f06b32-415e-4140-a76c-22e25b10cb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:33.551997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-06f06b32-415e-4140-a76c-22e25b10cb77 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:33.553565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-06f06b32-415e-4140-a76c-22e25b10cb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:33.625334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 465/951] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:33.648912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a43bb5-ce00-4120-bd88-9a6029e9fde7 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:33.753949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a43bb5-ce00-4120-bd88-9a6029e9fde7 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:33.789393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028ade2-bb0b-4a7c-87f0-7b54bcd489ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:33.790136 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028ade2-bb0b-4a7c-87f0-7b54bcd489ba None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:33.790419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028ade2-bb0b-4a7c-87f0-7b54bcd489ba None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:33.790698 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028ade2-bb0b-4a7c-87f0-7b54bcd489ba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:33.800671 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea619f9-3806-4238-bc02-48ca16e86888 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:33.800993 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea619f9-3806-4238-bc02-48ca16e86888 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:33.801117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028ade2-bb0b-4a7c-87f0-7b54bcd489ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:33.801283 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea619f9-3806-4238-bc02-48ca16e86888 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:33.803898 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 466/952] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:38:33.807985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf5350-9067-4dd6-872d-123213700d8e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:33.808496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf5350-9067-4dd6-872d-123213700d8e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:33.808897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf5350-9067-4dd6-872d-123213700d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-e028ade2-bb0b-4a7c-87f0-7b54bcd489ba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:33.809720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:33.810719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:33.811609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:33.811609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:33.811609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:33.811609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:33.811609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:33.811609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:33.811609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:33.811609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:33.811609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:33.811609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:33.811609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 14:38:33.811609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:33.811609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 487/953] 10.222.0.44 () {56 vars in 1120 bytes} [Mon Jun 27 14:38:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:33.817160 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028ade2-bb0b-4a7c-87f0-7b54bcd489ba None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:33.829437 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-81cf5350-9067-4dd6-872d-123213700d8e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:33.831001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-81cf5350-9067-4dd6-872d-123213700d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:33.856240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:33.914144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 467/954] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 14:38:33.933656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028ade2-bb0b-4a7c-87f0-7b54bcd489ba None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:33.938525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf5350-9067-4dd6-872d-123213700d8e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:33.956952 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:33.977850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af9370-7d48-4fe1-8798-172db42490bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:33.978523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af9370-7d48-4fe1-8798-172db42490bf None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:33.978812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af9370-7d48-4fe1-8798-172db42490bf None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:33.979245 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af9370-7d48-4fe1-8798-172db42490bf None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:33.979918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af9370-7d48-4fe1-8798-172db42490bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:33.980229 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af9370-7d48-4fe1-8798-172db42490bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:33.981628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af9370-7d48-4fe1-8798-172db42490bf None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:33.990381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 488/955] 10.222.0.44 () {56 vars in 1115 bytes} [Mon Jun 27 14:38:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:33.991549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcd912-1ea1-418f-aa77-9631f7d3a502 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:33.991839 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcd912-1ea1-418f-aa77-9631f7d3a502 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:33.992121 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcd912-1ea1-418f-aa77-9631f7d3a502 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:33.993424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 489/956] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:33.998963 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcd912-1ea1-418f-aa77-9631f7d3a502 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:34.061817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf5350-9067-4dd6-872d-123213700d8e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:34.105062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab9d1f-51f3-4385-9f69-ad804a20d9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:34.106122 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab9d1f-51f3-4385-9f69-ad804a20d9ae None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:34.106406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab9d1f-51f3-4385-9f69-ad804a20d9ae None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:34.106681 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab9d1f-51f3-4385-9f69-ad804a20d9ae None admin] PATH_INFO: `/v3/services/compute` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:34.107341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab9d1f-51f3-4385-9f69-ad804a20d9ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:34.108809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab9d1f-51f3-4385-9f69-ad804a20d9ae None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:34.111156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:34.115673 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcd912-1ea1-418f-aa77-9631f7d3a502 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-12ab9d1f-51f3-4385-9f69-ad804a20d9ae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:34.121387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:34.128598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:34.129536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:34.129536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:34.129536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:34.129536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:34.129536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:34.129536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:34.129536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:34.129536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:34.129536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:34.129536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:34.129536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:34.129536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:34.129536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 14:38:34.129536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:34.129536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 468/957] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:34.130448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e15b75-21cf-44cc-ace4-e9a9176a78e1 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:34.130448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e15b75-21cf-44cc-ace4-e9a9176a78e1 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:34.130448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e15b75-21cf-44cc-ace4-e9a9176a78e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:34.146533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-72e15b75-21cf-44cc-ace4-e9a9176a78e1 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:34.147726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-72e15b75-21cf-44cc-ace4-e9a9176a78e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:34.153633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35388366-7d0e-4bb5-9170-c903c8097910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:34.154693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35388366-7d0e-4bb5-9170-c903c8097910 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:34.155524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35388366-7d0e-4bb5-9170-c903c8097910 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:34.155991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35388366-7d0e-4bb5-9170-c903c8097910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:34.169795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35388366-7d0e-4bb5-9170-c903c8097910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:34.172184 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35388366-7d0e-4bb5-9170-c903c8097910 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:34.193438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-35388366-7d0e-4bb5-9170-c903c8097910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:34.193438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:34.193438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:34.193438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:34.193438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:34.193438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:34.193438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:34.193438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:34.193438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:34.193438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:34.193438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:34.193438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:34.193438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:34.193438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:34.193438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:34.194404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:34.195350 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:34.195350 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:34.195350 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:34.195350 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:34.195350 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 490/958] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:34.195908 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35388366-7d0e-4bb5-9170-c903c8097910 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:34.223673 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 469/959] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:34.224556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e15b75-21cf-44cc-ace4-e9a9176a78e1 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:34.235528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:34.325605 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35388366-7d0e-4bb5-9170-c903c8097910 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:34.328090 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e15b75-21cf-44cc-ace4-e9a9176a78e1 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:34.364839 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef7969-5687-4a03-ac3a-5dfbbac05f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:34.365497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef7969-5687-4a03-ac3a-5dfbbac05f28 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:34.365782 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef7969-5687-4a03-ac3a-5dfbbac05f28 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:34.365903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e90d4-c20c-40e0-8322-1d0c71156bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:34.366101 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef7969-5687-4a03-ac3a-5dfbbac05f28 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:34.366474 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e90d4-c20c-40e0-8322-1d0c71156bdb None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:34.366759 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e90d4-c20c-40e0-8322-1d0c71156bdb None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:34.366855 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef7969-5687-4a03-ac3a-5dfbbac05f28 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:34.367030 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e90d4-c20c-40e0-8322-1d0c71156bdb None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:34.367125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef7969-5687-4a03-ac3a-5dfbbac05f28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:34.367760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e90d4-c20c-40e0-8322-1d0c71156bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:34.368069 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e90d4-c20c-40e0-8322-1d0c71156bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:34.368415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef7969-5687-4a03-ac3a-5dfbbac05f28 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:34.369617 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e90d4-c20c-40e0-8322-1d0c71156bdb None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:34.378506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 491/960] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Jun 27 14:38:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:34.378506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef7969-5687-4a03-ac3a-5dfbbac05f28 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:34.382510 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 470/961] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:34.383326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e90d4-c20c-40e0-8322-1d0c71156bdb None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:34.399192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:34.458382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:34.487041 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef7969-5687-4a03-ac3a-5dfbbac05f28 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:34.499861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e90d4-c20c-40e0-8322-1d0c71156bdb None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:34.521818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053eb94-cfb3-4a9f-8a10-ca301b47b2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:34.522628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053eb94-cfb3-4a9f-8a10-ca301b47b2e9 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:34.522914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053eb94-cfb3-4a9f-8a10-ca301b47b2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:34.523193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053eb94-cfb3-4a9f-8a10-ca301b47b2e9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:34.523848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053eb94-cfb3-4a9f-8a10-ca301b47b2e9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:34.525241 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053eb94-cfb3-4a9f-8a10-ca301b47b2e9 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:34.537272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100e777-06f5-4855-a20c-aa36585e3b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:34.537936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100e777-06f5-4855-a20c-aa36585e3b1b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:34.538223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100e777-06f5-4855-a20c-aa36585e3b1b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:34.538501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100e777-06f5-4855-a20c-aa36585e3b1b None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:34.539208 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100e777-06f5-4855-a20c-aa36585e3b1b None admin] RBAC: Adding query filter params (type=compute) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:34.539514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100e777-06f5-4855-a20c-aa36585e3b1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:34.540875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100e777-06f5-4855-a20c-aa36585e3b1b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-4053eb94-cfb3-4a9f-8a10-ca301b47b2e9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:34.541716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:34.543226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:34.544080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:34.544080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:34.544080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:34.544080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:34.544080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:34.544080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:34.544080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:34.544080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:34.544080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:34.544080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:34.544080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:34.544080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:34.544080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 14:38:34.544080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:34.556972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 492/962] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Jun 27 14:38:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:34.556972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053eb94-cfb3-4a9f-8a10-ca301b47b2e9 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:34.557306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 471/963] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Jun 27 14:38:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:34.559350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100e777-06f5-4855-a20c-aa36585e3b1b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:34.669055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:34.679372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053eb94-cfb3-4a9f-8a10-ca301b47b2e9 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:34.703827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100e777-06f5-4855-a20c-aa36585e3b1b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:34.734831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e9a25-b311-46f5-8870-f4921cb515f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:34.734831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e9a25-b311-46f5-8870-f4921cb515f3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:34.734831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e9a25-b311-46f5-8870-f4921cb515f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:34.735188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e9a25-b311-46f5-8870-f4921cb515f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:34.742100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:34.752669 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e9a25-b311-46f5-8870-f4921cb515f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:34.752669 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e9a25-b311-46f5-8870-f4921cb515f3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:34.757348 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6056802-159e-48ed-b6ab-33856355cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:34.758025 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6056802-159e-48ed-b6ab-33856355cbac None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:34.758310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6056802-159e-48ed-b6ab-33856355cbac None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:34.758588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6056802-159e-48ed-b6ab-33856355cbac None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:34.759308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6056802-159e-48ed-b6ab-33856355cbac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:34.759618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6056802-159e-48ed-b6ab-33856355cbac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:34.761649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6056802-159e-48ed-b6ab-33856355cbac None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-d95e9a25-b311-46f5-8870-f4921cb515f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:34.763197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:34.764158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:34.765439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:34.765439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:34.765439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:34.765439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:34.765439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:34.765439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:34.765439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:34.765439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:34.765439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 14:38:34.765439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:34.765439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 493/964] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Jun 27 14:38:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:34.767130 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 472/965] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Jun 27 14:38:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:34.773131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6056802-159e-48ed-b6ab-33856355cbac None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:34.774020 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e9a25-b311-46f5-8870-f4921cb515f3 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:34.890859 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e9a25-b311-46f5-8870-f4921cb515f3 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:34.897413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6056802-159e-48ed-b6ab-33856355cbac None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:34.930472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d77a14-1b50-4611-8332-4e3538268b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:34.931495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d77a14-1b50-4611-8332-4e3538268b1a None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:34.932001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d77a14-1b50-4611-8332-4e3538268b1a None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:34.933033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d77a14-1b50-4611-8332-4e3538268b1a None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:34.934614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d77a14-1b50-4611-8332-4e3538268b1a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:34.935583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d77a14-1b50-4611-8332-4e3538268b1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:34.937725 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d77a14-1b50-4611-8332-4e3538268b1a None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:34.939537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87905912-f779-4127-989a-cc3f5734fd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:34.940476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87905912-f779-4127-989a-cc3f5734fd95 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:34.940810 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87905912-f779-4127-989a-cc3f5734fd95 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:34.941086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87905912-f779-4127-989a-cc3f5734fd95 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:34.941797 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87905912-f779-4127-989a-cc3f5734fd95 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:34.942969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87905912-f779-4127-989a-cc3f5734fd95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:34.944343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87905912-f779-4127-989a-cc3f5734fd95 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:34.949505 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:34.951655 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 473/966] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Jun 27 14:38:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:34.957135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87905912-f779-4127-989a-cc3f5734fd95 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:34.966864 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 494/967] 10.222.0.44 () {56 vars in 1149 bytes} [Mon Jun 27 14:38:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:34.972948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d77a14-1b50-4611-8332-4e3538268b1a None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:35.020721 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:35.064888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87905912-f779-4127-989a-cc3f5734fd95 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:35.088463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d77a14-1b50-4611-8332-4e3538268b1a None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:35.111242 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef766db-d9c5-497d-bbc6-f3308dfcb034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:35.111906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef766db-d9c5-497d-bbc6-f3308dfcb034 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:35.112184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef766db-d9c5-497d-bbc6-f3308dfcb034 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:35.112455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef766db-d9c5-497d-bbc6-f3308dfcb034 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:35.113224 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef766db-d9c5-497d-bbc6-f3308dfcb034 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:35.114669 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef766db-d9c5-497d-bbc6-f3308dfcb034 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:35.130175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53e6fa-15db-4388-b576-9ce8419505f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:35.130957 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53e6fa-15db-4388-b576-9ce8419505f7 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:35.131309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53e6fa-15db-4388-b576-9ce8419505f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:35.131658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53e6fa-15db-4388-b576-9ce8419505f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:35.208757 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 474/968] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Jun 27 14:38:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:38:35.210870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:35.218705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53e6fa-15db-4388-b576-9ce8419505f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:35.220368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53e6fa-15db-4388-b576-9ce8419505f7 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:35.305936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0fa41-8af9-48f2-baa4-6e2b42aa79b4 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:35.306277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0fa41-8af9-48f2-baa4-6e2b42aa79b4 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:35.306551 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0fa41-8af9-48f2-baa4-6e2b42aa79b4 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:35.309132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 475/969] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:38:35.316381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917e1b0-adf7-4688-8488-b5241c935c12 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:35.316924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917e1b0-adf7-4688-8488-b5241c935c12 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:35.317051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917e1b0-adf7-4688-8488-b5241c935c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:35.335191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-3917e1b0-adf7-4688-8488-b5241c935c12 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:35.336443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-3917e1b0-adf7-4688-8488-b5241c935c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:35.347050 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 495/970] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:34 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:38:35.356681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53e6fa-15db-4388-b576-9ce8419505f7 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:35.424572 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 476/971] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:35.452147 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917e1b0-adf7-4688-8488-b5241c935c12 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:35.471199 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:35.480160 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53e6fa-15db-4388-b576-9ce8419505f7 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:35.506794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:35.528566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a38d4-8423-4f73-8eb0-fa42d4899af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:35.529745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a38d4-8423-4f73-8eb0-fa42d4899af9 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:35.530232 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a38d4-8423-4f73-8eb0-fa42d4899af9 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:35.530829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a38d4-8423-4f73-8eb0-fa42d4899af9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:35.545564 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a38d4-8423-4f73-8eb0-fa42d4899af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:35.548070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a38d4-8423-4f73-8eb0-fa42d4899af9 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:35.568982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917e1b0-adf7-4688-8488-b5241c935c12 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:35.574808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-137a38d4-8423-4f73-8eb0-fa42d4899af9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:35.574808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:35.574808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:35.574808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:35.574808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:35.574808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:35.574808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:35.574808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:35.574808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:35.574808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:35.574808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:35.574808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:35.574808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:35.574808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:35.574808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:35.575860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:35.576988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:35.576988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:35.576988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:35.576988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:35.578843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 496/972] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:35.584925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a38d4-8423-4f73-8eb0-fa42d4899af9 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:35.614422 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01716c45-487b-4030-8336-675fcc340be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:35.615475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01716c45-487b-4030-8336-675fcc340be8 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:35.615957 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01716c45-487b-4030-8336-675fcc340be8 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:35.616293 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01716c45-487b-4030-8336-675fcc340be8 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:35.617069 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01716c45-487b-4030-8336-675fcc340be8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:35.618704 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01716c45-487b-4030-8336-675fcc340be8 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:35.689740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.sql.core [None req-01716c45-487b-4030-8336-675fcc340be8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 27 14:38:35.689740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 27 14:38:35.689740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [parameters: {'user_id': '14e7d14eeb144f02b6cf719d2a15fbcf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 27 14:38:35.689740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91927) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 27 14:38:35.696021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a38d4-8423-4f73-8eb0-fa42d4899af9 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:35.698457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-01716c45-487b-4030-8336-675fcc340be8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 27 14:38:35.698457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:35.698457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 14:38:35.698457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 14:38:35.698457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 14:38:35.698457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 14:38:35.698457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 14:38:35.698457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 14:38:35.698457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 14:38:35.698457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application conn.query(q) Jun 27 14:38:35.698457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 14:38:35.698457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 14:38:35.698457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 14:38:35.698457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application result.read() Jun 27 14:38:35.698457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 14:38:35.699323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application next(self.gen) Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application yield resource Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application next(self.gen) Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self.session.rollback() Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self.force_reraise() Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise self.value Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application session.commit() Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 27 14:38:35.700285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._prepare_impl() Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self.session.flush() Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._flush(objects) Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application compat.raise_( Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application flush_context.execute() Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rec.execute(self) Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 27 14:38:35.701244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 14:38:35.702165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application conn.query(q) Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application result.read() Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 14:38:35.703036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 14:38:35.703888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 14:38:35.703888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 14:38:35.703888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 14:38:35.703888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 14:38:35.703888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 27 14:38:35.703888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 27 14:38:35.703888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [parameters: {'user_id': '14e7d14eeb144f02b6cf719d2a15fbcf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 27 14:38:35.703888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 27 14:38:35.703888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:35.703888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:35.703888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:35.703888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:35.703888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:35.703888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:35.703888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 27 14:38:35.704715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 27 14:38:35.705638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 27 14:38:35.705638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 27 14:38:35.705638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 27 14:38:35.705638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 27 14:38:35.705638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 27 14:38:35.705638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:35.705638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 477/973] 10.222.0.44 () {60 vars in 1131 bytes} [Mon Jun 27 14:38:35 2022] POST /identity/v3/users => generated 160 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:35.712689 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01716c45-487b-4030-8336-675fcc340be8 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:35.745711 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa78b61-e504-4cb2-9da7-2557e74b0af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:35.746915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa78b61-e504-4cb2-9da7-2557e74b0af1 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:35.747325 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa78b61-e504-4cb2-9da7-2557e74b0af1 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:35.747615 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa78b61-e504-4cb2-9da7-2557e74b0af1 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:35.748362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa78b61-e504-4cb2-9da7-2557e74b0af1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:35.748852 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa78b61-e504-4cb2-9da7-2557e74b0af1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:35.750802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa78b61-e504-4cb2-9da7-2557e74b0af1 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:35.768818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 497/974] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:35.771678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa78b61-e504-4cb2-9da7-2557e74b0af1 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:35.789126 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:35.845258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01716c45-487b-4030-8336-675fcc340be8 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:35.849031 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:35.892245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355601ed-9821-4f27-b1e7-365c4dc2c400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:35.893668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355601ed-9821-4f27-b1e7-365c4dc2c400 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:35.894437 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355601ed-9821-4f27-b1e7-365c4dc2c400 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:35.895237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355601ed-9821-4f27-b1e7-365c4dc2c400 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:35.898074 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa78b61-e504-4cb2-9da7-2557e74b0af1 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:35.905472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355601ed-9821-4f27-b1e7-365c4dc2c400 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:35.909049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355601ed-9821-4f27-b1e7-365c4dc2c400 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-355601ed-9821-4f27-b1e7-365c4dc2c400 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:35.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:35.925637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:35.926682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:35.926682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:35.926682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:35.926682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:35.926682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:35.926682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:35.926682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:35.926682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:35.926682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 14:38:35.926682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:35.931660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 478/975] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:38:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:35.932880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355601ed-9821-4f27-b1e7-365c4dc2c400 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:35.942391 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cba5b3-0c41-4df2-b0ef-53ac257a12a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:35.944183 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cba5b3-0c41-4df2-b0ef-53ac257a12a3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:35.944621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cba5b3-0c41-4df2-b0ef-53ac257a12a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:35.945076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cba5b3-0c41-4df2-b0ef-53ac257a12a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:35.956077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cba5b3-0c41-4df2-b0ef-53ac257a12a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:35.958360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cba5b3-0c41-4df2-b0ef-53ac257a12a3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:35.977749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-80cba5b3-0c41-4df2-b0ef-53ac257a12a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:35.977749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:35.977749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:35.977749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:35.977749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:35.977749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:35.977749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:35.977749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:35.977749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:35.977749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:35.977749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:35.977749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:35.977749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:35.977749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:35.977749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:35.978883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:35.980299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:35.980299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:35.980299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:35.980299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:35.980299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:35.980299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:35.980299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:35.980299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:35.987012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 498/976] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:35.987638 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cba5b3-0c41-4df2-b0ef-53ac257a12a3 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:36.049576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355601ed-9821-4f27-b1e7-365c4dc2c400 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:36.080525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:36.095283 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc6f4b-df1c-487f-a9f0-d50a25ec3df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:36.095920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc6f4b-df1c-487f-a9f0-d50a25ec3df6 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:36.096963 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc6f4b-df1c-487f-a9f0-d50a25ec3df6 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:36.096963 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc6f4b-df1c-487f-a9f0-d50a25ec3df6 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:36.097509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc6f4b-df1c-487f-a9f0-d50a25ec3df6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:36.097843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc6f4b-df1c-487f-a9f0-d50a25ec3df6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:36.099366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc6f4b-df1c-487f-a9f0-d50a25ec3df6 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:36.119870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cba5b3-0c41-4df2-b0ef-53ac257a12a3 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:36.144402 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 479/977] 10.222.0.44 () {56 vars in 1101 bytes} [Mon Jun 27 14:38:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:36.158283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f2870-d3fc-450d-a46e-97fea9a5a43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:36.159344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f2870-d3fc-450d-a46e-97fea9a5a43c None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:36.159862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f2870-d3fc-450d-a46e-97fea9a5a43c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:36.160343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f2870-d3fc-450d-a46e-97fea9a5a43c None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:36.161443 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f2870-d3fc-450d-a46e-97fea9a5a43c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:36.162001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f2870-d3fc-450d-a46e-97fea9a5a43c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:36.163688 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f2870-d3fc-450d-a46e-97fea9a5a43c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:36.179069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 499/978] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:36.185908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc6f4b-df1c-487f-a9f0-d50a25ec3df6 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:36.218214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:36.308293 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc6f4b-df1c-487f-a9f0-d50a25ec3df6 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:36.351278 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9f540-9d31-4a3b-abbc-648fac207066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:36.351945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9f540-9d31-4a3b-abbc-648fac207066 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:36.352228 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9f540-9d31-4a3b-abbc-648fac207066 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:36.352506 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9f540-9d31-4a3b-abbc-648fac207066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:36.353389 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9f540-9d31-4a3b-abbc-648fac207066 None admin] RBAC: Adding query filter params (role.id=c9c2c328f42a430fa25f0ec124d672f1, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=d87edb187b2f4d6194cb7c94a3d690e6) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:36.353705 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9f540-9d31-4a3b-abbc-648fac207066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:36.355640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9f540-9d31-4a3b-abbc-648fac207066 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:36.362140 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 480/979] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:36 2022] GET /identity/v3/role_assignments?user.id=d87edb187b2f4d6194cb7c94a3d690e6&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=c9c2c328f42a430fa25f0ec124d672f1 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:36.652427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615e3d9-4229-4fe0-89b1-6df6cd3f3a38 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:36.652807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615e3d9-4229-4fe0-89b1-6df6cd3f3a38 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:36.653018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615e3d9-4229-4fe0-89b1-6df6cd3f3a38 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:36.654521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 500/980] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:36.659667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468a33c-7e09-4dc7-aef2-949732a56ae0 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:36.660108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468a33c-7e09-4dc7-aef2-949732a56ae0 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:36.660292 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468a33c-7e09-4dc7-aef2-949732a56ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:36.676943 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-2468a33c-7e09-4dc7-aef2-949732a56ae0 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:36.678444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2468a33c-7e09-4dc7-aef2-949732a56ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:36.749336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 481/981] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:36.779545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615e3d9-4229-4fe0-89b1-6df6cd3f3a38 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:36.884948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615e3d9-4229-4fe0-89b1-6df6cd3f3a38 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:36.912545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:36.920979 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0cfb0-d7e8-4b5b-a239-7d3367c63250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:36.921701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0cfb0-d7e8-4b5b-a239-7d3367c63250 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:36.922045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0cfb0-d7e8-4b5b-a239-7d3367c63250 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:36.922321 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0cfb0-d7e8-4b5b-a239-7d3367c63250 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:36.923059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0cfb0-d7e8-4b5b-a239-7d3367c63250 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:36.924412 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0cfb0-d7e8-4b5b-a239-7d3367c63250 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:37.003739 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 501/982] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Jun 27 14:38:36 2022] POST /identity/v3/services => generated 242 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:38:37.402563 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db297386-bfc3-46e6-bb30-6d6c9698b87e None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:37.405242 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db297386-bfc3-46e6-bb30-6d6c9698b87e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:37.405242 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db297386-bfc3-46e6-bb30-6d6c9698b87e None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:37.405242 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 482/983] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:37.409939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c1a1e-c1e3-4b86-b285-82c9a760dfca None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:37.410231 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c1a1e-c1e3-4b86-b285-82c9a760dfca None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:37.410511 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c1a1e-c1e3-4b86-b285-82c9a760dfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:37.427732 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-533c1a1e-c1e3-4b86-b285-82c9a760dfca None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:37.428911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-533c1a1e-c1e3-4b86-b285-82c9a760dfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:37.508365 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 502/984] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:37.532271 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db297386-bfc3-46e6-bb30-6d6c9698b87e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:37.551886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:37.637915 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db297386-bfc3-46e6-bb30-6d6c9698b87e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:37.671663 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8d0fe-4d30-49c1-8fd7-7b5f2db93e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:37.673269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8d0fe-4d30-49c1-8fd7-7b5f2db93e2a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:37.673755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8d0fe-4d30-49c1-8fd7-7b5f2db93e2a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:37.674238 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8d0fe-4d30-49c1-8fd7-7b5f2db93e2a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:37.675083 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8d0fe-4d30-49c1-8fd7-7b5f2db93e2a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:37.676628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8d0fe-4d30-49c1-8fd7-7b5f2db93e2a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-7dd8d0fe-4d30-49c1-8fd7-7b5f2db93e2a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:37.689331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:37.690485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:37.691366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:37.691366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:37.691366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:37.691366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:37.691366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:37.691366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:37.691366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:37.691366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:37.691366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:37.691366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:37.691366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:37.691366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:37.691366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 14:38:37.691366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:37.692130 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 483/985] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Jun 27 14:38:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:37.698692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c1a1e-c1e3-4b86-b285-82c9a760dfca None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:37.800454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c1a1e-c1e3-4b86-b285-82c9a760dfca None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:37.814925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:37.834504 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587f5a4-9fd5-4d47-bb2d-5373e783ada5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:37.835167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587f5a4-9fd5-4d47-bb2d-5373e783ada5 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:37.835454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587f5a4-9fd5-4d47-bb2d-5373e783ada5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:37.835730 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587f5a4-9fd5-4d47-bb2d-5373e783ada5 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:37.836433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587f5a4-9fd5-4d47-bb2d-5373e783ada5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:37.836769 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587f5a4-9fd5-4d47-bb2d-5373e783ada5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:37.838126 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587f5a4-9fd5-4d47-bb2d-5373e783ada5 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:37.847800 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 503/986] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Jun 27 14:38:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:37.849043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8d0fe-4d30-49c1-8fd7-7b5f2db93e2a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:37.930916 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:37.950153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8d0fe-4d30-49c1-8fd7-7b5f2db93e2a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:37.987171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b718c-4390-4318-89f6-c0493c90fe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:37.987832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b718c-4390-4318-89f6-c0493c90fe9b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:37.988109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b718c-4390-4318-89f6-c0493c90fe9b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:37.988381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b718c-4390-4318-89f6-c0493c90fe9b None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:37.989115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b718c-4390-4318-89f6-c0493c90fe9b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:37.989421 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b718c-4390-4318-89f6-c0493c90fe9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:37.990765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b718c-4390-4318-89f6-c0493c90fe9b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:37.996499 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 484/987] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Jun 27 14:38:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:38.002035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587f5a4-9fd5-4d47-bb2d-5373e783ada5 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:38.114513 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587f5a4-9fd5-4d47-bb2d-5373e783ada5 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:38.152710 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d8f33-9394-48ff-a9d6-2e55c1e882b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:38.153384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d8f33-9394-48ff-a9d6-2e55c1e882b5 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:38.153671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d8f33-9394-48ff-a9d6-2e55c1e882b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:38.153947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d8f33-9394-48ff-a9d6-2e55c1e882b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:38.154753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d8f33-9394-48ff-a9d6-2e55c1e882b5 None admin] RBAC: Adding query filter params (interface=admin, service_id=32ca0db73062447485b3749da95983ed, region_id=RegionOne) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:38.155071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d8f33-9394-48ff-a9d6-2e55c1e882b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:38.156431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d8f33-9394-48ff-a9d6-2e55c1e882b5 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:38.166330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 504/988] 10.222.0.44 () {56 vars in 1249 bytes} [Mon Jun 27 14:38:38 2022] GET /identity/v3/endpoints?service_id=32ca0db73062447485b3749da95983ed&interface=admin®ion_id=RegionOne => generated 193 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:38.168862 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b718c-4390-4318-89f6-c0493c90fe9b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:38.270544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b718c-4390-4318-89f6-c0493c90fe9b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:38.304210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7cee1-3583-4c33-8522-a087a157ab82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:38.304899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7cee1-3583-4c33-8522-a087a157ab82 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:38.305188 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7cee1-3583-4c33-8522-a087a157ab82 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:38.305463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7cee1-3583-4c33-8522-a087a157ab82 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:38.306144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7cee1-3583-4c33-8522-a087a157ab82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:38.308056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7cee1-3583-4c33-8522-a087a157ab82 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:38.314865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 485/989] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Jun 27 14:38:38 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:38:38.478966 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b2321-48ed-41f8-887d-3f84df2b2395 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:38.479817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b2321-48ed-41f8-887d-3f84df2b2395 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:38.480094 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b2321-48ed-41f8-887d-3f84df2b2395 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:38.481636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 505/990] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:38.487018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9e932-106f-4bd3-83f8-3418c564f824 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:38.487309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9e932-106f-4bd3-83f8-3418c564f824 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:38.487588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9e932-106f-4bd3-83f8-3418c564f824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:38.505704 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-beb9e932-106f-4bd3-83f8-3418c564f824 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:38.507061 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-beb9e932-106f-4bd3-83f8-3418c564f824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:38.509294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:38.577878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 486/991] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:38.600934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b2321-48ed-41f8-887d-3f84df2b2395 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:38.646987 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:38.707571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b2321-48ed-41f8-887d-3f84df2b2395 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:38.742606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37b955-3665-4271-b9fb-eb6ffc8715a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:38.743441 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37b955-3665-4271-b9fb-eb6ffc8715a9 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:38.743726 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37b955-3665-4271-b9fb-eb6ffc8715a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:38.744005 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37b955-3665-4271-b9fb-eb6ffc8715a9 None admin] PATH_INFO: `/v3/services/image` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:38.744686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37b955-3665-4271-b9fb-eb6ffc8715a9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:38.746469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37b955-3665-4271-b9fb-eb6ffc8715a9 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-3d37b955-3665-4271-b9fb-eb6ffc8715a9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:38.758142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:38.759217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:38.760071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:38.760071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:38.760071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:38.760071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:38.760071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:38.760071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:38.760071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:38.760071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:38.760071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:38.760071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:38.760071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:38.760071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:38.760071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 14:38:38.760071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:38.764708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 506/992] 10.222.0.44 () {56 vars in 1105 bytes} [Mon Jun 27 14:38:38 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:38.766055 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9e932-106f-4bd3-83f8-3418c564f824 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:38.879437 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9e932-106f-4bd3-83f8-3418c564f824 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:38.906663 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce216f-845e-4b1c-aaa9-e2c822fc5ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:38.907309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce216f-845e-4b1c-aaa9-e2c822fc5ac7 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:38.907590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce216f-845e-4b1c-aaa9-e2c822fc5ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:38.910153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce216f-845e-4b1c-aaa9-e2c822fc5ac7 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:38.910153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce216f-845e-4b1c-aaa9-e2c822fc5ac7 None admin] RBAC: Adding query filter params (name=image) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:38.910153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce216f-845e-4b1c-aaa9-e2c822fc5ac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:38.910383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce216f-845e-4b1c-aaa9-e2c822fc5ac7 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:38.920253 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 487/993] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:38.921846 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37b955-3665-4271-b9fb-eb6ffc8715a9 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:39.026355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37b955-3665-4271-b9fb-eb6ffc8715a9 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:39.033478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:39.049226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447f357-adc1-476e-b041-9e4ff0545247 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:39.049517 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447f357-adc1-476e-b041-9e4ff0545247 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:39.049788 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447f357-adc1-476e-b041-9e4ff0545247 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:39.051245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 488/994] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:39.056776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87742f81-874d-43ae-8461-894189e174e8 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:39.057067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87742f81-874d-43ae-8461-894189e174e8 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:39.057887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87742f81-874d-43ae-8461-894189e174e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:39.062965 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:39.071223 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf45574-f2a0-481f-affb-55c0c67cae0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:39.071900 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf45574-f2a0-481f-affb-55c0c67cae0f None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:39.072276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf45574-f2a0-481f-affb-55c0c67cae0f None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:39.072460 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf45574-f2a0-481f-affb-55c0c67cae0f None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:39.074451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf45574-f2a0-481f-affb-55c0c67cae0f None admin] RBAC: Adding query filter params (type=image) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:39.074763 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf45574-f2a0-481f-affb-55c0c67cae0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:39.076269 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf45574-f2a0-481f-affb-55c0c67cae0f None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:39.076491 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-87742f81-874d-43ae-8461-894189e174e8 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:39.077714 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-87742f81-874d-43ae-8461-894189e174e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:39.081194 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 507/995] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:38 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:39.162179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 489/996] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 14:38:39.186835 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf45574-f2a0-481f-affb-55c0c67cae0f None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:39.297900 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf45574-f2a0-481f-affb-55c0c67cae0f None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:39.332928 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdfa41-53ef-444d-9e70-f869264dda2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:39.333722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdfa41-53ef-444d-9e70-f869264dda2e None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:39.334002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdfa41-53ef-444d-9e70-f869264dda2e None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:39.334285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdfa41-53ef-444d-9e70-f869264dda2e None admin] PATH_INFO: `/v3/services/compute` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:39.334941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdfa41-53ef-444d-9e70-f869264dda2e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:39.336308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdfa41-53ef-444d-9e70-f869264dda2e None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-fefdfa41-53ef-444d-9e70-f869264dda2e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:39.348939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:39.349982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:39.351262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:39.351262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:39.351262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:39.351262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:39.351262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:39.351262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:39.351262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:39.351262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:39.351262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:39.351262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:39.351262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:39.351262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:39.351262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 14:38:39.351262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:39.351262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 508/997] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:39.356661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87742f81-874d-43ae-8461-894189e174e8 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:39.461190 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87742f81-874d-43ae-8461-894189e174e8 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:39.490579 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:39.496082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab47a7-28c9-47ba-b4db-9e740aedf559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:39.496780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab47a7-28c9-47ba-b4db-9e740aedf559 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:39.497064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab47a7-28c9-47ba-b4db-9e740aedf559 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:39.497337 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab47a7-28c9-47ba-b4db-9e740aedf559 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:39.498043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab47a7-28c9-47ba-b4db-9e740aedf559 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:39.498347 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab47a7-28c9-47ba-b4db-9e740aedf559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:39.499692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab47a7-28c9-47ba-b4db-9e740aedf559 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:39.504827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 490/998] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Jun 27 14:38:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:39.510224 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdfa41-53ef-444d-9e70-f869264dda2e None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:39.546458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:39.615811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdfa41-53ef-444d-9e70-f869264dda2e None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:39.651467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1b8b7-4557-4901-a25a-0369b44c0ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:39.652202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1b8b7-4557-4901-a25a-0369b44c0ccc None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:39.652489 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1b8b7-4557-4901-a25a-0369b44c0ccc None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:39.652802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1b8b7-4557-4901-a25a-0369b44c0ccc None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:39.653514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1b8b7-4557-4901-a25a-0369b44c0ccc None admin] RBAC: Adding query filter params (type=compute) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:39.653823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1b8b7-4557-4901-a25a-0369b44c0ccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:39.655180 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1b8b7-4557-4901-a25a-0369b44c0ccc None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:39.660340 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 509/999] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Jun 27 14:38:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:39.665943 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab47a7-28c9-47ba-b4db-9e740aedf559 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:39.766959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab47a7-28c9-47ba-b4db-9e740aedf559 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:39.800672 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43cd58-e91e-4547-a110-f7c4b83ff048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:39.801341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43cd58-e91e-4547-a110-f7c4b83ff048 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:39.801667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43cd58-e91e-4547-a110-f7c4b83ff048 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:39.801942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43cd58-e91e-4547-a110-f7c4b83ff048 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:39.802724 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43cd58-e91e-4547-a110-f7c4b83ff048 None admin] RBAC: Adding query filter params (interface=public, service_id=082bca0ccb894f96afbd8f47282e8a40, region_id=RegionOne) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:39.803029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43cd58-e91e-4547-a110-f7c4b83ff048 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:39.804370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43cd58-e91e-4547-a110-f7c4b83ff048 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:39.814450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 491/1000] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Jun 27 14:38:39 2022] GET /identity/v3/endpoints?service_id=082bca0ccb894f96afbd8f47282e8a40&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:39.815830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1b8b7-4557-4901-a25a-0369b44c0ccc None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:39.914398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:39.918609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1b8b7-4557-4901-a25a-0369b44c0ccc None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:39.954067 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc678f5f-a472-4df6-9bcc-627da6d9a963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:39.955082 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc678f5f-a472-4df6-9bcc-627da6d9a963 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:39.955582 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc678f5f-a472-4df6-9bcc-627da6d9a963 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:39.956065 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc678f5f-a472-4df6-9bcc-627da6d9a963 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:39.957010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc678f5f-a472-4df6-9bcc-627da6d9a963 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:39.958581 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc678f5f-a472-4df6-9bcc-627da6d9a963 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:39.965487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 510/1001] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Jun 27 14:38:39 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:38:40.358104 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b4ffa-5907-4a18-9b36-05797f7299c5 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:40.358450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b4ffa-5907-4a18-9b36-05797f7299c5 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:40.358626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b4ffa-5907-4a18-9b36-05797f7299c5 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:40.359984 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 492/1002] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:40.365149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830ea9c-17c1-4429-8783-4a55a61e5037 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:40.365623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830ea9c-17c1-4429-8783-4a55a61e5037 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:40.365706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830ea9c-17c1-4429-8783-4a55a61e5037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:40.382572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-8830ea9c-17c1-4429-8783-4a55a61e5037 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:40.383747 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-8830ea9c-17c1-4429-8783-4a55a61e5037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:40.451807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 511/1003] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:40.474624 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b4ffa-5907-4a18-9b36-05797f7299c5 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:40.535035 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:40.576763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b4ffa-5907-4a18-9b36-05797f7299c5 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:40.610857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cf269-159e-47ad-a628-c94027c03c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:40.611574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cf269-159e-47ad-a628-c94027c03c60 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:40.611854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cf269-159e-47ad-a628-c94027c03c60 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:40.612179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cf269-159e-47ad-a628-c94027c03c60 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:40.612857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cf269-159e-47ad-a628-c94027c03c60 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:40.614207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cf269-159e-47ad-a628-c94027c03c60 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-0c1cf269-159e-47ad-a628-c94027c03c60 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:40.626742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:40.627760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:40.628628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:40.628628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:40.628628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:40.628628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:40.628628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:40.628628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:40.628628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:40.628628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:40.628628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:40.628628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:40.628628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:40.628628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:40.628628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 14:38:40.628628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:40.636679 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 493/1004] 10.222.0.44 () {56 vars in 1126 bytes} [Mon Jun 27 14:38:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:40.636821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830ea9c-17c1-4429-8783-4a55a61e5037 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:40.729044 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:40.738682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830ea9c-17c1-4429-8783-4a55a61e5037 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:40.773566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3642c-8991-45ea-a99b-36c4f5007f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:40.774457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3642c-8991-45ea-a99b-36c4f5007f94 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:40.774912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3642c-8991-45ea-a99b-36c4f5007f94 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:40.775335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3642c-8991-45ea-a99b-36c4f5007f94 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:40.776403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3642c-8991-45ea-a99b-36c4f5007f94 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:40.776940 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3642c-8991-45ea-a99b-36c4f5007f94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:40.778850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3642c-8991-45ea-a99b-36c4f5007f94 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:40.784346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 512/1005] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Jun 27 14:38:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:40.789643 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cf269-159e-47ad-a628-c94027c03c60 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:40.891833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cf269-159e-47ad-a628-c94027c03c60 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:40.914782 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:40.925642 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d86f4-ae68-43c9-87f2-860f9903bc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:40.926305 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d86f4-ae68-43c9-87f2-860f9903bc92 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:40.926582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d86f4-ae68-43c9-87f2-860f9903bc92 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:40.926856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d86f4-ae68-43c9-87f2-860f9903bc92 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:40.927558 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d86f4-ae68-43c9-87f2-860f9903bc92 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:40.927865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d86f4-ae68-43c9-87f2-860f9903bc92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:40.929235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d86f4-ae68-43c9-87f2-860f9903bc92 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:40.934290 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 494/1006] 10.222.0.44 () {56 vars in 1122 bytes} [Mon Jun 27 14:38:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:40.939679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3642c-8991-45ea-a99b-36c4f5007f94 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:41.038580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3642c-8991-45ea-a99b-36c4f5007f94 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:41.074606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ed682-c253-4d75-94ec-6d58a691e882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:41.075263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ed682-c253-4d75-94ec-6d58a691e882 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:41.075544 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ed682-c253-4d75-94ec-6d58a691e882 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:41.075817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ed682-c253-4d75-94ec-6d58a691e882 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:41.076563 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ed682-c253-4d75-94ec-6d58a691e882 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:41.077948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ed682-c253-4d75-94ec-6d58a691e882 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:41.146719 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb30d7-f2f5-421c-a332-840d9b5e0e59 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:41.147010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb30d7-f2f5-421c-a332-840d9b5e0e59 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:41.147286 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb30d7-f2f5-421c-a332-840d9b5e0e59 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:41.148851 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 495/1007] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:38:41.153780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0893f29-fa3b-45b2-90c8-bdf7925db5da None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:41.154069 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0893f29-fa3b-45b2-90c8-bdf7925db5da None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:41.154350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0893f29-fa3b-45b2-90c8-bdf7925db5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:41.165411 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 513/1008] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Jun 27 14:38:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:38:41.171505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f0893f29-fa3b-45b2-90c8-bdf7925db5da None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:41.172795 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f0893f29-fa3b-45b2-90c8-bdf7925db5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:41.254923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 496/1009] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:41 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 14:38:41.279327 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ed682-c253-4d75-94ec-6d58a691e882 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:41.300019 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:41.386757 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ed682-c253-4d75-94ec-6d58a691e882 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:41.421859 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a146d3-41ba-4b5b-8653-daa08c285ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:41.422452 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a146d3-41ba-4b5b-8653-daa08c285ae3 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:41.422737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a146d3-41ba-4b5b-8653-daa08c285ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:41.423014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a146d3-41ba-4b5b-8653-daa08c285ae3 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:41.423750 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a146d3-41ba-4b5b-8653-daa08c285ae3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:41.425135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a146d3-41ba-4b5b-8653-daa08c285ae3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:41.513044 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 514/1010] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Jun 27 14:38:41 2022] POST /identity/v3/services => generated 242 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:38:42.045571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cd671-1d22-4b22-bf25-1ec83dcf0d4c None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:42.046127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cd671-1d22-4b22-bf25-1ec83dcf0d4c None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:42.046127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cd671-1d22-4b22-bf25-1ec83dcf0d4c None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:42.047627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 497/1011] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:42.052560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748ad11-81d6-433e-b737-4d342bbb00b4 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:42.052896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748ad11-81d6-433e-b737-4d342bbb00b4 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:42.053177 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748ad11-81d6-433e-b737-4d342bbb00b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:42.070899 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-9748ad11-81d6-433e-b737-4d342bbb00b4 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:42.072079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9748ad11-81d6-433e-b737-4d342bbb00b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:42.154643 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 515/1012] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:42 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:42.178725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cd671-1d22-4b22-bf25-1ec83dcf0d4c None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:42.282878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cd671-1d22-4b22-bf25-1ec83dcf0d4c None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:42.299744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:42.321083 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b7a47-263d-4002-82f7-a283c6debc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:42.321872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b7a47-263d-4002-82f7-a283c6debc12 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:42.322153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b7a47-263d-4002-82f7-a283c6debc12 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:42.322478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b7a47-263d-4002-82f7-a283c6debc12 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:42.323406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b7a47-263d-4002-82f7-a283c6debc12 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:42.324772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b7a47-263d-4002-82f7-a283c6debc12 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-970b7a47-263d-4002-82f7-a283c6debc12 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:42.336838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:42.337826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:42.338780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:42.338780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:42.338780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:42.338780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:42.338780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:42.338780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:42.338780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:42.338780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:42.338780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:42.338780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:42.338780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:42.338780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:42.338780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 14:38:42.338780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:42.338780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 498/1013] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:42.346997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748ad11-81d6-433e-b737-4d342bbb00b4 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:42.348473 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:42.514660 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748ad11-81d6-433e-b737-4d342bbb00b4 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:42.573265 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c48f38-06dc-4e42-8b93-e0c3855ed87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:42.574328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c48f38-06dc-4e42-8b93-e0c3855ed87e None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:42.574831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c48f38-06dc-4e42-8b93-e0c3855ed87e None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:42.575328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c48f38-06dc-4e42-8b93-e0c3855ed87e None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:42.576824 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c48f38-06dc-4e42-8b93-e0c3855ed87e None admin] RBAC: Adding query filter params (name=compute) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:42.577240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c48f38-06dc-4e42-8b93-e0c3855ed87e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:42.579789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c48f38-06dc-4e42-8b93-e0c3855ed87e None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:42.591738 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 516/1014] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Jun 27 14:38:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:42.598110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b7a47-263d-4002-82f7-a283c6debc12 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:42.707510 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b7a47-263d-4002-82f7-a283c6debc12 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:42.740908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bccea-9be4-4597-aba5-76d587981d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:42.741566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bccea-9be4-4597-aba5-76d587981d24 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:42.741850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bccea-9be4-4597-aba5-76d587981d24 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:42.742124 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bccea-9be4-4597-aba5-76d587981d24 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:42.742882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bccea-9be4-4597-aba5-76d587981d24 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:42.743188 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bccea-9be4-4597-aba5-76d587981d24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:42.744579 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bccea-9be4-4597-aba5-76d587981d24 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:42.755608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 499/1015] 10.222.0.44 () {56 vars in 1112 bytes} [Mon Jun 27 14:38:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:42.755756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c48f38-06dc-4e42-8b93-e0c3855ed87e None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:42.823590 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:42.857591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c48f38-06dc-4e42-8b93-e0c3855ed87e None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:42.891199 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bddeb-6977-43f1-bf45-944a413a36c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:42.891856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bddeb-6977-43f1-bf45-944a413a36c8 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:42.892136 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bddeb-6977-43f1-bf45-944a413a36c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:42.892414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bddeb-6977-43f1-bf45-944a413a36c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:42.893185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bddeb-6977-43f1-bf45-944a413a36c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:42.894533 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bddeb-6977-43f1-bf45-944a413a36c8 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:42.982384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 517/1016] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Jun 27 14:38:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:38:43.371859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a0fb-f0e4-4fd0-b80b-e5c2a6cce564 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:43.374417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a0fb-f0e4-4fd0-b80b-e5c2a6cce564 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:43.374417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a0fb-f0e4-4fd0-b80b-e5c2a6cce564 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:43.374417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 500/1017] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:43.379294 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02552ae9-eb3d-439f-ad73-f34427eb06ad None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:43.379589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02552ae9-eb3d-439f-ad73-f34427eb06ad None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:43.379866 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02552ae9-eb3d-439f-ad73-f34427eb06ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:43.397384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-02552ae9-eb3d-439f-ad73-f34427eb06ad None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:43.398579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-02552ae9-eb3d-439f-ad73-f34427eb06ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:43.473979 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 518/1018] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:43.497923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75a0fb-f0e4-4fd0-b80b-e5c2a6cce564 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:43.542946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:43.547421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cab37-90e9-4c20-97ce-3d0e986bbf57 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:43.547914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cab37-90e9-4c20-97ce-3d0e986bbf57 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:43.548022 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cab37-90e9-4c20-97ce-3d0e986bbf57 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:43.549339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 519/1019] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:43.554401 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e28e80-340b-48ec-b31b-1aa4a5b090c0 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:43.554688 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e28e80-340b-48ec-b31b-1aa4a5b090c0 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:43.554964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e28e80-340b-48ec-b31b-1aa4a5b090c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:43.572375 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a6e28e80-340b-48ec-b31b-1aa4a5b090c0 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:43.575357 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a6e28e80-340b-48ec-b31b-1aa4a5b090c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:43.608779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75a0fb-f0e4-4fd0-b80b-e5c2a6cce564 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:43.621327 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:43.644248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ab44a-6013-4005-851f-39b0a4b9b8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:43.645127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 520/1020] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 14:38:43.645256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ab44a-6013-4005-851f-39b0a4b9b8a4 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:43.645340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ab44a-6013-4005-851f-39b0a4b9b8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:43.645594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ab44a-6013-4005-851f-39b0a4b9b8a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:43.646759 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ab44a-6013-4005-851f-39b0a4b9b8a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:43.648178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ab44a-6013-4005-851f-39b0a4b9b8a4 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:43.649908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 501/1021] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:43.655512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e28e80-340b-48ec-b31b-1aa4a5b090c0 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:43.670552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ab44a-6013-4005-851f-39b0a4b9b8a4 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:43.763942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e28e80-340b-48ec-b31b-1aa4a5b090c0 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:43.773699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ab44a-6013-4005-851f-39b0a4b9b8a4 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:43.784418 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:43.804973 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c448-26e6-44a0-a0f4-7b8098518016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:43.805632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c448-26e6-44a0-a0f4-7b8098518016 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:43.805915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c448-26e6-44a0-a0f4-7b8098518016 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:43.806190 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c448-26e6-44a0-a0f4-7b8098518016 None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:43.806912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7c448-26e6-44a0-a0f4-7b8098518016 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:43.809220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7c448-26e6-44a0-a0f4-7b8098518016 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:43.809332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6c387-a9b7-4880-8fee-d18a494f6cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:43.810031 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6c387-a9b7-4880-8fee-d18a494f6cd0 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:43.810642 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6c387-a9b7-4880-8fee-d18a494f6cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:43.811496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6c387-a9b7-4880-8fee-d18a494f6cd0 None admin] PATH_INFO: `/v3/services/image` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:43.812157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6c387-a9b7-4880-8fee-d18a494f6cd0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:43.813542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6c387-a9b7-4880-8fee-d18a494f6cd0 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-8ba6c387-a9b7-4880-8fee-d18a494f6cd0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:43.826029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:43.827075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:43.828100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:43.828100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:43.828100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:43.828100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:43.828100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:43.828100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:43.828100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:43.828100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:43.828100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:43.828100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:43.828100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:43.828100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:43.828100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 14:38:43.828100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:43.828100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 502/1022] 10.222.0.44 () {56 vars in 1105 bytes} [Mon Jun 27 14:38:43 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:43.832964 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6c387-a9b7-4880-8fee-d18a494f6cd0 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:43.891935 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 521/1023] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Jun 27 14:38:43 2022] POST /identity/v3/projects => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:38:43.957687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6c387-a9b7-4880-8fee-d18a494f6cd0 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:43.994970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e116f85-045e-4ad2-9110-bdc7da05e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:43.996034 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e116f85-045e-4ad2-9110-bdc7da05e412 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:43.996552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e116f85-045e-4ad2-9110-bdc7da05e412 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:43.997090 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e116f85-045e-4ad2-9110-bdc7da05e412 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:43.998033 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e116f85-045e-4ad2-9110-bdc7da05e412 None admin] RBAC: Adding query filter params (name=image) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:43.998550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e116f85-045e-4ad2-9110-bdc7da05e412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:44.000138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e116f85-045e-4ad2-9110-bdc7da05e412 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:44.006030 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 503/1024] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:44.012811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c448-26e6-44a0-a0f4-7b8098518016 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:44.048583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:44.124821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c448-26e6-44a0-a0f4-7b8098518016 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:44.161428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a30637-c021-4cab-91dd-5b949f658066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:44.162093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a30637-c021-4cab-91dd-5b949f658066 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:44.162450 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a30637-c021-4cab-91dd-5b949f658066 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:44.162650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a30637-c021-4cab-91dd-5b949f658066 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:44.163360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a30637-c021-4cab-91dd-5b949f658066 None admin] RBAC: Adding query filter params (type=image) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:44.163666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a30637-c021-4cab-91dd-5b949f658066 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:44.165058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a30637-c021-4cab-91dd-5b949f658066 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:44.170720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 522/1025] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:44.176782 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e116f85-045e-4ad2-9110-bdc7da05e412 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:44.220971 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:44.282376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e116f85-045e-4ad2-9110-bdc7da05e412 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:44.316135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bda64f-de11-42bd-aa27-d4b88a93b5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:44.316823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bda64f-de11-42bd-aa27-d4b88a93b5fc None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:44.317107 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bda64f-de11-42bd-aa27-d4b88a93b5fc None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:44.317380 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bda64f-de11-42bd-aa27-d4b88a93b5fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:44.318168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bda64f-de11-42bd-aa27-d4b88a93b5fc None admin] RBAC: Adding query filter params (interface=public, service_id=15e53598d7e44a79bdda9a4364084af0, region_id=RegionOne) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:44.318478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bda64f-de11-42bd-aa27-d4b88a93b5fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:44.319831 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bda64f-de11-42bd-aa27-d4b88a93b5fc None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:44.329803 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 504/1026] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Jun 27 14:38:44 2022] GET /identity/v3/endpoints?service_id=15e53598d7e44a79bdda9a4364084af0&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:44.331354 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a30637-c021-4cab-91dd-5b949f658066 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:44.428241 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:44.434997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a30637-c021-4cab-91dd-5b949f658066 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:44.468850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693e8c2-b8ca-46c3-8e35-757f9c881e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:44.469524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693e8c2-b8ca-46c3-8e35-757f9c881e40 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:44.469803 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693e8c2-b8ca-46c3-8e35-757f9c881e40 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:44.470076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693e8c2-b8ca-46c3-8e35-757f9c881e40 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:44.470756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693e8c2-b8ca-46c3-8e35-757f9c881e40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:44.472158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693e8c2-b8ca-46c3-8e35-757f9c881e40 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:44.484683 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 523/1027] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Jun 27 14:38:44 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:38:45.148081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d97e3-7d86-430a-9b42-b09d09aac314 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:45.148595 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d97e3-7d86-430a-9b42-b09d09aac314 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:45.148701 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d97e3-7d86-430a-9b42-b09d09aac314 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:45.150150 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 505/1028] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:45.155751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e67f2-1078-496a-aa5c-2a22ed215b19 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:45.156162 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e67f2-1078-496a-aa5c-2a22ed215b19 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:45.156363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e67f2-1078-496a-aa5c-2a22ed215b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:45.173560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-8e0e67f2-1078-496a-aa5c-2a22ed215b19 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:45.174728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-8e0e67f2-1078-496a-aa5c-2a22ed215b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:45.242945 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 524/1029] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:45.266392 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d97e3-7d86-430a-9b42-b09d09aac314 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:45.368746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d97e3-7d86-430a-9b42-b09d09aac314 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:45.370882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:45.402236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974ea51-eaf7-4ded-8bb5-2ac20440a60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:45.403031 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974ea51-eaf7-4ded-8bb5-2ac20440a60b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:45.403303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974ea51-eaf7-4ded-8bb5-2ac20440a60b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:45.403572 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974ea51-eaf7-4ded-8bb5-2ac20440a60b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:45.414011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974ea51-eaf7-4ded-8bb5-2ac20440a60b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-5974ea51-eaf7-4ded-8bb5-2ac20440a60b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:45.422609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:45.423608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:45.424483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:45.424483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:45.424483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:45.424483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:45.424483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:45.424483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:45.424483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:45.424483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:45.424483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:45.424483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:45.424483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 14:38:45.424483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:45.428512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 506/1030] 10.222.0.44 () {56 vars in 1120 bytes} [Mon Jun 27 14:38:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:45.429875 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e67f2-1078-496a-aa5c-2a22ed215b19 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:45.534055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:45.546995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e67f2-1078-496a-aa5c-2a22ed215b19 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:45.582125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231eb0f-f26d-41eb-8dc7-fdba71a92e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:45.582786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231eb0f-f26d-41eb-8dc7-fdba71a92e71 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:45.583067 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231eb0f-f26d-41eb-8dc7-fdba71a92e71 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:45.583338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231eb0f-f26d-41eb-8dc7-fdba71a92e71 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:45.584079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231eb0f-f26d-41eb-8dc7-fdba71a92e71 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:45.584381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231eb0f-f26d-41eb-8dc7-fdba71a92e71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:45.585755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231eb0f-f26d-41eb-8dc7-fdba71a92e71 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:45.595246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 525/1031] 10.222.0.44 () {56 vars in 1115 bytes} [Mon Jun 27 14:38:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:45.600971 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974ea51-eaf7-4ded-8bb5-2ac20440a60b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:45.703769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974ea51-eaf7-4ded-8bb5-2ac20440a60b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:45.739995 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28f048-1119-4239-8406-50ea50ee306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:45.740809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28f048-1119-4239-8406-50ea50ee306d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:45.741089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28f048-1119-4239-8406-50ea50ee306d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:45.741354 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28f048-1119-4239-8406-50ea50ee306d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:45.752553 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28f048-1119-4239-8406-50ea50ee306d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:45.754000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28f048-1119-4239-8406-50ea50ee306d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:45.773397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-ae28f048-1119-4239-8406-50ea50ee306d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:45.773397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:45.773397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:45.773397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:45.773397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:45.773397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:45.773397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:45.773397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:45.773397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:45.773397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:45.773397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:45.773397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:45.773397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:45.773397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:45.773397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:45.774351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:45.775325 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:45.775325 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:45.775325 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:45.775325 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:45.776268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 507/1032] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:45.780279 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231eb0f-f26d-41eb-8dc7-fdba71a92e71 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:45.880451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231eb0f-f26d-41eb-8dc7-fdba71a92e71 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:45.914843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333dd17-32a4-457d-a59c-7b6501efbb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:45.915494 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333dd17-32a4-457d-a59c-7b6501efbb5e None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:45.915769 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333dd17-32a4-457d-a59c-7b6501efbb5e None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:45.916044 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333dd17-32a4-457d-a59c-7b6501efbb5e None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:45.916872 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333dd17-32a4-457d-a59c-7b6501efbb5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:45.917172 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333dd17-32a4-457d-a59c-7b6501efbb5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:45.918690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333dd17-32a4-457d-a59c-7b6501efbb5e None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:45.930128 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 526/1033] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:45.936323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28f048-1119-4239-8406-50ea50ee306d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:45.954280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:46.026845 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1bc67-7455-41c7-8450-f70ddab19488 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:46.027191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1bc67-7455-41c7-8450-f70ddab19488 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:46.027422 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1bc67-7455-41c7-8450-f70ddab19488 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:46.028971 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 527/1034] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:38:46.033795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e13e-85e1-48c6-adc0-1a859bd8d913 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:46.034088 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e13e-85e1-48c6-adc0-1a859bd8d913 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:46.034369 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e13e-85e1-48c6-adc0-1a859bd8d913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:46.038756 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28f048-1119-4239-8406-50ea50ee306d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:46.052065 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-fa59e13e-85e1-48c6-adc0-1a859bd8d913 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:46.053279 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-fa59e13e-85e1-48c6-adc0-1a859bd8d913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:46.056836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:46.076350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ad41b-71e1-4278-8a49-9eeb980209a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:46.077195 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ad41b-71e1-4278-8a49-9eeb980209a6 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:46.077479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ad41b-71e1-4278-8a49-9eeb980209a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:46.077758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ad41b-71e1-4278-8a49-9eeb980209a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:46.085143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ad41b-71e1-4278-8a49-9eeb980209a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:46.086581 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ad41b-71e1-4278-8a49-9eeb980209a6 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-119ad41b-71e1-4278-8a49-9eeb980209a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:46.107139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:46.108294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:46.109480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:46.109480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:46.109480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:46.109480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:46.109480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:46.109480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:46.109480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:46.109480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:46.109480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:38:46.109480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:46.109480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 508/1035] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Jun 27 14:38:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:46.113705 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ad41b-71e1-4278-8a49-9eeb980209a6 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:46.139874 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 528/1036] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 14:38:46.165337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59e13e-85e1-48c6-adc0-1a859bd8d913 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:46.190988 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:46.217161 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ad41b-71e1-4278-8a49-9eeb980209a6 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:46.253661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660fb0f-079e-4abc-8cd0-c66927db470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:46.254332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660fb0f-079e-4abc-8cd0-c66927db470a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:46.254614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660fb0f-079e-4abc-8cd0-c66927db470a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:46.254884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660fb0f-079e-4abc-8cd0-c66927db470a None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:46.255716 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660fb0f-079e-4abc-8cd0-c66927db470a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:46.256024 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660fb0f-079e-4abc-8cd0-c66927db470a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:46.257854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660fb0f-079e-4abc-8cd0-c66927db470a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:46.280668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 509/1037] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Jun 27 14:38:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:46.281644 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660fb0f-079e-4abc-8cd0-c66927db470a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:46.284167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59e13e-85e1-48c6-adc0-1a859bd8d913 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:46.321401 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55f8b9-a78f-484e-8ac9-60531368b94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:46.322189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55f8b9-a78f-484e-8ac9-60531368b94f None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:46.322467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55f8b9-a78f-484e-8ac9-60531368b94f None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:46.323303 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55f8b9-a78f-484e-8ac9-60531368b94f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:46.324577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55f8b9-a78f-484e-8ac9-60531368b94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:46.326030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55f8b9-a78f-484e-8ac9-60531368b94f None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:46.327787 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 529/1038] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:46.333213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55f8b9-a78f-484e-8ac9-60531368b94f None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:46.344322 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:46.390137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660fb0f-079e-4abc-8cd0-c66927db470a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:46.420323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:46.425451 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ba508-1b22-4eb4-95a7-ed4e991253c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:46.426111 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ba508-1b22-4eb4-95a7-ed4e991253c8 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:46.426403 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ba508-1b22-4eb4-95a7-ed4e991253c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:46.426677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ba508-1b22-4eb4-95a7-ed4e991253c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:46.438002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55f8b9-a78f-484e-8ac9-60531368b94f None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:46.474411 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4936ba-40b6-4cd2-bb8b-a981481a0fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:46.474994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4936ba-40b6-4cd2-bb8b-a981481a0fc7 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:46.475276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4936ba-40b6-4cd2-bb8b-a981481a0fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:46.475565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4936ba-40b6-4cd2-bb8b-a981481a0fc7 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:46.476250 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4936ba-40b6-4cd2-bb8b-a981481a0fc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:46.477718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4936ba-40b6-4cd2-bb8b-a981481a0fc7 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:46.502683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ba508-1b22-4eb4-95a7-ed4e991253c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:46.504133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ba508-1b22-4eb4-95a7-ed4e991253c8 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:46.586230 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 530/1039] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:38:46 2022] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:38:46.587547 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0170f5b-3eb9-489f-b433-ab97a7b5f9f5 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:46.587843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0170f5b-3eb9-489f-b433-ab97a7b5f9f5 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:46.588123 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0170f5b-3eb9-489f-b433-ab97a7b5f9f5 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:46.590000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 531/1040] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:46.595593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14102aed-39e5-4c6a-99a1-11d6d72f8d08 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:46.595892 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14102aed-39e5-4c6a-99a1-11d6d72f8d08 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:46.596167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14102aed-39e5-4c6a-99a1-11d6d72f8d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:46.608871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 510/1041] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:46 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:38:46.615030 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ba508-1b22-4eb4-95a7-ed4e991253c8 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:46.620711 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-14102aed-39e5-4c6a-99a1-11d6d72f8d08 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:46.621939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-14102aed-39e5-4c6a-99a1-11d6d72f8d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:46.652553 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:46.690333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:46.699917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 532/1042] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:46.724059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14102aed-39e5-4c6a-99a1-11d6d72f8d08 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:46.740748 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ba508-1b22-4eb4-95a7-ed4e991253c8 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:46.779350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d6800-d189-4038-bb85-05bc5393cf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:46.780142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d6800-d189-4038-bb85-05bc5393cf9d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:46.780420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d6800-d189-4038-bb85-05bc5393cf9d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:46.780766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d6800-d189-4038-bb85-05bc5393cf9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:46.793345 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d6800-d189-4038-bb85-05bc5393cf9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:46.794902 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d6800-d189-4038-bb85-05bc5393cf9d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:46.817211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-453d6800-d189-4038-bb85-05bc5393cf9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:46.817211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:46.817211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:46.817211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:46.817211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:46.817211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:46.817211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:46.817211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:46.817211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:46.817211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:46.817211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:46.817211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:46.817211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:46.817211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:46.817211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:46.818332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:46.819473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:46.819473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:46.819473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:46.819473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:46.819473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 511/1043] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:46.824658 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d6800-d189-4038-bb85-05bc5393cf9d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:46.850712 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14102aed-39e5-4c6a-99a1-11d6d72f8d08 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:46.887781 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bea6e-7845-4a30-b94d-3aab7a6282da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:46.888569 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bea6e-7845-4a30-b94d-3aab7a6282da None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:46.888880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bea6e-7845-4a30-b94d-3aab7a6282da None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:46.889161 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bea6e-7845-4a30-b94d-3aab7a6282da None admin] PATH_INFO: `/v3/services/image` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:46.889821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bea6e-7845-4a30-b94d-3aab7a6282da None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:46.891169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bea6e-7845-4a30-b94d-3aab7a6282da None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-c28bea6e-7845-4a30-b94d-3aab7a6282da None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:46.903027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:46.904077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:46.909512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:46.909512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:46.909512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:46.909512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:46.909512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:46.909512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:46.909512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:46.909512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:46.909512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:46.909512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:46.909512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:38:46.909512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:38:46.909512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 14:38:46.909512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:46.909512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 533/1044] 10.222.0.44 () {56 vars in 1105 bytes} [Mon Jun 27 14:38:46 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:46.911808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bea6e-7845-4a30-b94d-3aab7a6282da None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:46.923833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:46.940616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d6800-d189-4038-bb85-05bc5393cf9d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:46.976779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:46.976981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55227c8e-089d-4421-b845-746cab4d4918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:46.977485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55227c8e-089d-4421-b845-746cab4d4918 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:46.977770 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55227c8e-089d-4421-b845-746cab4d4918 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:46.978044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55227c8e-089d-4421-b845-746cab4d4918 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:46.978764 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55227c8e-089d-4421-b845-746cab4d4918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:46.979590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55227c8e-089d-4421-b845-746cab4d4918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:46.981138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55227c8e-089d-4421-b845-746cab4d4918 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:46.994583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 512/1045] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:46.999438 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55227c8e-089d-4421-b845-746cab4d4918 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:47.029516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bea6e-7845-4a30-b94d-3aab7a6282da None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:47.067191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef2d88-f0bb-4eed-a36e-75f65d6ddef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:47.067938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef2d88-f0bb-4eed-a36e-75f65d6ddef1 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:47.068144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef2d88-f0bb-4eed-a36e-75f65d6ddef1 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:47.068416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef2d88-f0bb-4eed-a36e-75f65d6ddef1 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:47.069229 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef2d88-f0bb-4eed-a36e-75f65d6ddef1 None admin] RBAC: Adding query filter params (name=image) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:47.069470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef2d88-f0bb-4eed-a36e-75f65d6ddef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:47.070796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef2d88-f0bb-4eed-a36e-75f65d6ddef1 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:47.081078 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 534/1046] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:47.082330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef2d88-f0bb-4eed-a36e-75f65d6ddef1 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:47.116305 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55227c8e-089d-4421-b845-746cab4d4918 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:47.152128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf925a-c25c-41ec-b841-620a7d914f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:47.152944 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf925a-c25c-41ec-b841-620a7d914f90 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:47.153231 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf925a-c25c-41ec-b841-620a7d914f90 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:47.153505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf925a-c25c-41ec-b841-620a7d914f90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:47.160469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf925a-c25c-41ec-b841-620a7d914f90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:47.161933 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf925a-c25c-41ec-b841-620a7d914f90 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:47.177607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-dadf925a-c25c-41ec-b841-620a7d914f90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:47.177607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:47.177607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:47.177607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:47.177607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:47.177607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:47.177607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:47.177607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:47.177607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:47.177607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:47.177607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:47.177607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:47.177607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:47.177607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:47.177607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:47.178556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:47.179482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:47.179482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:47.179482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:47.179482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:47.179482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:47.179482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:47.179482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:47.179482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:47.179482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 513/1047] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:47.184428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf925a-c25c-41ec-b841-620a7d914f90 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:47.189065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:47.207564 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef2d88-f0bb-4eed-a36e-75f65d6ddef1 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:47.232352 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:47.243643 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df0808-6d93-4496-bfa8-0e0fd20814f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:47.244306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df0808-6d93-4496-bfa8-0e0fd20814f3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:47.245142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df0808-6d93-4496-bfa8-0e0fd20814f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:47.245142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df0808-6d93-4496-bfa8-0e0fd20814f3 None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:47.245906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df0808-6d93-4496-bfa8-0e0fd20814f3 None admin] RBAC: Adding query filter params (type=image) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:47.246216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df0808-6d93-4496-bfa8-0e0fd20814f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:47.247576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df0808-6d93-4496-bfa8-0e0fd20814f3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:47.252531 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 535/1048] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:47.258861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df0808-6d93-4496-bfa8-0e0fd20814f3 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:47.290959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf925a-c25c-41ec-b841-620a7d914f90 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:47.329603 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bfbd1-630e-4d34-9f03-438603bbf6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:47.330495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bfbd1-630e-4d34-9f03-438603bbf6ca None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:47.330965 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bfbd1-630e-4d34-9f03-438603bbf6ca None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:47.331240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bfbd1-630e-4d34-9f03-438603bbf6ca None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:47.332019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bfbd1-630e-4d34-9f03-438603bbf6ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:47.332324 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bfbd1-630e-4d34-9f03-438603bbf6ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:47.333865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bfbd1-630e-4d34-9f03-438603bbf6ca None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:47.351439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 514/1049] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:47.352413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bfbd1-630e-4d34-9f03-438603bbf6ca None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:47.372364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df0808-6d93-4496-bfa8-0e0fd20814f3 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:47.407608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd816bf-b8c8-46c4-8bec-1aa3a3128796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:47.408736 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd816bf-b8c8-46c4-8bec-1aa3a3128796 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:47.409119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd816bf-b8c8-46c4-8bec-1aa3a3128796 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:47.409388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd816bf-b8c8-46c4-8bec-1aa3a3128796 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:47.410038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd816bf-b8c8-46c4-8bec-1aa3a3128796 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:47.411404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd816bf-b8c8-46c4-8bec-1aa3a3128796 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:47.418704 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:47.456895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bfbd1-630e-4d34-9f03-438603bbf6ca None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:47.490908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2362855-15b3-4c18-866b-75ea68c642c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:47.491581 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362855-15b3-4c18-866b-75ea68c642c1 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:47.491866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362855-15b3-4c18-866b-75ea68c642c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:47.492144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362855-15b3-4c18-866b-75ea68c642c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:47.493090 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2362855-15b3-4c18-866b-75ea68c642c1 None admin] RBAC: Adding query filter params (role.id=c9c2c328f42a430fa25f0ec124d672f1, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=08529776af224c36ab560c13f5941e0a) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:47.504870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2362855-15b3-4c18-866b-75ea68c642c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:47.504870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2362855-15b3-4c18-866b-75ea68c642c1 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:47.504870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 515/1050] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:47 2022] GET /identity/v3/role_assignments?user.id=08529776af224c36ab560c13f5941e0a&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=c9c2c328f42a430fa25f0ec124d672f1 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:47.535277 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 536/1051] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Jun 27 14:38:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:38:48.671457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21292d-cfa8-4307-aeaf-70f638b7935d None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:48.671994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21292d-cfa8-4307-aeaf-70f638b7935d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:48.671994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21292d-cfa8-4307-aeaf-70f638b7935d None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:48.673594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 516/1052] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:48.679121 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cda8f1-d3a4-4a43-9030-c8bd096a6a13 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:48.679560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cda8f1-d3a4-4a43-9030-c8bd096a6a13 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:48.679728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cda8f1-d3a4-4a43-9030-c8bd096a6a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:48.696566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-77cda8f1-d3a4-4a43-9030-c8bd096a6a13 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:48.698305 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-77cda8f1-d3a4-4a43-9030-c8bd096a6a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:48.735038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:48.772673 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 537/1053] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:48.797014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21292d-cfa8-4307-aeaf-70f638b7935d None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:48.899178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21292d-cfa8-4307-aeaf-70f638b7935d None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:48.926365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:48.934356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e56340-dbc2-4160-ab72-dbcc38066bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:48.935140 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e56340-dbc2-4160-ab72-dbcc38066bf1 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:48.938168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e56340-dbc2-4160-ab72-dbcc38066bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:48.938168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e56340-dbc2-4160-ab72-dbcc38066bf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:48.946067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e56340-dbc2-4160-ab72-dbcc38066bf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-99e56340-dbc2-4160-ab72-dbcc38066bf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:48.953890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:48.954875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:48.960601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:48.960601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:48.960601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:48.960601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:48.960601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:48.960601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:48.960601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:48.960601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:48.960601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:48.960601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:48.960601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:48.960601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:48.960601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 517/1054] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:38:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:48.963733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cda8f1-d3a4-4a43-9030-c8bd096a6a13 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:49.061359 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cda8f1-d3a4-4a43-9030-c8bd096a6a13 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:49.100094 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9717fe1-6087-4944-bdfa-c523dd4280fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:49.101054 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9717fe1-6087-4944-bdfa-c523dd4280fd None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:49.101054 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9717fe1-6087-4944-bdfa-c523dd4280fd None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:49.104304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9717fe1-6087-4944-bdfa-c523dd4280fd None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:49.104304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9717fe1-6087-4944-bdfa-c523dd4280fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:49.104304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9717fe1-6087-4944-bdfa-c523dd4280fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:49.104304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9717fe1-6087-4944-bdfa-c523dd4280fd None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:49.118657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 538/1055] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:38:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:49.120374 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e56340-dbc2-4160-ab72-dbcc38066bf1 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:49.228786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e56340-dbc2-4160-ab72-dbcc38066bf1 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:49.263022 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c42b8-f7c6-4a85-8977-152b481e390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:49.263890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c42b8-f7c6-4a85-8977-152b481e390f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:49.264170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c42b8-f7c6-4a85-8977-152b481e390f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:49.264439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c42b8-f7c6-4a85-8977-152b481e390f None admin] PATH_INFO: `/v3/users/c0d03ca6e9de49959e0c0d499fdd60be` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:49.278676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c42b8-f7c6-4a85-8977-152b481e390f None admin] RBAC: Authorizing `identity:get_user(user_id=c0d03ca6e9de49959e0c0d499fdd60be)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:49.280117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c42b8-f7c6-4a85-8977-152b481e390f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:49.282035 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 518/1056] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:38:49 2022] GET /identity/v3/users/c0d03ca6e9de49959e0c0d499fdd60be => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:49.287705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9717fe1-6087-4944-bdfa-c523dd4280fd None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:49.319969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:49.389913 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9717fe1-6087-4944-bdfa-c523dd4280fd None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:49.425754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97623f42-dce8-43df-bd40-0fbbc8d9b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:49.426406 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97623f42-dce8-43df-bd40-0fbbc8d9b910 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:49.426688 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97623f42-dce8-43df-bd40-0fbbc8d9b910 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:49.426963 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97623f42-dce8-43df-bd40-0fbbc8d9b910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:49.497707 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97623f42-dce8-43df-bd40-0fbbc8d9b910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:49.499075 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97623f42-dce8-43df-bd40-0fbbc8d9b910 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:49.528909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:49.533329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4432e3-6204-41fb-a09c-aa393918a295 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:49.533620 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4432e3-6204-41fb-a09c-aa393918a295 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:49.533896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4432e3-6204-41fb-a09c-aa393918a295 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:49.535441 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 519/1057] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:49.540052 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48511d94-6354-4c5e-b6e9-426631d3c65b None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:49.540417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48511d94-6354-4c5e-b6e9-426631d3c65b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:49.540798 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48511d94-6354-4c5e-b6e9-426631d3c65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:49.557727 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-48511d94-6354-4c5e-b6e9-426631d3c65b None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:49.558906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-48511d94-6354-4c5e-b6e9-426631d3c65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:49.604010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:49.612348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 539/1058] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:38:49.613637 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fef7a-c222-4a87-956b-cffb21d6a575 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:49.613928 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fef7a-c222-4a87-956b-cffb21d6a575 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:49.614205 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fef7a-c222-4a87-956b-cffb21d6a575 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:49.615469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 540/1059] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:49.617994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fef7a-c222-4a87-956b-cffb21d6a575 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:49.629524 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 520/1060] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:49.632137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019faf11-4ca6-4e2c-b390-f7b84006b0c7 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:49.632425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019faf11-4ca6-4e2c-b390-f7b84006b0c7 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:49.632732 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019faf11-4ca6-4e2c-b390-f7b84006b0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:49.649481 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-019faf11-4ca6-4e2c-b390-f7b84006b0c7 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:49.651170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-019faf11-4ca6-4e2c-b390-f7b84006b0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:49.718134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 521/1061] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:49.733268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019faf11-4ca6-4e2c-b390-f7b84006b0c7 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:49.733368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fef7a-c222-4a87-956b-cffb21d6a575 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:49.752286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:49.757969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6a564-904b-4e94-b283-6ee7f173a710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:49.758828 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6a564-904b-4e94-b283-6ee7f173a710 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:49.759109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6a564-904b-4e94-b283-6ee7f173a710 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:49.759383 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6a564-904b-4e94-b283-6ee7f173a710 None admin] PATH_INFO: `/v3/projects/01bfcb1a38134fbb91ed618a73e1b520` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:49.761393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6a564-904b-4e94-b283-6ee7f173a710 None admin] RBAC: Authorizing `identity:get_project(project_id=01bfcb1a38134fbb91ed618a73e1b520)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:49.762829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6a564-904b-4e94-b283-6ee7f173a710 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:49.769539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 541/1062] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:38:49 2022] GET /identity/v3/projects/01bfcb1a38134fbb91ed618a73e1b520 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:49.769539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6a564-904b-4e94-b283-6ee7f173a710 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:49.818044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019faf11-4ca6-4e2c-b390-f7b84006b0c7 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:49.825753 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:49.852397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cad52-4e55-4bd4-8777-b2738f5128f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:49.853231 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cad52-4e55-4bd4-8777-b2738f5128f4 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:49.853514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cad52-4e55-4bd4-8777-b2738f5128f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:49.853823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cad52-4e55-4bd4-8777-b2738f5128f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:49.863705 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cad52-4e55-4bd4-8777-b2738f5128f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:49.864254 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6a564-904b-4e94-b283-6ee7f173a710 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-358cad52-4e55-4bd4-8777-b2738f5128f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:49.872450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:49.876408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:49.877493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:49.877493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:49.877493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:49.877493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:49.877493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:49.877493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:49.877493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:49.877493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:49.877493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:49.877493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:49.877493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 14:38:49.877493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:49.877493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 522/1063] 10.222.0.44 () {56 vars in 1120 bytes} [Mon Jun 27 14:38:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:49.877493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cad52-4e55-4bd4-8777-b2738f5128f4 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:49.901802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398035d-3dc5-4cb6-99a9-07413f8928a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:49.904132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398035d-3dc5-4cb6-99a9-07413f8928a4 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:49.904132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398035d-3dc5-4cb6-99a9-07413f8928a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:49.904132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398035d-3dc5-4cb6-99a9-07413f8928a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:49.968160 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:49.971601 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398035d-3dc5-4cb6-99a9-07413f8928a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:49.973110 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398035d-3dc5-4cb6-99a9-07413f8928a4 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:49.975381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cad52-4e55-4bd4-8777-b2738f5128f4 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:50.007548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e326d-3c96-4a0f-979f-d4c433203211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:50.008117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e326d-3c96-4a0f-979f-d4c433203211 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:50.008396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e326d-3c96-4a0f-979f-d4c433203211 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:50.008696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e326d-3c96-4a0f-979f-d4c433203211 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:50.009521 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e326d-3c96-4a0f-979f-d4c433203211 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=01bfcb1a38134fbb91ed618a73e1b520, user.id=c0d03ca6e9de49959e0c0d499fdd60be) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:50.009825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e326d-3c96-4a0f-979f-d4c433203211 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:50.011846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e326d-3c96-4a0f-979f-d4c433203211 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:50.017232 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 523/1064] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:49 2022] GET /identity/v3/role_assignments?user.id=c0d03ca6e9de49959e0c0d499fdd60be&scope.project.id=01bfcb1a38134fbb91ed618a73e1b520&role.id=6036efe96c1948fb98d01c8703a0561a => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:50.017998 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e326d-3c96-4a0f-979f-d4c433203211 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:50.053142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:50.097409 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 542/1065] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:38:50.104030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398035d-3dc5-4cb6-99a9-07413f8928a4 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:50.136240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e326d-3c96-4a0f-979f-d4c433203211 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:50.176865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2401a0-a5e2-46b9-954c-4dcda1980df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:50.177542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2401a0-a5e2-46b9-954c-4dcda1980df9 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:50.177828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2401a0-a5e2-46b9-954c-4dcda1980df9 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:50.178106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2401a0-a5e2-46b9-954c-4dcda1980df9 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:50.178854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2401a0-a5e2-46b9-954c-4dcda1980df9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:50.179164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2401a0-a5e2-46b9-954c-4dcda1980df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:50.180520 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2401a0-a5e2-46b9-954c-4dcda1980df9 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:50.193088 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 524/1066] 10.222.0.44 () {56 vars in 1115 bytes} [Mon Jun 27 14:38:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:50.194920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2401a0-a5e2-46b9-954c-4dcda1980df9 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:50.216270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:50.221523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398035d-3dc5-4cb6-99a9-07413f8928a4 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:50.259557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7bf0d-21a7-43d7-945b-66aa4dcfed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:50.260900 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7bf0d-21a7-43d7-945b-66aa4dcfed30 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:50.261256 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7bf0d-21a7-43d7-945b-66aa4dcfed30 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:50.261534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7bf0d-21a7-43d7-945b-66aa4dcfed30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:50.272427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7bf0d-21a7-43d7-945b-66aa4dcfed30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:50.274002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7bf0d-21a7-43d7-945b-66aa4dcfed30 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:50.289065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:50.294677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-12d7bf0d-21a7-43d7-945b-66aa4dcfed30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:50.294677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:50.294677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:50.294677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:50.294677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:50.294677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:50.294677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:50.294677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:50.294677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:50.294677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:50.294677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:50.294677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:50.294677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:50.294677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:50.294677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:50.295745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:50.297159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:50.297159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:50.297159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:50.297159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:50.297159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 543/1067] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:50.302687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2401a0-a5e2-46b9-954c-4dcda1980df9 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:50.302782 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7bf0d-21a7-43d7-945b-66aa4dcfed30 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:50.339307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b27e1-9085-4197-a061-bfebc5ede0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:50.340122 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b27e1-9085-4197-a061-bfebc5ede0f0 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:50.340402 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b27e1-9085-4197-a061-bfebc5ede0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:50.340695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b27e1-9085-4197-a061-bfebc5ede0f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:50.350878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b27e1-9085-4197-a061-bfebc5ede0f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:50.352303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b27e1-9085-4197-a061-bfebc5ede0f0 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:50.370584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-424b27e1-9085-4197-a061-bfebc5ede0f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:50.370584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:50.370584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:50.370584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:50.370584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:50.370584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:50.370584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:50.370584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:50.370584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:50.370584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:50.370584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:50.370584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:50.370584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:50.370584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:50.370584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:50.371723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:50.373623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:50.373623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:50.373623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:50.373623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:50.373623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 525/1068] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:50.377342 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b27e1-9085-4197-a061-bfebc5ede0f0 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:50.416264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7bf0d-21a7-43d7-945b-66aa4dcfed30 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:50.452891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cb0c6-f884-4421-aae5-48b3a709c5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:50.453675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cb0c6-f884-4421-aae5-48b3a709c5d2 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:50.453958 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cb0c6-f884-4421-aae5-48b3a709c5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:50.454232 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cb0c6-f884-4421-aae5-48b3a709c5d2 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:50.454951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cb0c6-f884-4421-aae5-48b3a709c5d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:50.455386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cb0c6-f884-4421-aae5-48b3a709c5d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:50.456877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cb0c6-f884-4421-aae5-48b3a709c5d2 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:50.477024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 544/1069] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:50.481700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b27e1-9085-4197-a061-bfebc5ede0f0 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:50.520296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abbea6-4a42-4188-8229-507c8c25104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:50.520919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abbea6-4a42-4188-8229-507c8c25104a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:50.521201 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abbea6-4a42-4188-8229-507c8c25104a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:50.521472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abbea6-4a42-4188-8229-507c8c25104a None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:50.522219 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abbea6-4a42-4188-8229-507c8c25104a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:50.522522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abbea6-4a42-4188-8229-507c8c25104a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:50.524102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abbea6-4a42-4188-8229-507c8c25104a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:50.537546 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 526/1070] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:50.543649 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cb0c6-f884-4421-aae5-48b3a709c5d2 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:50.558040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:50.650934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cb0c6-f884-4421-aae5-48b3a709c5d2 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:50.687977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b105cbc-c797-4857-9289-6fb903263116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:50.688797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b105cbc-c797-4857-9289-6fb903263116 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:50.689083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b105cbc-c797-4857-9289-6fb903263116 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:50.689361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b105cbc-c797-4857-9289-6fb903263116 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:50.697351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b105cbc-c797-4857-9289-6fb903263116 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:50.699431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b105cbc-c797-4857-9289-6fb903263116 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-2b105cbc-c797-4857-9289-6fb903263116 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:50.714654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:50.715652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:50.717002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:50.717002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:50.717002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:50.717002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:50.717002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:50.717002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:50.717002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:50.717002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:50.717002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:38:50.717002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:50.717002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 545/1071] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Jun 27 14:38:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:50.721671 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abbea6-4a42-4188-8229-507c8c25104a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:50.725611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:50.834084 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abbea6-4a42-4188-8229-507c8c25104a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:50.866737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d416f9d-ecce-4771-8ae9-ff6205c57a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:50.867396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d416f9d-ecce-4771-8ae9-ff6205c57a6b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:50.867698 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d416f9d-ecce-4771-8ae9-ff6205c57a6b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:50.868011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d416f9d-ecce-4771-8ae9-ff6205c57a6b None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:50.868812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d416f9d-ecce-4771-8ae9-ff6205c57a6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:50.874463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d416f9d-ecce-4771-8ae9-ff6205c57a6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:50.874463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d416f9d-ecce-4771-8ae9-ff6205c57a6b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:50.888500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 527/1072] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Jun 27 14:38:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:50.894105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b105cbc-c797-4857-9289-6fb903263116 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:51.006317 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:51.035950 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b105cbc-c797-4857-9289-6fb903263116 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:51.068815 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fffa7-e3fe-4b82-a442-cb0f9a6998de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:51.069594 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fffa7-e3fe-4b82-a442-cb0f9a6998de None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:51.069876 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fffa7-e3fe-4b82-a442-cb0f9a6998de None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:51.070149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fffa7-e3fe-4b82-a442-cb0f9a6998de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:51.081253 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fffa7-e3fe-4b82-a442-cb0f9a6998de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:51.082675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fffa7-e3fe-4b82-a442-cb0f9a6998de None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:51.102587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-9e2fffa7-e3fe-4b82-a442-cb0f9a6998de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:51.102587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:51.102587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:51.102587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:51.102587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:51.102587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:51.102587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:51.102587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:51.102587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:51.102587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:51.102587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:51.102587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:51.102587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:51.102587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:51.102587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:51.108755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:51.110178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:51.110178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:51.110178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:51.110178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:51.110178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 546/1073] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:51.110464 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d416f9d-ecce-4771-8ae9-ff6205c57a6b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:51.172201 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:51.208750 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d416f9d-ecce-4771-8ae9-ff6205c57a6b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:51.242020 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60113374-d3ea-4a6a-91e1-0628f09689dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:51.242667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60113374-d3ea-4a6a-91e1-0628f09689dc None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:51.242945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60113374-d3ea-4a6a-91e1-0628f09689dc None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:51.243216 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60113374-d3ea-4a6a-91e1-0628f09689dc None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:51.243924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60113374-d3ea-4a6a-91e1-0628f09689dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:51.244232 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60113374-d3ea-4a6a-91e1-0628f09689dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:51.245821 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60113374-d3ea-4a6a-91e1-0628f09689dc None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:51.256496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 528/1074] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:51.262483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fffa7-e3fe-4b82-a442-cb0f9a6998de None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:51.358988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fffa7-e3fe-4b82-a442-cb0f9a6998de None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:51.380344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:51.392028 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddfb1b-6573-45e4-9719-bb07ef2b5d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:51.392832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddfb1b-6573-45e4-9719-bb07ef2b5d18 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:51.393115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddfb1b-6573-45e4-9719-bb07ef2b5d18 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:51.393385 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddfb1b-6573-45e4-9719-bb07ef2b5d18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:51.399797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddfb1b-6573-45e4-9719-bb07ef2b5d18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:51.401916 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddfb1b-6573-45e4-9719-bb07ef2b5d18 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:51.415948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-f0ddfb1b-6573-45e4-9719-bb07ef2b5d18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:51.415948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:51.415948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:51.415948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:51.415948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:51.415948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:51.415948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:51.415948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:51.415948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:51.415948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:51.415948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:51.415948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:51.415948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:51.415948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:51.415948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:51.417314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:51.423259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:51.423259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:51.423259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:51.423259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:51.423259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:51.423259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:51.423259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:51.423259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:51.423259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 547/1075] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:51.423872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60113374-d3ea-4a6a-91e1-0628f09689dc None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:51.518947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60113374-d3ea-4a6a-91e1-0628f09689dc None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:51.540878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:51.551930 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a6540-ced1-4927-ac11-cc158f8f8845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:51.552575 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a6540-ced1-4927-ac11-cc158f8f8845 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:51.552882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a6540-ced1-4927-ac11-cc158f8f8845 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:51.553155 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a6540-ced1-4927-ac11-cc158f8f8845 None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:51.553928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a6540-ced1-4927-ac11-cc158f8f8845 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:51.554239 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a6540-ced1-4927-ac11-cc158f8f8845 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:51.555638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a6540-ced1-4927-ac11-cc158f8f8845 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:51.567634 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 529/1076] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:51.574302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddfb1b-6573-45e4-9719-bb07ef2b5d18 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:51.673016 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddfb1b-6573-45e4-9719-bb07ef2b5d18 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:51.707536 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1e964-c04f-4a68-a58f-215c3028b877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:51.708421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1e964-c04f-4a68-a58f-215c3028b877 None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:51.708734 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1e964-c04f-4a68-a58f-215c3028b877 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:51.709064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1e964-c04f-4a68-a58f-215c3028b877 None admin] PATH_INFO: `/v3/projects/af4d24603fa24a62946a57fabb774756/users/08529776af224c36ab560c13f5941e0a/roles/c9c2c328f42a430fa25f0ec124d672f1` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:51.711261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1e964-c04f-4a68-a58f-215c3028b877 None admin] RBAC: Authorizing `identity:create_grant(project_id=af4d24603fa24a62946a57fabb774756, user_id=08529776af224c36ab560c13f5941e0a, role_id=c9c2c328f42a430fa25f0ec124d672f1)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:51.712707 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1e964-c04f-4a68-a58f-215c3028b877 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:51.803380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 548/1077] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:38:51 2022] PUT /identity/v3/projects/af4d24603fa24a62946a57fabb774756/users/08529776af224c36ab560c13f5941e0a/roles/c9c2c328f42a430fa25f0ec124d672f1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:38:52.079229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4710c3-85ea-4f92-a77a-e73e9084a340 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:52.079733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4710c3-85ea-4f92-a77a-e73e9084a340 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:52.079733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4710c3-85ea-4f92-a77a-e73e9084a340 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:52.081130 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 530/1078] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:52.086457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b8ca2-cbf2-4247-9fa4-a5624bbcb1c6 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:52.086891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b8ca2-cbf2-4247-9fa4-a5624bbcb1c6 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:52.086992 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b8ca2-cbf2-4247-9fa4-a5624bbcb1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:52.104339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1b9b8ca2-cbf2-4247-9fa4-a5624bbcb1c6 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:52.105586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1b9b8ca2-cbf2-4247-9fa4-a5624bbcb1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:52.140474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:52.172153 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 549/1079] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:52.195308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4710c3-85ea-4f92-a77a-e73e9084a340 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:52.296101 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4710c3-85ea-4f92-a77a-e73e9084a340 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:52.329625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa2ab5-0c93-48df-9291-f29fbd964952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:52.330333 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa2ab5-0c93-48df-9291-f29fbd964952 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:52.330613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa2ab5-0c93-48df-9291-f29fbd964952 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:52.330883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa2ab5-0c93-48df-9291-f29fbd964952 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:52.341159 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa2ab5-0c93-48df-9291-f29fbd964952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-16aa2ab5-0c93-48df-9291-f29fbd964952 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:52.348612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:52.349700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:52.350598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:52.350598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:52.350598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:52.350598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:52.350598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:52.350598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:52.350598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:52.350598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:52.350598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:52.350598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:52.350598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:52.350598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:52.350598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 531/1080] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:38:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:52.357902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b8ca2-cbf2-4247-9fa4-a5624bbcb1c6 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:52.453841 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b8ca2-cbf2-4247-9fa4-a5624bbcb1c6 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:52.487088 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60d559-8011-4b8a-b5c9-1232a78b0c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:52.487750 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60d559-8011-4b8a-b5c9-1232a78b0c83 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:52.488029 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60d559-8011-4b8a-b5c9-1232a78b0c83 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:52.488297 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60d559-8011-4b8a-b5c9-1232a78b0c83 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:52.489067 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60d559-8011-4b8a-b5c9-1232a78b0c83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:52.489372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60d559-8011-4b8a-b5c9-1232a78b0c83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:52.490713 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60d559-8011-4b8a-b5c9-1232a78b0c83 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:52.498832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 550/1081] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:38:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:52.504597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa2ab5-0c93-48df-9291-f29fbd964952 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:52.547847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:52.602829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa2ab5-0c93-48df-9291-f29fbd964952 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:52.635423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c218a8d-0689-412d-90b6-00430a64f144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:52.636268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c218a8d-0689-412d-90b6-00430a64f144 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:52.636552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c218a8d-0689-412d-90b6-00430a64f144 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:52.636855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c218a8d-0689-412d-90b6-00430a64f144 None admin] PATH_INFO: `/v3/users/c0d03ca6e9de49959e0c0d499fdd60be` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:52.638043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c218a8d-0689-412d-90b6-00430a64f144 None admin] RBAC: Authorizing `identity:get_user(user_id=c0d03ca6e9de49959e0c0d499fdd60be)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:52.639452 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c218a8d-0689-412d-90b6-00430a64f144 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:52.641251 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 532/1082] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:38:52 2022] GET /identity/v3/users/c0d03ca6e9de49959e0c0d499fdd60be => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:52.646779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60d559-8011-4b8a-b5c9-1232a78b0c83 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:52.680987 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:52.746024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60d559-8011-4b8a-b5c9-1232a78b0c83 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:52.781532 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2239e4d-e9d7-4c0e-946f-6d933e72d138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:52.782380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2239e4d-e9d7-4c0e-946f-6d933e72d138 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:52.782665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2239e4d-e9d7-4c0e-946f-6d933e72d138 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:52.782943 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2239e4d-e9d7-4c0e-946f-6d933e72d138 None admin] PATH_INFO: `/v3/projects/01bfcb1a38134fbb91ed618a73e1b520` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:52.784121 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2239e4d-e9d7-4c0e-946f-6d933e72d138 None admin] RBAC: Authorizing `identity:get_project(project_id=01bfcb1a38134fbb91ed618a73e1b520)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:52.785570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2239e4d-e9d7-4c0e-946f-6d933e72d138 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:52.787275 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 551/1083] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:38:52 2022] GET /identity/v3/projects/01bfcb1a38134fbb91ed618a73e1b520 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:52.793128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c218a8d-0689-412d-90b6-00430a64f144 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:52.891444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c218a8d-0689-412d-90b6-00430a64f144 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:52.903230 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:52.927517 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342272bc-00ec-4123-924c-8b93dc4d4ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:52.928390 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342272bc-00ec-4123-924c-8b93dc4d4ade None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:52.928699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342272bc-00ec-4123-924c-8b93dc4d4ade None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:52.928972 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342272bc-00ec-4123-924c-8b93dc4d4ade None admin] PATH_INFO: `/v3/projects/01bfcb1a38134fbb91ed618a73e1b520/users/c0d03ca6e9de49959e0c0d499fdd60be/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:52.930927 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342272bc-00ec-4123-924c-8b93dc4d4ade None admin] RBAC: Authorizing `identity:create_grant(project_id=01bfcb1a38134fbb91ed618a73e1b520, user_id=c0d03ca6e9de49959e0c0d499fdd60be, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:52.932536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342272bc-00ec-4123-924c-8b93dc4d4ade None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:52.985803 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 533/1084] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:38:52 2022] PUT /identity/v3/projects/01bfcb1a38134fbb91ed618a73e1b520/users/c0d03ca6e9de49959e0c0d499fdd60be/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:38:53.833616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4c1b6-2263-4c01-9dc1-156f53390d6b None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:53.834187 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4c1b6-2263-4c01-9dc1-156f53390d6b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:53.834187 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4c1b6-2263-4c01-9dc1-156f53390d6b None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:53.835523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 552/1085] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:53.841436 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98099b64-91e2-475a-8090-0fcf66872721 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:53.841855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98099b64-91e2-475a-8090-0fcf66872721 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:53.842000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98099b64-91e2-475a-8090-0fcf66872721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:53.858337 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-98099b64-91e2-475a-8090-0fcf66872721 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:53.859510 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-98099b64-91e2-475a-8090-0fcf66872721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:53.924138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 534/1086] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:53.948763 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4c1b6-2263-4c01-9dc1-156f53390d6b None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:54.046944 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4c1b6-2263-4c01-9dc1-156f53390d6b None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:54.048457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:54.083424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde26c92-d7f8-42ea-9e34-99fc657d32d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:54.084293 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde26c92-d7f8-42ea-9e34-99fc657d32d5 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:54.084518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde26c92-d7f8-42ea-9e34-99fc657d32d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:54.084821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde26c92-d7f8-42ea-9e34-99fc657d32d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:54.095287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde26c92-d7f8-42ea-9e34-99fc657d32d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-dde26c92-d7f8-42ea-9e34-99fc657d32d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:54.103319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:54.104478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:54.110483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:54.110483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:54.110483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:54.110483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:54.110483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:54.110483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:54.110483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:54.110483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:54.110483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:54.110483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:54.110483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 14:38:54.110483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:54.110483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 553/1087] 10.222.0.44 () {56 vars in 1120 bytes} [Mon Jun 27 14:38:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:54.113268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98099b64-91e2-475a-8090-0fcf66872721 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:54.207076 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:54.210009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98099b64-91e2-475a-8090-0fcf66872721 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:54.243584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca467563-7b0f-40ee-8f86-90b75c320ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:54.244276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca467563-7b0f-40ee-8f86-90b75c320ea6 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:54.245324 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca467563-7b0f-40ee-8f86-90b75c320ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:54.245619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca467563-7b0f-40ee-8f86-90b75c320ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:54.246371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca467563-7b0f-40ee-8f86-90b75c320ea6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:54.246737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca467563-7b0f-40ee-8f86-90b75c320ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:54.248089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca467563-7b0f-40ee-8f86-90b75c320ea6 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:54.255819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 535/1088] 10.222.0.44 () {56 vars in 1115 bytes} [Mon Jun 27 14:38:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:54.261584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde26c92-d7f8-42ea-9e34-99fc657d32d5 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:54.358212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde26c92-d7f8-42ea-9e34-99fc657d32d5 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:54.390424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd2117-5c01-4ff7-a7e1-59dc386b0a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:54.391196 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd2117-5c01-4ff7-a7e1-59dc386b0a53 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:54.391480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd2117-5c01-4ff7-a7e1-59dc386b0a53 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:54.391755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd2117-5c01-4ff7-a7e1-59dc386b0a53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:54.402079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd2117-5c01-4ff7-a7e1-59dc386b0a53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:54.403498 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd2117-5c01-4ff7-a7e1-59dc386b0a53 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:54.420773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-54fd2117-5c01-4ff7-a7e1-59dc386b0a53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:54.420773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:54.420773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:54.420773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:54.420773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:54.420773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:54.420773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:54.420773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:54.420773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:54.420773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:54.420773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:54.420773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:54.420773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:54.420773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:54.420773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:54.421813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:54.423041 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:54.423041 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:54.423041 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:54.423041 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:54.423041 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 554/1089] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:54.427596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca467563-7b0f-40ee-8f86-90b75c320ea6 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:54.523616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca467563-7b0f-40ee-8f86-90b75c320ea6 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:54.555758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026913a9-7aea-4c75-81b5-51cebfdfe289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:54.556411 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026913a9-7aea-4c75-81b5-51cebfdfe289 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:54.556760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026913a9-7aea-4c75-81b5-51cebfdfe289 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:54.557550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026913a9-7aea-4c75-81b5-51cebfdfe289 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:54.558264 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026913a9-7aea-4c75-81b5-51cebfdfe289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:54.558566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026913a9-7aea-4c75-81b5-51cebfdfe289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:54.559909 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026913a9-7aea-4c75-81b5-51cebfdfe289 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:54.571946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 536/1090] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:54.577838 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd2117-5c01-4ff7-a7e1-59dc386b0a53 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:54.594442 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:54.677360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd2117-5c01-4ff7-a7e1-59dc386b0a53 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:54.710945 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb6637-11c2-41bf-a3dc-a198bcc897eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:54.711727 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb6637-11c2-41bf-a3dc-a198bcc897eb None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:54.712010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb6637-11c2-41bf-a3dc-a198bcc897eb None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:54.712284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb6637-11c2-41bf-a3dc-a198bcc897eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:54.719993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb6637-11c2-41bf-a3dc-a198bcc897eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:54.721438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb6637-11c2-41bf-a3dc-a198bcc897eb None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-83bb6637-11c2-41bf-a3dc-a198bcc897eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:38:54.736210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:54.737378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:54.738516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:54.738516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:54.738516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:38:54.738516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:38:54.738516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:38:54.738516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:38:54.738516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:38:54.738516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:38:54.738516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 14:38:54.738516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:54.738516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 555/1091] 10.222.0.44 () {56 vars in 1093 bytes} [Mon Jun 27 14:38:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:54.743115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026913a9-7aea-4c75-81b5-51cebfdfe289 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:54.767011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:54.842220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026913a9-7aea-4c75-81b5-51cebfdfe289 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:54.875775 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25898c-4514-49ed-bac8-cb5cf969b106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:54.876448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25898c-4514-49ed-bac8-cb5cf969b106 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:54.876761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25898c-4514-49ed-bac8-cb5cf969b106 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:54.877040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25898c-4514-49ed-bac8-cb5cf969b106 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:54.877877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25898c-4514-49ed-bac8-cb5cf969b106 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:54.878191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25898c-4514-49ed-bac8-cb5cf969b106 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:54.879606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25898c-4514-49ed-bac8-cb5cf969b106 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:54.896338 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 537/1092] 10.222.0.44 () {56 vars in 1133 bytes} [Mon Jun 27 14:38:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:54.902486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb6637-11c2-41bf-a3dc-a198bcc897eb None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:54.976078 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:54.999844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb6637-11c2-41bf-a3dc-a198bcc897eb None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:55.003547 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb12e8-8e30-4423-afba-199f77e6f368 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:55.003833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb12e8-8e30-4423-afba-199f77e6f368 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:55.004111 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb12e8-8e30-4423-afba-199f77e6f368 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:55.005508 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 538/1093] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:55.010958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9466f2-1f4e-4050-8a31-ce81e602ebde None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:55.011320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9466f2-1f4e-4050-8a31-ce81e602ebde None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:55.011668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9466f2-1f4e-4050-8a31-ce81e602ebde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:55.028874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-db9466f2-1f4e-4050-8a31-ce81e602ebde None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:55.030049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-db9466f2-1f4e-4050-8a31-ce81e602ebde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:55.035312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b927b2a-38f4-4877-9e4a-ec86c112e294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:55.035956 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b927b2a-38f4-4877-9e4a-ec86c112e294 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:55.036263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b927b2a-38f4-4877-9e4a-ec86c112e294 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:55.036543 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b927b2a-38f4-4877-9e4a-ec86c112e294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:55.094793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 539/1094] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 14:38:55.105588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b927b2a-38f4-4877-9e4a-ec86c112e294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:55.107034 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b927b2a-38f4-4877-9e4a-ec86c112e294 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:55.117925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9466f2-1f4e-4050-8a31-ce81e602ebde None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:55.129266 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:55.179753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:55.205311 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 556/1095] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:38:55.210953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b927b2a-38f4-4877-9e4a-ec86c112e294 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:55.215912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9466f2-1f4e-4050-8a31-ce81e602ebde None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:55.249259 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b30a8f-4399-4579-8ab5-4e909da8652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:55.249970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b30a8f-4399-4579-8ab5-4e909da8652c None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:55.250260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b30a8f-4399-4579-8ab5-4e909da8652c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:55.250538 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b30a8f-4399-4579-8ab5-4e909da8652c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:55.261269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b30a8f-4399-4579-8ab5-4e909da8652c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-09b30a8f-4399-4579-8ab5-4e909da8652c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:38:55.268882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:55.270021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:55.271182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:55.271182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:55.271182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:55.271182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:55.271182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:38:55.271182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:38:55.271182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:38:55.271182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:38:55.271182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:38:55.271182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:38:55.271182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:38:55.271182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:38:55.271182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 540/1096] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:38:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:55.276496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b30a8f-4399-4579-8ab5-4e909da8652c None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:55.312568 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b927b2a-38f4-4877-9e4a-ec86c112e294 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:55.343654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:55.346482 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9d7d5-c0b8-447e-9adf-d442a43dea78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:55.347337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9d7d5-c0b8-447e-9adf-d442a43dea78 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:55.347686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9d7d5-c0b8-447e-9adf-d442a43dea78 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:55.348024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9d7d5-c0b8-447e-9adf-d442a43dea78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:55.358374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9d7d5-c0b8-447e-9adf-d442a43dea78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:55.360481 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9d7d5-c0b8-447e-9adf-d442a43dea78 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:55.373339 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b30a8f-4399-4579-8ab5-4e909da8652c None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:55.377514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-4ea9d7d5-c0b8-447e-9adf-d442a43dea78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:55.377514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:55.377514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:55.377514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:55.377514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:55.377514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:55.377514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:55.377514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:55.377514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:55.377514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:55.377514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:55.377514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:55.377514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:38:55.377514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:38:55.377514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:55.378420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:55.379332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:38:55.379332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:38:55.379332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:38:55.379332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:55.379332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 557/1097] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:38:55.384418 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9d7d5-c0b8-447e-9adf-d442a43dea78 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:55.406568 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e89ec-f791-441a-a40f-e1fb3ba604a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:55.407223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e89ec-f791-441a-a40f-e1fb3ba604a2 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:55.407501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e89ec-f791-441a-a40f-e1fb3ba604a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:55.407774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e89ec-f791-441a-a40f-e1fb3ba604a2 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:55.408513 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e89ec-f791-441a-a40f-e1fb3ba604a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:55.408844 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e89ec-f791-441a-a40f-e1fb3ba604a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:55.410188 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e89ec-f791-441a-a40f-e1fb3ba604a2 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:55.411074 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:55.418063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 541/1098] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:38:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:55.423761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e89ec-f791-441a-a40f-e1fb3ba604a2 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:55.482497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9d7d5-c0b8-447e-9adf-d442a43dea78 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:55.517374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983dadb-30e4-477f-a653-e214492f0bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:55.517949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983dadb-30e4-477f-a653-e214492f0bd6 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:55.518229 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983dadb-30e4-477f-a653-e214492f0bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:55.518512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983dadb-30e4-477f-a653-e214492f0bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:55.519217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983dadb-30e4-477f-a653-e214492f0bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:55.519510 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983dadb-30e4-477f-a653-e214492f0bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:55.520886 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983dadb-30e4-477f-a653-e214492f0bd6 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:55.522009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e89ec-f791-441a-a40f-e1fb3ba604a2 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:55.531896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 558/1099] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:55.537528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983dadb-30e4-477f-a653-e214492f0bd6 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:55.550978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:55.555652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a22f8b-79af-4548-8829-83d51db89421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:55.556510 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a22f8b-79af-4548-8829-83d51db89421 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:55.557424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a22f8b-79af-4548-8829-83d51db89421 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:55.557696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a22f8b-79af-4548-8829-83d51db89421 None admin] PATH_INFO: `/v3/users/c0d03ca6e9de49959e0c0d499fdd60be` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:55.558889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a22f8b-79af-4548-8829-83d51db89421 None admin] RBAC: Authorizing `identity:get_user(user_id=c0d03ca6e9de49959e0c0d499fdd60be)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:55.566138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a22f8b-79af-4548-8829-83d51db89421 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:55.566138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 542/1100] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:38:55 2022] GET /identity/v3/users/c0d03ca6e9de49959e0c0d499fdd60be => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:55.567674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a22f8b-79af-4548-8829-83d51db89421 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:55.621962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:55.637327 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983dadb-30e4-477f-a653-e214492f0bd6 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:55.665576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a22f8b-79af-4548-8829-83d51db89421 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:55.673646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f6b3f-8eb1-4776-b3d8-bd094748a1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:55.674440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f6b3f-8eb1-4776-b3d8-bd094748a1c1 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:55.674720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f6b3f-8eb1-4776-b3d8-bd094748a1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:55.674994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f6b3f-8eb1-4776-b3d8-bd094748a1c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:55.681566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f6b3f-8eb1-4776-b3d8-bd094748a1c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:55.683342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f6b3f-8eb1-4776-b3d8-bd094748a1c1 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:55.696934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-457f6b3f-8eb1-4776-b3d8-bd094748a1c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:55.696934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:38:55.696934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:38:55.696934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:38:55.696934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:38:55.696934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:38:55.696934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:38:55.696934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:38:55.696934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:38:55.696934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:38:55.696934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:38:55.696934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:38:55.696934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:38:55.696934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:38:55.696934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:38:55.698370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:38:55.699929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:38:55.699929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:38:55.699929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:38:55.699929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:38:55.699929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:38:55.699929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:38:55.699929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:38:55.699929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:38:55.699929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 559/1101] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:38:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:38:55.700432 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7f979-665d-4ba6-ac19-195831973b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:55.700432 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7f979-665d-4ba6-ac19-195831973b8b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:55.700432 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7f979-665d-4ba6-ac19-195831973b8b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:55.700668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7f979-665d-4ba6-ac19-195831973b8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:55.704232 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f6b3f-8eb1-4776-b3d8-bd094748a1c1 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:55.765664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:55.767903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7f979-665d-4ba6-ac19-195831973b8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:55.769375 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7f979-665d-4ba6-ac19-195831973b8b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:55.803673 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f6b3f-8eb1-4776-b3d8-bd094748a1c1 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:55.837244 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce76e5-997f-4bea-a030-01339b14dfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:55.838503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce76e5-997f-4bea-a030-01339b14dfe5 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:55.838789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce76e5-997f-4bea-a030-01339b14dfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:55.839167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce76e5-997f-4bea-a030-01339b14dfe5 None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:55.839976 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce76e5-997f-4bea-a030-01339b14dfe5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:55.840285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce76e5-997f-4bea-a030-01339b14dfe5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:55.841712 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce76e5-997f-4bea-a030-01339b14dfe5 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:55.853010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 560/1102] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:38:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:55.859329 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce76e5-997f-4bea-a030-01339b14dfe5 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:55.872202 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 543/1103] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:38:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 27 14:38:55.872715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:55.874943 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7f979-665d-4ba6-ac19-195831973b8b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:55.958280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce76e5-997f-4bea-a030-01339b14dfe5 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:55.968105 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:55.970956 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7f979-665d-4ba6-ac19-195831973b8b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:55.992768 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2e296-8b9b-49e5-9222-8a01194eb994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:55.993418 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2e296-8b9b-49e5-9222-8a01194eb994 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:55.993701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2e296-8b9b-49e5-9222-8a01194eb994 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:55.993975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2e296-8b9b-49e5-9222-8a01194eb994 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:55.995161 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2e296-8b9b-49e5-9222-8a01194eb994 None admin] RBAC: Adding query filter params (role.id=c9c2c328f42a430fa25f0ec124d672f1, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=08529776af224c36ab560c13f5941e0a) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:55.995472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2e296-8b9b-49e5-9222-8a01194eb994 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:55.996911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2e296-8b9b-49e5-9222-8a01194eb994 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:56.002778 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 561/1104] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:55 2022] GET /identity/v3/role_assignments?user.id=08529776af224c36ab560c13f5941e0a&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=c9c2c328f42a430fa25f0ec124d672f1 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:56.003543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b8fb6-e797-48d5-9256-a5e1033bc42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:56.004829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b8fb6-e797-48d5-9256-a5e1033bc42c None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:56.005110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b8fb6-e797-48d5-9256-a5e1033bc42c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:56.005384 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b8fb6-e797-48d5-9256-a5e1033bc42c None admin] PATH_INFO: `/v3/projects/01bfcb1a38134fbb91ed618a73e1b520` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:56.006562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b8fb6-e797-48d5-9256-a5e1033bc42c None admin] RBAC: Authorizing `identity:get_project(project_id=01bfcb1a38134fbb91ed618a73e1b520)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:56.007985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b8fb6-e797-48d5-9256-a5e1033bc42c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:56.010298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 544/1105] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:38:55 2022] GET /identity/v3/projects/01bfcb1a38134fbb91ed618a73e1b520 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:56.016751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2e296-8b9b-49e5-9222-8a01194eb994 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:56.090221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:56.123105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2e296-8b9b-49e5-9222-8a01194eb994 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:56.158573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3659a-5412-4534-963d-76917e358b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:56.159227 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3659a-5412-4534-963d-76917e358b10 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:56.159510 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3659a-5412-4534-963d-76917e358b10 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:56.159787 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3659a-5412-4534-963d-76917e358b10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:56.160614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3659a-5412-4534-963d-76917e358b10 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=01bfcb1a38134fbb91ed618a73e1b520, user.id=c0d03ca6e9de49959e0c0d499fdd60be) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:38:56.160956 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3659a-5412-4534-963d-76917e358b10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:56.162362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3659a-5412-4534-963d-76917e358b10 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:56.169228 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 562/1106] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:38:56 2022] GET /identity/v3/role_assignments?user.id=c0d03ca6e9de49959e0c0d499fdd60be&scope.project.id=01bfcb1a38134fbb91ed618a73e1b520&role.id=6036efe96c1948fb98d01c8703a0561a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:38:58.214553 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16dd9b-c593-4ed5-9d79-a7cefae0e2fe None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:58.215054 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16dd9b-c593-4ed5-9d79-a7cefae0e2fe None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:58.215143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16dd9b-c593-4ed5-9d79-a7cefae0e2fe None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:58.216444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 545/1107] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:38:58.221678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5e41d-8ea8-45b7-bcf9-ce0ec5b9ee1f None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:58.222059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5e41d-8ea8-45b7-bcf9-ce0ec5b9ee1f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:58.222231 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5e41d-8ea8-45b7-bcf9-ce0ec5b9ee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:58.239011 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-9be5e41d-8ea8-45b7-bcf9-ce0ec5b9ee1f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:38:58.240183 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9be5e41d-8ea8-45b7-bcf9-ce0ec5b9ee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:38:58.304125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 563/1108] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:38:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:38:58.328735 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16dd9b-c593-4ed5-9d79-a7cefae0e2fe None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:58.436171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16dd9b-c593-4ed5-9d79-a7cefae0e2fe None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:58.476096 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b62b4-1e85-4c7e-9b7b-370d1263a0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:58.476924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b62b4-1e85-4c7e-9b7b-370d1263a0fa None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:58.477208 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b62b4-1e85-4c7e-9b7b-370d1263a0fa None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:58.477483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b62b4-1e85-4c7e-9b7b-370d1263a0fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:58.479319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b62b4-1e85-4c7e-9b7b-370d1263a0fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:58.480974 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b62b4-1e85-4c7e-9b7b-370d1263a0fa None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:58.482592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 546/1109] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:38:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:38:58.488249 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5e41d-8ea8-45b7-bcf9-ce0ec5b9ee1f None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:38:58.547942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:38:58.584497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5e41d-8ea8-45b7-bcf9-ce0ec5b9ee1f None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:38:58.615823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4d92e-9b7a-4d25-9d35-395bd4177f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:38:58.616462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4d92e-9b7a-4d25-9d35-395bd4177f97 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:38:58.616767 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4d92e-9b7a-4d25-9d35-395bd4177f97 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:38:58.617042 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4d92e-9b7a-4d25-9d35-395bd4177f97 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:38:58.617745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4d92e-9b7a-4d25-9d35-395bd4177f97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:38:58.619666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4d92e-9b7a-4d25-9d35-395bd4177f97 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:38:58.693722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 564/1110] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:38:58 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:39:00.839641 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fb302-1b98-47c9-b0f6-b049851f4ccc None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:00.840182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fb302-1b98-47c9-b0f6-b049851f4ccc None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:00.840182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fb302-1b98-47c9-b0f6-b049851f4ccc None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:00.841570 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 547/1111] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:39:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:39:00.846819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1399e7-d94e-4bb8-8a1f-7a214273bf64 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:00.847198 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1399e7-d94e-4bb8-8a1f-7a214273bf64 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:00.847386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1399e7-d94e-4bb8-8a1f-7a214273bf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:00.864389 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-0a1399e7-d94e-4bb8-8a1f-7a214273bf64 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:39:00.865681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-0a1399e7-d94e-4bb8-8a1f-7a214273bf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:39:00.931571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 565/1112] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:39:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:39:00.955849 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fb302-1b98-47c9-b0f6-b049851f4ccc None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:00.992631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:01.062971 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fb302-1b98-47c9-b0f6-b049851f4ccc None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:01.099490 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47659b1c-86b2-4482-bf49-c52dd24d453d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:01.100267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47659b1c-86b2-4482-bf49-c52dd24d453d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:01.100547 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47659b1c-86b2-4482-bf49-c52dd24d453d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:01.100853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47659b1c-86b2-4482-bf49-c52dd24d453d None admin] PATH_INFO: `/v3/roles/aef73ff3b03c4ad0878a0dbb33fc285c` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:01.102313 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47659b1c-86b2-4482-bf49-c52dd24d453d None admin] RBAC: Authorizing `identity:get_role(role_id=aef73ff3b03c4ad0878a0dbb33fc285c)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:01.107779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47659b1c-86b2-4482-bf49-c52dd24d453d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:01.109210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 548/1113] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:39:00 2022] GET /identity/v3/roles/aef73ff3b03c4ad0878a0dbb33fc285c => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:01.115129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1399e7-d94e-4bb8-8a1f-7a214273bf64 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:01.163540 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:01.211967 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1399e7-d94e-4bb8-8a1f-7a214273bf64 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:01.244461 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e6d2b-6a93-4c3c-9e36-7d9a607ba1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:01.245344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e6d2b-6a93-4c3c-9e36-7d9a607ba1f9 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:01.245625 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e6d2b-6a93-4c3c-9e36-7d9a607ba1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:01.245923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e6d2b-6a93-4c3c-9e36-7d9a607ba1f9 None admin] PATH_INFO: `/v3/users/9cb9bc4cf8444653a8586160a82c0a14` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:01.258495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e6d2b-6a93-4c3c-9e36-7d9a607ba1f9 None admin] RBAC: Authorizing `identity:get_user(user_id=9cb9bc4cf8444653a8586160a82c0a14)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:01.260611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e6d2b-6a93-4c3c-9e36-7d9a607ba1f9 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:01.262275 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 566/1114] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:39:01 2022] GET /identity/v3/users/9cb9bc4cf8444653a8586160a82c0a14 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:01.268039 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47659b1c-86b2-4482-bf49-c52dd24d453d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:01.434089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47659b1c-86b2-4482-bf49-c52dd24d453d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:01.436308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:01.467927 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080506ea-5636-423c-881d-f2f3aa1081f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:01.468570 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080506ea-5636-423c-881d-f2f3aa1081f3 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:01.469020 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080506ea-5636-423c-881d-f2f3aa1081f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:01.469297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080506ea-5636-423c-881d-f2f3aa1081f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:01.533163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080506ea-5636-423c-881d-f2f3aa1081f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:01.534584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080506ea-5636-423c-881d-f2f3aa1081f3 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:01.627626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 549/1115] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:39:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:39:01.633578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e6d2b-6a93-4c3c-9e36-7d9a607ba1f9 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:01.729176 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e6d2b-6a93-4c3c-9e36-7d9a607ba1f9 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:01.737992 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:01.762274 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddee55-ef26-40dc-b2c3-e7f97d876235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:01.763118 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddee55-ef26-40dc-b2c3-e7f97d876235 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:01.763402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddee55-ef26-40dc-b2c3-e7f97d876235 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:01.763677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddee55-ef26-40dc-b2c3-e7f97d876235 None admin] PATH_INFO: `/v3/projects/01bfcb1a38134fbb91ed618a73e1b520` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:01.764864 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddee55-ef26-40dc-b2c3-e7f97d876235 None admin] RBAC: Authorizing `identity:get_project(project_id=01bfcb1a38134fbb91ed618a73e1b520)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:01.766338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddee55-ef26-40dc-b2c3-e7f97d876235 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:01.768464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 567/1116] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:39:01 2022] GET /identity/v3/projects/01bfcb1a38134fbb91ed618a73e1b520 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:01.774336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080506ea-5636-423c-881d-f2f3aa1081f3 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:01.777635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:01.870805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080506ea-5636-423c-881d-f2f3aa1081f3 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:01.901908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924c321-64a1-47f3-a8a1-ede31a38df11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:01.902534 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924c321-64a1-47f3-a8a1-ede31a38df11 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:01.902812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924c321-64a1-47f3-a8a1-ede31a38df11 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:01.903091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924c321-64a1-47f3-a8a1-ede31a38df11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:01.903909 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924c321-64a1-47f3-a8a1-ede31a38df11 None admin] RBAC: Adding query filter params (role.id=aef73ff3b03c4ad0878a0dbb33fc285c, scope.project.id=01bfcb1a38134fbb91ed618a73e1b520, user.id=9cb9bc4cf8444653a8586160a82c0a14) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:39:01.904215 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924c321-64a1-47f3-a8a1-ede31a38df11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:01.905640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924c321-64a1-47f3-a8a1-ede31a38df11 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:01.910820 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 550/1117] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:39:01 2022] GET /identity/v3/role_assignments?user.id=9cb9bc4cf8444653a8586160a82c0a14&scope.project.id=01bfcb1a38134fbb91ed618a73e1b520&role.id=aef73ff3b03c4ad0878a0dbb33fc285c => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:03.882639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be499584-984c-46b7-a25d-cabee0f411fb None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:03.883220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be499584-984c-46b7-a25d-cabee0f411fb None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:03.883220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be499584-984c-46b7-a25d-cabee0f411fb None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:03.885154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 568/1118] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:39:03.890273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c15bc-3e0c-4472-a044-1247f989d15d None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:03.890679 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c15bc-3e0c-4472-a044-1247f989d15d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:03.890832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c15bc-3e0c-4472-a044-1247f989d15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:03.907113 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-0d5c15bc-3e0c-4472-a044-1247f989d15d None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:39:03.908289 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0d5c15bc-3e0c-4472-a044-1247f989d15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:39:03.967341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:03.972525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 551/1119] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:39:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:39:03.996164 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be499584-984c-46b7-a25d-cabee0f411fb None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:04.094623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be499584-984c-46b7-a25d-cabee0f411fb None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:04.126701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33edcb8-f96f-4d99-8d40-2056f9b32279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:04.127542 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33edcb8-f96f-4d99-8d40-2056f9b32279 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:04.127819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33edcb8-f96f-4d99-8d40-2056f9b32279 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:04.128089 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33edcb8-f96f-4d99-8d40-2056f9b32279 None admin] PATH_INFO: `/v3/roles/aef73ff3b03c4ad0878a0dbb33fc285c` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:04.129571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33edcb8-f96f-4d99-8d40-2056f9b32279 None admin] RBAC: Authorizing `identity:get_role(role_id=aef73ff3b03c4ad0878a0dbb33fc285c)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:04.130914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33edcb8-f96f-4d99-8d40-2056f9b32279 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:04.132255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 569/1120] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:39:03 2022] GET /identity/v3/roles/aef73ff3b03c4ad0878a0dbb33fc285c => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:04.138635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c15bc-3e0c-4472-a044-1247f989d15d None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:04.232932 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c15bc-3e0c-4472-a044-1247f989d15d None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:04.264935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaebe5-d3df-4a89-bf56-40b87ef153e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:04.265772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaebe5-d3df-4a89-bf56-40b87ef153e5 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:04.266048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaebe5-d3df-4a89-bf56-40b87ef153e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:04.266315 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaebe5-d3df-4a89-bf56-40b87ef153e5 None admin] PATH_INFO: `/v3/users/9cb9bc4cf8444653a8586160a82c0a14` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:04.267477 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aaebe5-d3df-4a89-bf56-40b87ef153e5 None admin] RBAC: Authorizing `identity:get_user(user_id=9cb9bc4cf8444653a8586160a82c0a14)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:04.268901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aaebe5-d3df-4a89-bf56-40b87ef153e5 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:04.270477 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 552/1121] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:39:04 2022] GET /identity/v3/users/9cb9bc4cf8444653a8586160a82c0a14 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:04.276755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33edcb8-f96f-4d99-8d40-2056f9b32279 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:04.320352 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:04.373802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33edcb8-f96f-4d99-8d40-2056f9b32279 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:04.406355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec23710-6c3c-4182-afde-edf8b52322fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:04.407242 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec23710-6c3c-4182-afde-edf8b52322fb None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:04.407526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec23710-6c3c-4182-afde-edf8b52322fb None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:04.407805 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec23710-6c3c-4182-afde-edf8b52322fb None admin] PATH_INFO: `/v3/projects/01bfcb1a38134fbb91ed618a73e1b520` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:04.409001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec23710-6c3c-4182-afde-edf8b52322fb None admin] RBAC: Authorizing `identity:get_project(project_id=01bfcb1a38134fbb91ed618a73e1b520)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:04.410419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec23710-6c3c-4182-afde-edf8b52322fb None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:04.412096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 570/1122] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:39:04 2022] GET /identity/v3/projects/01bfcb1a38134fbb91ed618a73e1b520 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:04.418271 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaebe5-d3df-4a89-bf56-40b87ef153e5 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:04.481248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:04.515035 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaebe5-d3df-4a89-bf56-40b87ef153e5 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:04.547314 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5cde4-117b-480b-9a10-77757aa4be02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:04.548175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5cde4-117b-480b-9a10-77757aa4be02 None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:04.548454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5cde4-117b-480b-9a10-77757aa4be02 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:04.548749 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5cde4-117b-480b-9a10-77757aa4be02 None admin] PATH_INFO: `/v3/projects/01bfcb1a38134fbb91ed618a73e1b520/users/9cb9bc4cf8444653a8586160a82c0a14/roles/aef73ff3b03c4ad0878a0dbb33fc285c` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:04.550887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5cde4-117b-480b-9a10-77757aa4be02 None admin] RBAC: Authorizing `identity:create_grant(project_id=01bfcb1a38134fbb91ed618a73e1b520, user_id=9cb9bc4cf8444653a8586160a82c0a14, role_id=aef73ff3b03c4ad0878a0dbb33fc285c)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:04.552288 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5cde4-117b-480b-9a10-77757aa4be02 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:04.607529 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 553/1123] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:39:04 2022] PUT /identity/v3/projects/01bfcb1a38134fbb91ed618a73e1b520/users/9cb9bc4cf8444653a8586160a82c0a14/roles/aef73ff3b03c4ad0878a0dbb33fc285c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:39:06.602234 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49e9e0-7238-46da-8da4-1f8e51be50e8 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:06.602809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49e9e0-7238-46da-8da4-1f8e51be50e8 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:06.602809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49e9e0-7238-46da-8da4-1f8e51be50e8 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:06.604919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 571/1124] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:39:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:39:06.610126 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e39e61-fd6e-4745-a994-e7b4ac7f6475 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:06.610526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e39e61-fd6e-4745-a994-e7b4ac7f6475 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:06.610682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e39e61-fd6e-4745-a994-e7b4ac7f6475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:06.626872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-58e39e61-fd6e-4745-a994-e7b4ac7f6475 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:39:06.628049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-58e39e61-fd6e-4745-a994-e7b4ac7f6475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:39:06.692841 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 554/1125] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:39:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 14:39:06.716830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49e9e0-7238-46da-8da4-1f8e51be50e8 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:06.815569 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49e9e0-7238-46da-8da4-1f8e51be50e8 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:06.828507 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:06.849167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c484c7-6fd4-4ea0-95a2-382f39dbe43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:06.850010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c484c7-6fd4-4ea0-95a2-382f39dbe43e None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:06.850295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c484c7-6fd4-4ea0-95a2-382f39dbe43e None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:06.850572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c484c7-6fd4-4ea0-95a2-382f39dbe43e None admin] PATH_INFO: `/v3/roles/aef73ff3b03c4ad0878a0dbb33fc285c` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:06.852040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c484c7-6fd4-4ea0-95a2-382f39dbe43e None admin] RBAC: Authorizing `identity:get_role(role_id=aef73ff3b03c4ad0878a0dbb33fc285c)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:06.854227 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c484c7-6fd4-4ea0-95a2-382f39dbe43e None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:06.855521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 572/1126] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:39:06 2022] GET /identity/v3/roles/aef73ff3b03c4ad0878a0dbb33fc285c => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:06.861383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e39e61-fd6e-4745-a994-e7b4ac7f6475 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:06.915256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:06.957968 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e39e61-fd6e-4745-a994-e7b4ac7f6475 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:06.990561 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc6398-aed6-4953-b987-34047273ff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:06.991404 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc6398-aed6-4953-b987-34047273ff6a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:06.991680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc6398-aed6-4953-b987-34047273ff6a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:06.991947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc6398-aed6-4953-b987-34047273ff6a None admin] PATH_INFO: `/v3/users/9cb9bc4cf8444653a8586160a82c0a14` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:06.993130 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc6398-aed6-4953-b987-34047273ff6a None admin] RBAC: Authorizing `identity:get_user(user_id=9cb9bc4cf8444653a8586160a82c0a14)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:06.994618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc6398-aed6-4953-b987-34047273ff6a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:06.996284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 555/1127] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:39:06 2022] GET /identity/v3/users/9cb9bc4cf8444653a8586160a82c0a14 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:39:07.002029 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c484c7-6fd4-4ea0-95a2-382f39dbe43e None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:07.099459 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c484c7-6fd4-4ea0-95a2-382f39dbe43e None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:07.131212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a144443-3d43-4605-b995-d78e72b90bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:07.131844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a144443-3d43-4605-b995-d78e72b90bd2 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:07.132130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a144443-3d43-4605-b995-d78e72b90bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:07.132404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a144443-3d43-4605-b995-d78e72b90bd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:07.178460 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:07.196556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a144443-3d43-4605-b995-d78e72b90bd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:07.198870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a144443-3d43-4605-b995-d78e72b90bd2 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:07.292053 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 573/1128] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:39:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:39:07.298037 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc6398-aed6-4953-b987-34047273ff6a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:07.393548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc6398-aed6-4953-b987-34047273ff6a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:07.415426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:07.425468 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee9926-e78f-40d6-8362-89635b61afd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:07.426299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee9926-e78f-40d6-8362-89635b61afd0 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:07.426577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee9926-e78f-40d6-8362-89635b61afd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:07.426850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee9926-e78f-40d6-8362-89635b61afd0 None admin] PATH_INFO: `/v3/projects/01bfcb1a38134fbb91ed618a73e1b520` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:07.427998 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee9926-e78f-40d6-8362-89635b61afd0 None admin] RBAC: Authorizing `identity:get_project(project_id=01bfcb1a38134fbb91ed618a73e1b520)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:07.429430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee9926-e78f-40d6-8362-89635b61afd0 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:07.431133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 556/1129] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:39:07 2022] GET /identity/v3/projects/01bfcb1a38134fbb91ed618a73e1b520 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:07.437764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a144443-3d43-4605-b995-d78e72b90bd2 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:07.515878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:07.534027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a144443-3d43-4605-b995-d78e72b90bd2 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:07.567486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011eb11-7f99-47f6-9703-dce73b3c027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:07.568125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011eb11-7f99-47f6-9703-dce73b3c027e None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:07.568408 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011eb11-7f99-47f6-9703-dce73b3c027e None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:07.568710 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011eb11-7f99-47f6-9703-dce73b3c027e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:07.569539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011eb11-7f99-47f6-9703-dce73b3c027e None admin] RBAC: Adding query filter params (role.id=aef73ff3b03c4ad0878a0dbb33fc285c, scope.project.id=01bfcb1a38134fbb91ed618a73e1b520, user.id=9cb9bc4cf8444653a8586160a82c0a14) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:39:07.569854 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011eb11-7f99-47f6-9703-dce73b3c027e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:07.571264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011eb11-7f99-47f6-9703-dce73b3c027e None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:07.577986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 574/1130] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:39:07 2022] GET /identity/v3/role_assignments?user.id=9cb9bc4cf8444653a8586160a82c0a14&scope.project.id=01bfcb1a38134fbb91ed618a73e1b520&role.id=aef73ff3b03c4ad0878a0dbb33fc285c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:09.614397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c72ce1-43b0-40e2-b691-8b9b218fac71 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:09.614932 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c72ce1-43b0-40e2-b691-8b9b218fac71 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:09.614932 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c72ce1-43b0-40e2-b691-8b9b218fac71 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:09.616287 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 557/1131] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:39:09.621970 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daa2ed-7c8a-40d1-a6d5-ff5efdfb0308 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:09.622375 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daa2ed-7c8a-40d1-a6d5-ff5efdfb0308 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:09.622524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daa2ed-7c8a-40d1-a6d5-ff5efdfb0308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:09.639503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-61daa2ed-7c8a-40d1-a6d5-ff5efdfb0308 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:39:09.640698 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-61daa2ed-7c8a-40d1-a6d5-ff5efdfb0308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:39:09.705743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 575/1132] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:39:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:39:09.728435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c72ce1-43b0-40e2-b691-8b9b218fac71 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:09.826492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c72ce1-43b0-40e2-b691-8b9b218fac71 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:09.858787 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a73c95-2c5f-45fd-91c3-fcd4993b3190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:09.859548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a73c95-2c5f-45fd-91c3-fcd4993b3190 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:09.859823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a73c95-2c5f-45fd-91c3-fcd4993b3190 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:09.860090 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a73c95-2c5f-45fd-91c3-fcd4993b3190 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:09.861254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a73c95-2c5f-45fd-91c3-fcd4993b3190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:09.862653 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a73c95-2c5f-45fd-91c3-fcd4993b3190 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:09.864218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 558/1133] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:39:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:09.870566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daa2ed-7c8a-40d1-a6d5-ff5efdfb0308 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:09.940903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:09.965193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daa2ed-7c8a-40d1-a6d5-ff5efdfb0308 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:09.998660 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c132c2d-805c-4178-bb1b-770df608925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:09.999305 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132c2d-805c-4178-bb1b-770df608925b None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:09.999587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132c2d-805c-4178-bb1b-770df608925b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:09.999860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132c2d-805c-4178-bb1b-770df608925b None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:10.000555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c132c2d-805c-4178-bb1b-770df608925b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:10.001988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c132c2d-805c-4178-bb1b-770df608925b None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:10.099572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 576/1134] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Jun 27 14:39:09 2022] POST /identity/v3/projects => generated 311 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:39:12.117840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0e713-375d-4541-9a9e-4605c5754e10 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:12.118265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0e713-375d-4541-9a9e-4605c5754e10 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:12.118393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0e713-375d-4541-9a9e-4605c5754e10 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:12.119953 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 559/1135] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:39:12.125022 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca372fa7-0cd9-437d-bfa6-fb348237c136 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:12.125440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca372fa7-0cd9-437d-bfa6-fb348237c136 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:12.125588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca372fa7-0cd9-437d-bfa6-fb348237c136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:12.142736 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-ca372fa7-0cd9-437d-bfa6-fb348237c136 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:39:12.143919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-ca372fa7-0cd9-437d-bfa6-fb348237c136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:39:12.208863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 577/1136] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:39:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:39:12.235329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0e713-375d-4541-9a9e-4605c5754e10 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:12.293454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:12.333687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0e713-375d-4541-9a9e-4605c5754e10 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:12.366947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fcee8-4f6c-4b2b-9d12-d67210bc7c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:12.367663 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fcee8-4f6c-4b2b-9d12-d67210bc7c8b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:12.367948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fcee8-4f6c-4b2b-9d12-d67210bc7c8b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:12.368225 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fcee8-4f6c-4b2b-9d12-d67210bc7c8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:12.369481 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fcee8-4f6c-4b2b-9d12-d67210bc7c8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:12.370897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fcee8-4f6c-4b2b-9d12-d67210bc7c8b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:12.372486 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 560/1137] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:39:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:12.378023 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca372fa7-0cd9-437d-bfa6-fb348237c136 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:12.431749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:12.474724 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca372fa7-0cd9-437d-bfa6-fb348237c136 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:12.507192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097aca24-6fc6-44f9-8a2f-5fe5c6018c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:12.507848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aca24-6fc6-44f9-8a2f-5fe5c6018c31 None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:12.508130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aca24-6fc6-44f9-8a2f-5fe5c6018c31 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:12.508404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aca24-6fc6-44f9-8a2f-5fe5c6018c31 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:12.509668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097aca24-6fc6-44f9-8a2f-5fe5c6018c31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:12.511085 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097aca24-6fc6-44f9-8a2f-5fe5c6018c31 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:12.625884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 578/1138] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:39:12 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:39:14.685197 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c356c-a11b-4d64-b907-21bf92daa13c None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:14.685735 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c356c-a11b-4d64-b907-21bf92daa13c None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:14.685735 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c356c-a11b-4d64-b907-21bf92daa13c None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:14.687109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 561/1139] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:39:14.692150 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49247e62-d96c-4746-a582-6c679ab2d6be None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:14.692589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49247e62-d96c-4746-a582-6c679ab2d6be None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:14.692714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49247e62-d96c-4746-a582-6c679ab2d6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:14.709665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-49247e62-d96c-4746-a582-6c679ab2d6be None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:39:14.710834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-49247e62-d96c-4746-a582-6c679ab2d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:39:14.773982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 579/1140] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:39:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:39:14.797823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c356c-a11b-4d64-b907-21bf92daa13c None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:14.897618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c356c-a11b-4d64-b907-21bf92daa13c None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:14.922522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:14.929973 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223360a-e284-466a-84b0-66f67ef38c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:14.931510 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223360a-e284-466a-84b0-66f67ef38c7d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:14.931674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223360a-e284-466a-84b0-66f67ef38c7d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:14.931961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223360a-e284-466a-84b0-66f67ef38c7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:14.941838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223360a-e284-466a-84b0-66f67ef38c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-f223360a-e284-466a-84b0-66f67ef38c7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:39:14.950372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:39:14.951604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:39:14.952573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:39:14.952573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:39:14.952573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:39:14.952573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:39:14.952573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:39:14.952573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:39:14.952573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:39:14.952573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:39:14.952573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:39:14.952573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:39:14.952573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:39:14.952573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:39:14.952573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 562/1141] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:39:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:39:14.957858 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49247e62-d96c-4746-a582-6c679ab2d6be None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:14.999220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:15.053246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49247e62-d96c-4746-a582-6c679ab2d6be None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:15.088033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b9a3e-4b76-4087-be47-6730c7d500c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:15.088723 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b9a3e-4b76-4087-be47-6730c7d500c9 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:15.089011 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b9a3e-4b76-4087-be47-6730c7d500c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:15.089290 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b9a3e-4b76-4087-be47-6730c7d500c9 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:15.090036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b9a3e-4b76-4087-be47-6730c7d500c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:39:15.090344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b9a3e-4b76-4087-be47-6730c7d500c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:15.091697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b9a3e-4b76-4087-be47-6730c7d500c9 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:15.099779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 580/1142] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:39:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:15.105433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223360a-e284-466a-84b0-66f67ef38c7d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:15.202244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223360a-e284-466a-84b0-66f67ef38c7d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:15.234304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7eb19-617a-47a5-9e02-0aaefc496e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:15.235143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7eb19-617a-47a5-9e02-0aaefc496e2d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:15.235419 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7eb19-617a-47a5-9e02-0aaefc496e2d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:15.235691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7eb19-617a-47a5-9e02-0aaefc496e2d None admin] PATH_INFO: `/v3/users/3ce05aeb3f8f421ea9ef9092a747ee40` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:15.248771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7eb19-617a-47a5-9e02-0aaefc496e2d None admin] RBAC: Authorizing `identity:get_user(user_id=3ce05aeb3f8f421ea9ef9092a747ee40)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:15.250185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7eb19-617a-47a5-9e02-0aaefc496e2d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:15.251778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 563/1143] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:39:15 2022] GET /identity/v3/users/3ce05aeb3f8f421ea9ef9092a747ee40 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:15.257549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b9a3e-4b76-4087-be47-6730c7d500c9 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:15.352424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b9a3e-4b76-4087-be47-6730c7d500c9 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:15.355192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:15.385458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56d987-4c5c-43e6-8d51-1b0a634f1e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:15.386090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56d987-4c5c-43e6-8d51-1b0a634f1e04 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:15.386371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56d987-4c5c-43e6-8d51-1b0a634f1e04 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:15.386645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56d987-4c5c-43e6-8d51-1b0a634f1e04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:15.452025 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56d987-4c5c-43e6-8d51-1b0a634f1e04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:15.453516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56d987-4c5c-43e6-8d51-1b0a634f1e04 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:15.547202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 581/1144] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:39:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:39:15.553014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7eb19-617a-47a5-9e02-0aaefc496e2d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:15.598625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:15.648984 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7eb19-617a-47a5-9e02-0aaefc496e2d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:15.681809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42dc6c-34dc-4b4c-94dd-6c031963870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:15.682637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42dc6c-34dc-4b4c-94dd-6c031963870b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:15.682916 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42dc6c-34dc-4b4c-94dd-6c031963870b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:15.683185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42dc6c-34dc-4b4c-94dd-6c031963870b None admin] PATH_INFO: `/v3/projects/9453bbbcdf074d6890f5ca20884e4c0a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:15.684346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42dc6c-34dc-4b4c-94dd-6c031963870b None admin] RBAC: Authorizing `identity:get_project(project_id=9453bbbcdf074d6890f5ca20884e4c0a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:15.685781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42dc6c-34dc-4b4c-94dd-6c031963870b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:15.687440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 564/1145] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:39:15 2022] GET /identity/v3/projects/9453bbbcdf074d6890f5ca20884e4c0a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:15.693378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56d987-4c5c-43e6-8d51-1b0a634f1e04 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:15.696359 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:15.788956 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56d987-4c5c-43e6-8d51-1b0a634f1e04 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:15.820492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573177ea-2594-4cc6-a797-6ac1a7582c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:15.821155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573177ea-2594-4cc6-a797-6ac1a7582c96 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:15.821602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573177ea-2594-4cc6-a797-6ac1a7582c96 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:15.821784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573177ea-2594-4cc6-a797-6ac1a7582c96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:15.822857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573177ea-2594-4cc6-a797-6ac1a7582c96 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=9453bbbcdf074d6890f5ca20884e4c0a, user.id=3ce05aeb3f8f421ea9ef9092a747ee40) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:39:15.823160 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573177ea-2594-4cc6-a797-6ac1a7582c96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:15.824556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573177ea-2594-4cc6-a797-6ac1a7582c96 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:15.829774 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 582/1146] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:39:15 2022] GET /identity/v3/role_assignments?user.id=3ce05aeb3f8f421ea9ef9092a747ee40&scope.project.id=9453bbbcdf074d6890f5ca20884e4c0a&role.id=6036efe96c1948fb98d01c8703a0561a => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:17.893541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a5f9-4123-4072-ab2a-a7f8a3f65cd8 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:17.894099 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a5f9-4123-4072-ab2a-a7f8a3f65cd8 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:17.894099 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a5f9-4123-4072-ab2a-a7f8a3f65cd8 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:17.895431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 565/1147] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:39:17.901062 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287be69-bc0e-417a-8576-644fe951f220 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:17.901487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287be69-bc0e-417a-8576-644fe951f220 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:17.901616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287be69-bc0e-417a-8576-644fe951f220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:17.918491 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-b287be69-bc0e-417a-8576-644fe951f220 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:39:17.919675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b287be69-bc0e-417a-8576-644fe951f220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:39:17.979632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:17.984940 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 583/1148] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:39:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:39:18.006782 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540a5f9-4123-4072-ab2a-a7f8a3f65cd8 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:18.103816 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540a5f9-4123-4072-ab2a-a7f8a3f65cd8 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:18.117260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:18.135895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa9339-e88a-4b73-9763-4fac2f5ca17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:18.136673 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa9339-e88a-4b73-9763-4fac2f5ca17a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:18.136962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa9339-e88a-4b73-9763-4fac2f5ca17a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:18.137227 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa9339-e88a-4b73-9763-4fac2f5ca17a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:18.146966 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa9339-e88a-4b73-9763-4fac2f5ca17a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-02aa9339-e88a-4b73-9763-4fac2f5ca17a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:39:18.155252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:39:18.156250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:39:18.157164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:39:18.157164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:39:18.157164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:39:18.157164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:39:18.157164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:39:18.157164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:39:18.157164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:39:18.157164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:39:18.157164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:39:18.157164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:39:18.157164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:39:18.157164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:39:18.157164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 566/1149] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:39:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:39:18.162828 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287be69-bc0e-417a-8576-644fe951f220 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:18.257539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287be69-bc0e-417a-8576-644fe951f220 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:18.290345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9d38d-17eb-4386-a152-ef3c10f9df86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:18.291064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9d38d-17eb-4386-a152-ef3c10f9df86 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:18.291345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9d38d-17eb-4386-a152-ef3c10f9df86 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:18.291616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9d38d-17eb-4386-a152-ef3c10f9df86 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:18.292350 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9d38d-17eb-4386-a152-ef3c10f9df86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:39:18.292672 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9d38d-17eb-4386-a152-ef3c10f9df86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:18.294014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9d38d-17eb-4386-a152-ef3c10f9df86 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:18.301692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 584/1150] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:39:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:18.307389 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa9339-e88a-4b73-9763-4fac2f5ca17a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:18.404463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa9339-e88a-4b73-9763-4fac2f5ca17a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:18.436278 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573e99c-2cbb-4d9b-90b0-557a8377d0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:18.437190 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573e99c-2cbb-4d9b-90b0-557a8377d0c1 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:18.437471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573e99c-2cbb-4d9b-90b0-557a8377d0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:18.437742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573e99c-2cbb-4d9b-90b0-557a8377d0c1 None admin] PATH_INFO: `/v3/users/3ce05aeb3f8f421ea9ef9092a747ee40` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:18.438905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573e99c-2cbb-4d9b-90b0-557a8377d0c1 None admin] RBAC: Authorizing `identity:get_user(user_id=3ce05aeb3f8f421ea9ef9092a747ee40)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:18.440402 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573e99c-2cbb-4d9b-90b0-557a8377d0c1 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:18.442032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 567/1151] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:39:18 2022] GET /identity/v3/users/3ce05aeb3f8f421ea9ef9092a747ee40 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:18.448514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9d38d-17eb-4386-a152-ef3c10f9df86 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:18.505905 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:18.547131 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9d38d-17eb-4386-a152-ef3c10f9df86 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:18.579782 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eeabf-68cc-4748-9f79-f4da79e79d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:18.580627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eeabf-68cc-4748-9f79-f4da79e79d0a None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:18.580950 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eeabf-68cc-4748-9f79-f4da79e79d0a None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:18.581227 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eeabf-68cc-4748-9f79-f4da79e79d0a None admin] PATH_INFO: `/v3/projects/9453bbbcdf074d6890f5ca20884e4c0a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:18.582402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305eeabf-68cc-4748-9f79-f4da79e79d0a None admin] RBAC: Authorizing `identity:get_project(project_id=9453bbbcdf074d6890f5ca20884e4c0a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:18.583809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305eeabf-68cc-4748-9f79-f4da79e79d0a None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:18.585516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 585/1152] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:39:18 2022] GET /identity/v3/projects/9453bbbcdf074d6890f5ca20884e4c0a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:18.591784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573e99c-2cbb-4d9b-90b0-557a8377d0c1 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:18.633785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:18.688394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573e99c-2cbb-4d9b-90b0-557a8377d0c1 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:18.720723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a5d38-3c71-465c-975a-50324a703aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:18.721589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a5d38-3c71-465c-975a-50324a703aec None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:18.721867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a5d38-3c71-465c-975a-50324a703aec None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:18.722138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a5d38-3c71-465c-975a-50324a703aec None admin] PATH_INFO: `/v3/projects/9453bbbcdf074d6890f5ca20884e4c0a/users/3ce05aeb3f8f421ea9ef9092a747ee40/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:18.724041 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a5d38-3c71-465c-975a-50324a703aec None admin] RBAC: Authorizing `identity:create_grant(project_id=9453bbbcdf074d6890f5ca20884e4c0a, user_id=3ce05aeb3f8f421ea9ef9092a747ee40, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:18.725494 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a5d38-3c71-465c-975a-50324a703aec None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:18.807867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 568/1153] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:39:18 2022] PUT /identity/v3/projects/9453bbbcdf074d6890f5ca20884e4c0a/users/3ce05aeb3f8f421ea9ef9092a747ee40/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:39:20.841612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6967946-233f-47cc-9ae5-9b8ad8dcf86f None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:20.842161 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6967946-233f-47cc-9ae5-9b8ad8dcf86f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:20.842161 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6967946-233f-47cc-9ae5-9b8ad8dcf86f None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:20.843516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 586/1154] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:39:20.848775 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8a01e-75b8-426e-ab46-48cf11d58e84 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:20.849180 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8a01e-75b8-426e-ab46-48cf11d58e84 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:20.849341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8a01e-75b8-426e-ab46-48cf11d58e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:20.865984 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-89d8a01e-75b8-426e-ab46-48cf11d58e84 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:39:20.867170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-89d8a01e-75b8-426e-ab46-48cf11d58e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:39:20.933589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 569/1155] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:39:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:39:20.958130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6967946-233f-47cc-9ae5-9b8ad8dcf86f None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:21.058344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6967946-233f-47cc-9ae5-9b8ad8dcf86f None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:21.084210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:21.091949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f952a-c95d-4826-a799-8219b0c01b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:21.092692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f952a-c95d-4826-a799-8219b0c01b2d None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:21.092980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f952a-c95d-4826-a799-8219b0c01b2d None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:21.093253 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f952a-c95d-4826-a799-8219b0c01b2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:21.103188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f952a-c95d-4826-a799-8219b0c01b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-a77f952a-c95d-4826-a799-8219b0c01b2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:39:21.110761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:39:21.111831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:39:21.112853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:39:21.112853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:39:21.112853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:39:21.112853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:39:21.112853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:39:21.112853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:39:21.112853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:39:21.112853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:39:21.112853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:39:21.112853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:39:21.112853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:39:21.112853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:39:21.112853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 587/1156] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:39:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:39:21.118080 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8a01e-75b8-426e-ab46-48cf11d58e84 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:21.147878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:21.214608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8a01e-75b8-426e-ab46-48cf11d58e84 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:21.247119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4ac73-7e59-4991-9226-36333e81bf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:21.247766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4ac73-7e59-4991-9226-36333e81bf8d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:21.248043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4ac73-7e59-4991-9226-36333e81bf8d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:21.248313 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4ac73-7e59-4991-9226-36333e81bf8d None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:21.249081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4ac73-7e59-4991-9226-36333e81bf8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:39:21.249385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4ac73-7e59-4991-9226-36333e81bf8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:21.250725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4ac73-7e59-4991-9226-36333e81bf8d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:21.258412 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 570/1157] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:39:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:21.264230 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f952a-c95d-4826-a799-8219b0c01b2d None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:21.361494 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f952a-c95d-4826-a799-8219b0c01b2d None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:21.393821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ddfb1-ef49-4218-97fe-9548faf5e289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:21.394672 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ddfb1-ef49-4218-97fe-9548faf5e289 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:21.394954 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ddfb1-ef49-4218-97fe-9548faf5e289 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:21.395229 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ddfb1-ef49-4218-97fe-9548faf5e289 None admin] PATH_INFO: `/v3/users/3ce05aeb3f8f421ea9ef9092a747ee40` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:21.396398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ddfb1-ef49-4218-97fe-9548faf5e289 None admin] RBAC: Authorizing `identity:get_user(user_id=3ce05aeb3f8f421ea9ef9092a747ee40)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:21.397833 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ddfb1-ef49-4218-97fe-9548faf5e289 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:21.399433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 588/1158] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:39:21 2022] GET /identity/v3/users/3ce05aeb3f8f421ea9ef9092a747ee40 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:21.405013 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4ac73-7e59-4991-9226-36333e81bf8d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:21.494920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:21.501230 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4ac73-7e59-4991-9226-36333e81bf8d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:21.533745 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2628-e314-4261-a0aa-97022fd60771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:21.534377 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2628-e314-4261-a0aa-97022fd60771 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:21.534660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2628-e314-4261-a0aa-97022fd60771 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:21.534934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2628-e314-4261-a0aa-97022fd60771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:21.600351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba2628-e314-4261-a0aa-97022fd60771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:21.601824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba2628-e314-4261-a0aa-97022fd60771 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:21.689207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:21.696262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 571/1159] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:39:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:39:21.702414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ddfb1-ef49-4218-97fe-9548faf5e289 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:21.757276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:21.801288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ddfb1-ef49-4218-97fe-9548faf5e289 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:21.833656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6aca8f-8fb3-45ea-8cb0-6ee748eecf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:21.834495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6aca8f-8fb3-45ea-8cb0-6ee748eecf5f None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:21.834776 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6aca8f-8fb3-45ea-8cb0-6ee748eecf5f None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:21.835050 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6aca8f-8fb3-45ea-8cb0-6ee748eecf5f None admin] PATH_INFO: `/v3/projects/9453bbbcdf074d6890f5ca20884e4c0a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:21.836212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6aca8f-8fb3-45ea-8cb0-6ee748eecf5f None admin] RBAC: Authorizing `identity:get_project(project_id=9453bbbcdf074d6890f5ca20884e4c0a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:21.838281 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6aca8f-8fb3-45ea-8cb0-6ee748eecf5f None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:21.839945 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 589/1160] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:39:21 2022] GET /identity/v3/projects/9453bbbcdf074d6890f5ca20884e4c0a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:21.845957 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2628-e314-4261-a0aa-97022fd60771 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:21.942124 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2628-e314-4261-a0aa-97022fd60771 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:21.975592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5955125-e36a-4e51-a96f-432aa38aa944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:21.976235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5955125-e36a-4e51-a96f-432aa38aa944 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:21.976519 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5955125-e36a-4e51-a96f-432aa38aa944 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:21.976835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5955125-e36a-4e51-a96f-432aa38aa944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:21.978374 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5955125-e36a-4e51-a96f-432aa38aa944 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=9453bbbcdf074d6890f5ca20884e4c0a, user.id=3ce05aeb3f8f421ea9ef9092a747ee40) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:39:21.978896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5955125-e36a-4e51-a96f-432aa38aa944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:21.980316 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5955125-e36a-4e51-a96f-432aa38aa944 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:21.986058 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 572/1161] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:39:21 2022] GET /identity/v3/role_assignments?user.id=3ce05aeb3f8f421ea9ef9092a747ee40&scope.project.id=9453bbbcdf074d6890f5ca20884e4c0a&role.id=6036efe96c1948fb98d01c8703a0561a => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:24.022886 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3736025-d266-4611-ac77-e646606a5469 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:24.023455 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3736025-d266-4611-ac77-e646606a5469 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:24.023455 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3736025-d266-4611-ac77-e646606a5469 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:24.025384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 590/1162] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:39:24.030784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfdf0c-9463-452a-aab6-1d38f3831682 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:24.031171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfdf0c-9463-452a-aab6-1d38f3831682 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:24.031329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfdf0c-9463-452a-aab6-1d38f3831682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:24.048150 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-a0cfdf0c-9463-452a-aab6-1d38f3831682 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:39:24.049345 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-a0cfdf0c-9463-452a-aab6-1d38f3831682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:39:24.100008 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:24.113653 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 573/1163] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:39:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:39:24.136890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3736025-d266-4611-ac77-e646606a5469 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:24.235394 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3736025-d266-4611-ac77-e646606a5469 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:24.257364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:24.268140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae81c7-c6d1-40dd-8610-a5ff21d0093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:24.269480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae81c7-c6d1-40dd-8610-a5ff21d0093c None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:24.269480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae81c7-c6d1-40dd-8610-a5ff21d0093c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:24.269480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae81c7-c6d1-40dd-8610-a5ff21d0093c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:24.333831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae81c7-c6d1-40dd-8610-a5ff21d0093c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:24.335185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae81c7-c6d1-40dd-8610-a5ff21d0093c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:24.428984 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 591/1164] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:39:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:39:24.435105 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfdf0c-9463-452a-aab6-1d38f3831682 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:24.529960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfdf0c-9463-452a-aab6-1d38f3831682 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:24.562074 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5035da-814a-4f8e-87cf-9c649fbc0646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:24.562846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5035da-814a-4f8e-87cf-9c649fbc0646 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:24.563124 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5035da-814a-4f8e-87cf-9c649fbc0646 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:24.563405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5035da-814a-4f8e-87cf-9c649fbc0646 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:24.569796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5035da-814a-4f8e-87cf-9c649fbc0646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:24.571740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5035da-814a-4f8e-87cf-9c649fbc0646 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-7b5035da-814a-4f8e-87cf-9c649fbc0646 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:39:24.585661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:39:24.587615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:39:24.588922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:39:24.588922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:39:24.588922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:39:24.588922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:39:24.588922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:39:24.588922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:39:24.588922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:39:24.588922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:39:24.588922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:39:24.588922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:39:24.588922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 27 14:39:24.588922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:39:24.588922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 27 14:39:24.588922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:39:24.588922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 574/1165] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Jun 27 14:39:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:39:24.593119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae81c7-c6d1-40dd-8610-a5ff21d0093c None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:24.616425 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:24.688333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae81c7-c6d1-40dd-8610-a5ff21d0093c None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:24.720854 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee2e1e-6caa-46ee-9e50-96682d5d82ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:24.721493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee2e1e-6caa-46ee-9e50-96682d5d82ff None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:24.721769 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee2e1e-6caa-46ee-9e50-96682d5d82ff None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:24.722038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee2e1e-6caa-46ee-9e50-96682d5d82ff None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:24.722775 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee2e1e-6caa-46ee-9e50-96682d5d82ff None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:39:24.723076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee2e1e-6caa-46ee-9e50-96682d5d82ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:24.724417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee2e1e-6caa-46ee-9e50-96682d5d82ff None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:24.731401 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 592/1166] 10.222.0.44 () {56 vars in 1115 bytes} [Mon Jun 27 14:39:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:26.769788 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bd318-8d0c-44e6-b879-60880f232194 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:26.770323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bd318-8d0c-44e6-b879-60880f232194 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:26.770323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bd318-8d0c-44e6-b879-60880f232194 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:26.771711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 575/1167] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:39:26.776955 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea31465-959c-4a3f-9674-556bfd8abd3b None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:26.777418 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea31465-959c-4a3f-9674-556bfd8abd3b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:26.777515 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea31465-959c-4a3f-9674-556bfd8abd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:26.794288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-4ea31465-959c-4a3f-9674-556bfd8abd3b None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:39:26.795457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4ea31465-959c-4a3f-9674-556bfd8abd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:39:26.860413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 593/1168] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:39:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:39:26.884264 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bd318-8d0c-44e6-b879-60880f232194 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:26.933500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:26.983383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bd318-8d0c-44e6-b879-60880f232194 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:27.014833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c1605-8d54-4d1b-87fc-b7e01e8d52c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:27.015469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c1605-8d54-4d1b-87fc-b7e01e8d52c3 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:27.015751 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c1605-8d54-4d1b-87fc-b7e01e8d52c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:27.016027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c1605-8d54-4d1b-87fc-b7e01e8d52c3 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:27.016935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c1605-8d54-4d1b-87fc-b7e01e8d52c3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:27.018277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c1605-8d54-4d1b-87fc-b7e01e8d52c3 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:27.117673 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 576/1169] 10.222.0.44 () {60 vars in 1138 bytes} [Mon Jun 27 14:39:26 2022] POST /identity/v3/domains => generated 267 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:39:29.130388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb8541-4be9-474a-b252-e61b49130fda None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:29.130849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb8541-4be9-474a-b252-e61b49130fda None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:29.130936 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb8541-4be9-474a-b252-e61b49130fda None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:29.132309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 594/1170] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:39:29.142562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef34d5-2660-4507-a875-29f712d96833 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:29.142948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef34d5-2660-4507-a875-29f712d96833 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:29.143111 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef34d5-2660-4507-a875-29f712d96833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:29.168125 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-47ef34d5-2660-4507-a875-29f712d96833 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:39:29.169352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-47ef34d5-2660-4507-a875-29f712d96833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:39:29.234294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 577/1171] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:39:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:39:29.258284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb8541-4be9-474a-b252-e61b49130fda None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:29.277228 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:29.355843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb8541-4be9-474a-b252-e61b49130fda None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:29.388712 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901be3ff-7bc1-4920-a02b-2f2f0531549b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:29.389548 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901be3ff-7bc1-4920-a02b-2f2f0531549b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:29.389827 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901be3ff-7bc1-4920-a02b-2f2f0531549b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:29.390099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901be3ff-7bc1-4920-a02b-2f2f0531549b None admin] PATH_INFO: `/v3/domains/30db060d3f064c1eb8ce39a2e2878dee` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:29.400066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901be3ff-7bc1-4920-a02b-2f2f0531549b None admin] RBAC: Authorizing `identity:get_domain(domain_id=30db060d3f064c1eb8ce39a2e2878dee)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:29.401499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901be3ff-7bc1-4920-a02b-2f2f0531549b None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:29.403084 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 595/1172] 10.222.0.44 () {56 vars in 1183 bytes} [Mon Jun 27 14:39:29 2022] GET /identity/v3/domains/30db060d3f064c1eb8ce39a2e2878dee => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:29.408876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef34d5-2660-4507-a875-29f712d96833 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:29.448584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:29.505941 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef34d5-2660-4507-a875-29f712d96833 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:29.537756 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5512a-898c-4d69-a978-1cbceff9e561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:29.538396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5512a-898c-4d69-a978-1cbceff9e561 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:29.538673 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5512a-898c-4d69-a978-1cbceff9e561 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:29.538943 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5512a-898c-4d69-a978-1cbceff9e561 None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:29.540139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5512a-898c-4d69-a978-1cbceff9e561 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:29.541548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5512a-898c-4d69-a978-1cbceff9e561 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:29.620464 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 578/1173] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Jun 27 14:39:29 2022] POST /identity/v3/projects => generated 361 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:39:31.655868 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78959f60-e69e-4075-b463-64b23054f255 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:31.656404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78959f60-e69e-4075-b463-64b23054f255 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:31.656497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78959f60-e69e-4075-b463-64b23054f255 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:31.657820 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 596/1174] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:39:31.662870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dffc58-69d4-4a87-8300-4be6f5abfa0d None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:31.663251 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dffc58-69d4-4a87-8300-4be6f5abfa0d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:31.663428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dffc58-69d4-4a87-8300-4be6f5abfa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:31.680321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b9dffc58-69d4-4a87-8300-4be6f5abfa0d None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:39:31.681684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b9dffc58-69d4-4a87-8300-4be6f5abfa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:39:31.744401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 579/1175] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:39:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:39:31.772742 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78959f60-e69e-4075-b463-64b23054f255 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:31.852274 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:31.873561 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78959f60-e69e-4075-b463-64b23054f255 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:31.910776 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b27cff-2488-4d30-a07f-a9d17d1717d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:31.911565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b27cff-2488-4d30-a07f-a9d17d1717d8 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:31.911847 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b27cff-2488-4d30-a07f-a9d17d1717d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:31.912120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b27cff-2488-4d30-a07f-a9d17d1717d8 None admin] PATH_INFO: `/v3/domains/30db060d3f064c1eb8ce39a2e2878dee` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:31.913288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b27cff-2488-4d30-a07f-a9d17d1717d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=30db060d3f064c1eb8ce39a2e2878dee)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:31.914760 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b27cff-2488-4d30-a07f-a9d17d1717d8 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:31.916373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 597/1176] 10.222.0.44 () {56 vars in 1183 bytes} [Mon Jun 27 14:39:31 2022] GET /identity/v3/domains/30db060d3f064c1eb8ce39a2e2878dee => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:31.922054 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dffc58-69d4-4a87-8300-4be6f5abfa0d None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:31.942273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:32.018581 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dffc58-69d4-4a87-8300-4be6f5abfa0d None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:32.051147 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be541738-0411-463c-b263-6efddeaed739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:32.051802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be541738-0411-463c-b263-6efddeaed739 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:32.052084 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be541738-0411-463c-b263-6efddeaed739 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:32.052358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be541738-0411-463c-b263-6efddeaed739 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:32.053095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be541738-0411-463c-b263-6efddeaed739 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:32.054503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be541738-0411-463c-b263-6efddeaed739 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:32.143727 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 580/1177] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:39:31 2022] POST /identity/v3/users => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:39:34.240253 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456032d-cf2d-4aad-aca6-e19611d1603b None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:34.240811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456032d-cf2d-4aad-aca6-e19611d1603b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:34.240911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456032d-cf2d-4aad-aca6-e19611d1603b None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:34.242190 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 598/1178] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:39:34.247439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ee669-0346-4518-b4ae-391c3d7ee723 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:34.247852 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ee669-0346-4518-b4ae-391c3d7ee723 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:34.247992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ee669-0346-4518-b4ae-391c3d7ee723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:34.265513 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-236ee669-0346-4518-b4ae-391c3d7ee723 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:39:34.266688 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-236ee669-0346-4518-b4ae-391c3d7ee723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:39:34.330783 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 581/1179] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:39:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:39:34.354427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456032d-cf2d-4aad-aca6-e19611d1603b None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:34.452968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456032d-cf2d-4aad-aca6-e19611d1603b None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:34.485754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad0ca1-2883-4993-9203-74f7739a3c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:34.486523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad0ca1-2883-4993-9203-74f7739a3c0c None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:34.486807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad0ca1-2883-4993-9203-74f7739a3c0c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:34.487083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad0ca1-2883-4993-9203-74f7739a3c0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:34.497708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad0ca1-2883-4993-9203-74f7739a3c0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-8aad0ca1-2883-4993-9203-74f7739a3c0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:39:34.505167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:39:34.506335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:39:34.507464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:39:34.507464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:39:34.507464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:39:34.507464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:39:34.507464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:39:34.507464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:39:34.507464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:39:34.507464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:39:34.507464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:39:34.507464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:39:34.507464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:39:34.507464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:39:34.507464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 599/1180] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:39:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:39:34.513023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ee669-0346-4518-b4ae-391c3d7ee723 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:34.520906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:34.609862 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ee669-0346-4518-b4ae-391c3d7ee723 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:34.643185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe9b97-15af-40b6-81c5-8cfcb2ec7533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:34.643836 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe9b97-15af-40b6-81c5-8cfcb2ec7533 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:34.644118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe9b97-15af-40b6-81c5-8cfcb2ec7533 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:34.644394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe9b97-15af-40b6-81c5-8cfcb2ec7533 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:34.645162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe9b97-15af-40b6-81c5-8cfcb2ec7533 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:39:34.645467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe9b97-15af-40b6-81c5-8cfcb2ec7533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:34.646814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe9b97-15af-40b6-81c5-8cfcb2ec7533 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:34.654701 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 582/1181] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:39:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:34.660280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad0ca1-2883-4993-9203-74f7739a3c0c None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:34.669488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:34.758592 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad0ca1-2883-4993-9203-74f7739a3c0c None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:34.790900 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31ea2b-1ff3-415a-9571-7680cc0b3a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:34.791746 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ea2b-1ff3-415a-9571-7680cc0b3a0f None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:34.792027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ea2b-1ff3-415a-9571-7680cc0b3a0f None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:34.792301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ea2b-1ff3-415a-9571-7680cc0b3a0f None admin] PATH_INFO: `/v3/users/89bae14799ab4f63a4153fe6c3ab7843` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:34.804810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31ea2b-1ff3-415a-9571-7680cc0b3a0f None admin] RBAC: Authorizing `identity:get_user(user_id=89bae14799ab4f63a4153fe6c3ab7843)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:34.807016 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31ea2b-1ff3-415a-9571-7680cc0b3a0f None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:34.808625 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 600/1182] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:39:34 2022] GET /identity/v3/users/89bae14799ab4f63a4153fe6c3ab7843 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:34.814242 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe9b97-15af-40b6-81c5-8cfcb2ec7533 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:34.877540 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:34.908958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe9b97-15af-40b6-81c5-8cfcb2ec7533 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:34.941639 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a302a-6366-4e15-9ac3-b93faf3576ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:34.942267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a302a-6366-4e15-9ac3-b93faf3576ea None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:34.942549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a302a-6366-4e15-9ac3-b93faf3576ea None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:34.942823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a302a-6366-4e15-9ac3-b93faf3576ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:35.006964 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a302a-6366-4e15-9ac3-b93faf3576ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:35.008410 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a302a-6366-4e15-9ac3-b93faf3576ea None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:35.069619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:35.104225 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 583/1183] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:39:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:39:35.110030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31ea2b-1ff3-415a-9571-7680cc0b3a0f None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:35.171360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:35.207954 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31ea2b-1ff3-415a-9571-7680cc0b3a0f None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:35.253923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd727c-2bde-45f7-8ce4-b87bb3ceb244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:35.254767 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd727c-2bde-45f7-8ce4-b87bb3ceb244 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:35.255045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd727c-2bde-45f7-8ce4-b87bb3ceb244 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:35.255317 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd727c-2bde-45f7-8ce4-b87bb3ceb244 None admin] PATH_INFO: `/v3/projects/e693775e709146219f0efac6704e086d` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:35.256509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd727c-2bde-45f7-8ce4-b87bb3ceb244 None admin] RBAC: Authorizing `identity:get_project(project_id=e693775e709146219f0efac6704e086d)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:35.261823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd727c-2bde-45f7-8ce4-b87bb3ceb244 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:35.263492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 601/1184] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:39:35 2022] GET /identity/v3/projects/e693775e709146219f0efac6704e086d => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:35.269701 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a302a-6366-4e15-9ac3-b93faf3576ea None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:35.365736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a302a-6366-4e15-9ac3-b93faf3576ea None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:35.397811 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79354183-b36e-4f31-8c66-07eb841f23b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:35.398450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79354183-b36e-4f31-8c66-07eb841f23b6 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:35.398730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79354183-b36e-4f31-8c66-07eb841f23b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:35.399525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79354183-b36e-4f31-8c66-07eb841f23b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:35.400465 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79354183-b36e-4f31-8c66-07eb841f23b6 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=e693775e709146219f0efac6704e086d, user.id=89bae14799ab4f63a4153fe6c3ab7843) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:39:35.400811 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79354183-b36e-4f31-8c66-07eb841f23b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:35.402212 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79354183-b36e-4f31-8c66-07eb841f23b6 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:35.407471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 584/1185] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:39:35 2022] GET /identity/v3/role_assignments?user.id=89bae14799ab4f63a4153fe6c3ab7843&scope.project.id=e693775e709146219f0efac6704e086d&role.id=6036efe96c1948fb98d01c8703a0561a => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:37.432389 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11693696-2354-4476-a7d7-be7aa84dd510 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:37.432932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11693696-2354-4476-a7d7-be7aa84dd510 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:37.433041 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11693696-2354-4476-a7d7-be7aa84dd510 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:37.434337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 602/1186] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:39:37.439523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9624b-4c43-439d-bca5-ff28084af1bd None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:37.439893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9624b-4c43-439d-bca5-ff28084af1bd None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:37.440073 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9624b-4c43-439d-bca5-ff28084af1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:37.457255 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-59e9624b-4c43-439d-bca5-ff28084af1bd None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:39:37.458419 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-59e9624b-4c43-439d-bca5-ff28084af1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:39:37.482772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:37.522428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 585/1187] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:39:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:39:37.544942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11693696-2354-4476-a7d7-be7aa84dd510 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:37.643033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11693696-2354-4476-a7d7-be7aa84dd510 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:37.670175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:37.674815 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9468de8-387c-4832-aea1-47883e03864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:37.675578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9468de8-387c-4832-aea1-47883e03864a None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:37.675855 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9468de8-387c-4832-aea1-47883e03864a None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:37.676125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9468de8-387c-4832-aea1-47883e03864a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:37.692992 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9468de8-387c-4832-aea1-47883e03864a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-b9468de8-387c-4832-aea1-47883e03864a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:39:37.693953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:39:37.695057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:39:37.697093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:39:37.697093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:39:37.697093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:39:37.697093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:39:37.697093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:39:37.697093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:39:37.697093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:39:37.697093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:39:37.697093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:39:37.697093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:39:37.697093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:39:37.697093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:39:37.697093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 603/1188] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:39:37.702203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9624b-4c43-439d-bca5-ff28084af1bd None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:37.798349 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9624b-4c43-439d-bca5-ff28084af1bd None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:37.831677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f50b0-1d6b-41ce-b1b3-f06cc975c805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:37.832326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f50b0-1d6b-41ce-b1b3-f06cc975c805 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:37.832604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f50b0-1d6b-41ce-b1b3-f06cc975c805 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:37.832910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f50b0-1d6b-41ce-b1b3-f06cc975c805 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:37.833653 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f50b0-1d6b-41ce-b1b3-f06cc975c805 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:39:37.833956 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f50b0-1d6b-41ce-b1b3-f06cc975c805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:37.835313 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f50b0-1d6b-41ce-b1b3-f06cc975c805 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:37.843268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 586/1189] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:37.848929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9468de8-387c-4832-aea1-47883e03864a None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:37.945525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9468de8-387c-4832-aea1-47883e03864a None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:37.977807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fcad2-5cde-4251-b7a9-7c010757f282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:37.978679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fcad2-5cde-4251-b7a9-7c010757f282 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:37.978962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fcad2-5cde-4251-b7a9-7c010757f282 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:37.979236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fcad2-5cde-4251-b7a9-7c010757f282 None admin] PATH_INFO: `/v3/users/89bae14799ab4f63a4153fe6c3ab7843` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:37.980405 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fcad2-5cde-4251-b7a9-7c010757f282 None admin] RBAC: Authorizing `identity:get_user(user_id=89bae14799ab4f63a4153fe6c3ab7843)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:37.981846 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fcad2-5cde-4251-b7a9-7c010757f282 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:37.983440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 604/1190] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:39:37 2022] GET /identity/v3/users/89bae14799ab4f63a4153fe6c3ab7843 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:37.989042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f50b0-1d6b-41ce-b1b3-f06cc975c805 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:38.014302 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:38.084555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f50b0-1d6b-41ce-b1b3-f06cc975c805 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:38.118812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec094560-f790-41b2-8714-e6ba15da3943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:38.119656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec094560-f790-41b2-8714-e6ba15da3943 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:38.119934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec094560-f790-41b2-8714-e6ba15da3943 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:38.120206 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec094560-f790-41b2-8714-e6ba15da3943 None admin] PATH_INFO: `/v3/projects/e693775e709146219f0efac6704e086d` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:38.121381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec094560-f790-41b2-8714-e6ba15da3943 None admin] RBAC: Authorizing `identity:get_project(project_id=e693775e709146219f0efac6704e086d)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:38.122793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec094560-f790-41b2-8714-e6ba15da3943 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:38.124470 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 587/1191] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:39:37 2022] GET /identity/v3/projects/e693775e709146219f0efac6704e086d => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:38.130248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fcad2-5cde-4251-b7a9-7c010757f282 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:38.191118 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:38.230788 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fcad2-5cde-4251-b7a9-7c010757f282 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:38.263221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7574837-983c-4edc-8b46-eb4798c3d7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:38.264088 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7574837-983c-4edc-8b46-eb4798c3d7ab None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:38.264367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7574837-983c-4edc-8b46-eb4798c3d7ab None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:38.264669 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7574837-983c-4edc-8b46-eb4798c3d7ab None admin] PATH_INFO: `/v3/projects/e693775e709146219f0efac6704e086d/users/89bae14799ab4f63a4153fe6c3ab7843/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:38.266581 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7574837-983c-4edc-8b46-eb4798c3d7ab None admin] RBAC: Authorizing `identity:create_grant(project_id=e693775e709146219f0efac6704e086d, user_id=89bae14799ab4f63a4153fe6c3ab7843, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:38.267985 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7574837-983c-4edc-8b46-eb4798c3d7ab None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:38.333087 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 605/1192] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:39:38 2022] PUT /identity/v3/projects/e693775e709146219f0efac6704e086d/users/89bae14799ab4f63a4153fe6c3ab7843/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:39:40.340848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717dd4a-e690-4184-a664-52a321b22747 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:40.341387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717dd4a-e690-4184-a664-52a321b22747 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:40.341387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717dd4a-e690-4184-a664-52a321b22747 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:40.342789 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 588/1193] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:39:40.347820 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39fd00-85b8-48d3-b5ae-ba6ebc849d43 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:40.348243 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39fd00-85b8-48d3-b5ae-ba6ebc849d43 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:40.348373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39fd00-85b8-48d3-b5ae-ba6ebc849d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:40.364914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-5e39fd00-85b8-48d3-b5ae-ba6ebc849d43 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:39:40.366024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-5e39fd00-85b8-48d3-b5ae-ba6ebc849d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:39:40.430847 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 606/1194] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:39:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:39:40.454845 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717dd4a-e690-4184-a664-52a321b22747 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:40.543282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:40.557085 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717dd4a-e690-4184-a664-52a321b22747 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:40.590643 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3bc20-f007-483d-8a66-876dfe94a0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:40.591507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3bc20-f007-483d-8a66-876dfe94a0b8 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:40.591791 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3bc20-f007-483d-8a66-876dfe94a0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:40.592063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3bc20-f007-483d-8a66-876dfe94a0b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:40.601671 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3bc20-f007-483d-8a66-876dfe94a0b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-cea3bc20-f007-483d-8a66-876dfe94a0b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:39:40.609263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:39:40.610372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:39:40.611294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:39:40.611294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:39:40.611294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:39:40.611294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:39:40.611294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:39:40.611294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:39:40.611294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:39:40.611294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:39:40.611294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:39:40.611294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:39:40.611294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:39:40.611294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:39:40.611294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 589/1195] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:39:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:39:40.616452 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39fd00-85b8-48d3-b5ae-ba6ebc849d43 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:40.665472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:40.714724 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39fd00-85b8-48d3-b5ae-ba6ebc849d43 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:40.748779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697e8cc-d3a2-491b-9ba6-cd7fd771c803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:40.749432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697e8cc-d3a2-491b-9ba6-cd7fd771c803 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:40.749717 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697e8cc-d3a2-491b-9ba6-cd7fd771c803 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:40.749996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697e8cc-d3a2-491b-9ba6-cd7fd771c803 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:40.750741 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697e8cc-d3a2-491b-9ba6-cd7fd771c803 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:39:40.751052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697e8cc-d3a2-491b-9ba6-cd7fd771c803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:40.752417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697e8cc-d3a2-491b-9ba6-cd7fd771c803 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:40.760457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 607/1196] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:39:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:40.766056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3bc20-f007-483d-8a66-876dfe94a0b8 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:40.862228 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3bc20-f007-483d-8a66-876dfe94a0b8 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:40.894806 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6b8c5-ffcf-49ae-b9bd-134c11737d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:40.895668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6b8c5-ffcf-49ae-b9bd-134c11737d17 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:40.895948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6b8c5-ffcf-49ae-b9bd-134c11737d17 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:40.896218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6b8c5-ffcf-49ae-b9bd-134c11737d17 None admin] PATH_INFO: `/v3/users/89bae14799ab4f63a4153fe6c3ab7843` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:40.897418 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6b8c5-ffcf-49ae-b9bd-134c11737d17 None admin] RBAC: Authorizing `identity:get_user(user_id=89bae14799ab4f63a4153fe6c3ab7843)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:40.898978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6b8c5-ffcf-49ae-b9bd-134c11737d17 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:40.900788 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 590/1197] 10.222.0.44 () {56 vars in 1177 bytes} [Mon Jun 27 14:39:40 2022] GET /identity/v3/users/89bae14799ab4f63a4153fe6c3ab7843 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:40.906721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697e8cc-d3a2-491b-9ba6-cd7fd771c803 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:41.004529 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697e8cc-d3a2-491b-9ba6-cd7fd771c803 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:41.016889 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:41.037042 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcf9a7-ca35-478b-92a7-75823e2d3eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:41.037677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcf9a7-ca35-478b-92a7-75823e2d3eb3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:41.037963 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcf9a7-ca35-478b-92a7-75823e2d3eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:41.038240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcf9a7-ca35-478b-92a7-75823e2d3eb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:41.104703 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcf9a7-ca35-478b-92a7-75823e2d3eb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:41.106239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcf9a7-ca35-478b-92a7-75823e2d3eb3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:41.199891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 608/1198] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:39:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 27 14:39:41.205768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6b8c5-ffcf-49ae-b9bd-134c11737d17 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:41.228933 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:41.304527 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6b8c5-ffcf-49ae-b9bd-134c11737d17 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:41.339047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b279f-18b3-43c6-a23b-1245f5dd8db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:41.339884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b279f-18b3-43c6-a23b-1245f5dd8db5 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:41.340167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b279f-18b3-43c6-a23b-1245f5dd8db5 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:41.340442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b279f-18b3-43c6-a23b-1245f5dd8db5 None admin] PATH_INFO: `/v3/projects/e693775e709146219f0efac6704e086d` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:41.341639 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b279f-18b3-43c6-a23b-1245f5dd8db5 None admin] RBAC: Authorizing `identity:get_project(project_id=e693775e709146219f0efac6704e086d)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:41.343056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b279f-18b3-43c6-a23b-1245f5dd8db5 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:41.344902 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 591/1199] 10.222.0.44 () {56 vars in 1186 bytes} [Mon Jun 27 14:39:41 2022] GET /identity/v3/projects/e693775e709146219f0efac6704e086d => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:39:41.350647 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcf9a7-ca35-478b-92a7-75823e2d3eb3 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:39:41.365005 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:41.445530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcf9a7-ca35-478b-92a7-75823e2d3eb3 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:39:41.478362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a124c83-e4d7-47fb-b602-779d1f4c8655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:39:41.478934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a124c83-e4d7-47fb-b602-779d1f4c8655 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:39:41.479213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a124c83-e4d7-47fb-b602-779d1f4c8655 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:39:41.479487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a124c83-e4d7-47fb-b602-779d1f4c8655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:39:41.480302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a124c83-e4d7-47fb-b602-779d1f4c8655 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=e693775e709146219f0efac6704e086d, user.id=89bae14799ab4f63a4153fe6c3ab7843) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:39:41.480609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a124c83-e4d7-47fb-b602-779d1f4c8655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:39:41.482037 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a124c83-e4d7-47fb-b602-779d1f4c8655 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:39:41.487583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 609/1200] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:39:41 2022] GET /identity/v3/role_assignments?user.id=89bae14799ab4f63a4153fe6c3ab7843&scope.project.id=e693775e709146219f0efac6704e086d&role.id=6036efe96c1948fb98d01c8703a0561a => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:39:51.334137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=56 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:39:51.485061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=62 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:40:54.186277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281926cd-6653-4879-ac0e-4ca624b620c3 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:54.186892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281926cd-6653-4879-ac0e-4ca624b620c3 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:54.186892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281926cd-6653-4879-ac0e-4ca624b620c3 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:54.188184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 592/1201] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:40:54.193595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1338e59-ee2b-477f-a20c-5a63d1619c0b None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:54.194087 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1338e59-ee2b-477f-a20c-5a63d1619c0b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:54.194191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1338e59-ee2b-477f-a20c-5a63d1619c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:54.210779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d1338e59-ee2b-477f-a20c-5a63d1619c0b None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:40:54.211946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d1338e59-ee2b-477f-a20c-5a63d1619c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:40:54.276853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 610/1202] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:40:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:40:54.302149 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281926cd-6653-4879-ac0e-4ca624b620c3 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:40:54.406622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281926cd-6653-4879-ac0e-4ca624b620c3 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:40:54.441794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93011a-76f1-4bd6-bc72-c95e11ae3541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:40:54.442580 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93011a-76f1-4bd6-bc72-c95e11ae3541 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:54.442861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93011a-76f1-4bd6-bc72-c95e11ae3541 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:54.443130 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93011a-76f1-4bd6-bc72-c95e11ae3541 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:54.454312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93011a-76f1-4bd6-bc72-c95e11ae3541 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:40:54.455737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93011a-76f1-4bd6-bc72-c95e11ae3541 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:40:54.473429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-7c93011a-76f1-4bd6-bc72-c95e11ae3541 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:40:54.473429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:40:54.473429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:40:54.473429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:40:54.473429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:40:54.473429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:40:54.473429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:40:54.473429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:40:54.473429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:40:54.473429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:40:54.473429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:40:54.473429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:40:54.473429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:40:54.473429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:40:54.473429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:40:54.474613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:40:54.475631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:40:54.475631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:40:54.475631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:40:54.475631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:40:54.475631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 593/1203] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:40:54.480654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1338e59-ee2b-477f-a20c-5a63d1619c0b None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:40:54.577537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1338e59-ee2b-477f-a20c-5a63d1619c0b None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:40:54.605379 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:40:54.611083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e407e3e-b615-4ebd-bbf9-5ba54ffdd4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:40:54.615373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e407e3e-b615-4ebd-bbf9-5ba54ffdd4c5 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:54.615373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e407e3e-b615-4ebd-bbf9-5ba54ffdd4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:54.615373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e407e3e-b615-4ebd-bbf9-5ba54ffdd4c5 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:54.615373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e407e3e-b615-4ebd-bbf9-5ba54ffdd4c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:40:54.615373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e407e3e-b615-4ebd-bbf9-5ba54ffdd4c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:40:54.615373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e407e3e-b615-4ebd-bbf9-5ba54ffdd4c5 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:40:54.625692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 611/1204] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:40:54.631385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93011a-76f1-4bd6-bc72-c95e11ae3541 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:40:54.682857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:40:54.727701 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93011a-76f1-4bd6-bc72-c95e11ae3541 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:40:54.759970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f9b6c-894e-4e10-b891-c9ad9d1bf5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:40:54.760626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f9b6c-894e-4e10-b891-c9ad9d1bf5e1 None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:54.760932 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f9b6c-894e-4e10-b891-c9ad9d1bf5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:54.761207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f9b6c-894e-4e10-b891-c9ad9d1bf5e1 None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:54.761897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f9b6c-894e-4e10-b891-c9ad9d1bf5e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:40:54.763889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f9b6c-894e-4e10-b891-c9ad9d1bf5e1 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:40:54.886772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 594/1205] 10.222.0.44 () {60 vars in 1132 bytes} [Mon Jun 27 14:40:54 2022] POST /identity/v3/users => generated 251 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:40:56.989753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9c056-e683-4e35-89d7-74347cceb4f7 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:56.990311 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9c056-e683-4e35-89d7-74347cceb4f7 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:56.990311 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9c056-e683-4e35-89d7-74347cceb4f7 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:56.991677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 612/1206] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:40:56.997488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d55f00-b1a8-4baf-9834-5b963a31e4b0 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:56.998154 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d55f00-b1a8-4baf-9834-5b963a31e4b0 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:56.998413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d55f00-b1a8-4baf-9834-5b963a31e4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:57.014958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b8d55f00-b1a8-4baf-9834-5b963a31e4b0 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:40:57.016140 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b8d55f00-b1a8-4baf-9834-5b963a31e4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:40:57.081989 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 595/1207] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:40:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:40:57.108018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9c056-e683-4e35-89d7-74347cceb4f7 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:40:57.207233 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9c056-e683-4e35-89d7-74347cceb4f7 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:40:57.240876 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ef281-dfc4-4115-8f8c-208adec64fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:40:57.241592 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ef281-dfc4-4115-8f8c-208adec64fe4 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:57.241875 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ef281-dfc4-4115-8f8c-208adec64fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:57.242153 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ef281-dfc4-4115-8f8c-208adec64fe4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:57.252293 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ef281-dfc4-4115-8f8c-208adec64fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-e19ef281-dfc4-4115-8f8c-208adec64fe4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:40:57.259965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:40:57.261111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:40:57.262077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:40:57.262077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:40:57.262077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:40:57.262077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:40:57.262077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:40:57.262077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:40:57.262077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:40:57.262077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:40:57.262077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:40:57.262077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:40:57.262077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:40:57.262077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:40:57.262077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 613/1208] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:40:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:40:57.267099 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d55f00-b1a8-4baf-9834-5b963a31e4b0 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:40:57.306473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:40:57.368661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d55f00-b1a8-4baf-9834-5b963a31e4b0 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:40:57.401431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53628f8d-5dbf-4717-a3b4-59bb9b19286f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:40:57.402096 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53628f8d-5dbf-4717-a3b4-59bb9b19286f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:57.402377 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53628f8d-5dbf-4717-a3b4-59bb9b19286f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:57.402685 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53628f8d-5dbf-4717-a3b4-59bb9b19286f None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:57.404087 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53628f8d-5dbf-4717-a3b4-59bb9b19286f None admin] RBAC: Adding query filter params (name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:40:57.404395 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53628f8d-5dbf-4717-a3b4-59bb9b19286f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:40:57.405842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53628f8d-5dbf-4717-a3b4-59bb9b19286f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:40:57.413613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 596/1209] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:40:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:40:57.420339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ef281-dfc4-4115-8f8c-208adec64fe4 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:40:57.472032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:40:57.521573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ef281-dfc4-4115-8f8c-208adec64fe4 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:40:57.554027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110fc7c-6cdf-45ff-8e84-594064529fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:40:57.554794 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110fc7c-6cdf-45ff-8e84-594064529fde None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:57.555073 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110fc7c-6cdf-45ff-8e84-594064529fde None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:57.555347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110fc7c-6cdf-45ff-8e84-594064529fde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:57.566367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110fc7c-6cdf-45ff-8e84-594064529fde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:40:57.567785 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110fc7c-6cdf-45ff-8e84-594064529fde None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:40:57.584842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-9110fc7c-6cdf-45ff-8e84-594064529fde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:40:57.584842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:40:57.584842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:40:57.584842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:40:57.584842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:40:57.584842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:40:57.584842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:40:57.584842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:40:57.584842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:40:57.584842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:40:57.584842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:40:57.584842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:40:57.584842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:40:57.584842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:40:57.584842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:40:57.585891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:40:57.586977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:40:57.586977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:40:57.586977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:40:57.586977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:40:57.586977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 614/1210] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:40:57.591835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53628f8d-5dbf-4717-a3b4-59bb9b19286f None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:40:57.687253 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:40:57.690106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53628f8d-5dbf-4717-a3b4-59bb9b19286f None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:40:57.723469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4ff0c-3c9b-451a-a228-d64d28a60458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:40:57.724216 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4ff0c-3c9b-451a-a228-d64d28a60458 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:57.724586 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4ff0c-3c9b-451a-a228-d64d28a60458 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:57.724903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4ff0c-3c9b-451a-a228-d64d28a60458 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:57.725630 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4ff0c-3c9b-451a-a228-d64d28a60458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:40:57.725960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4ff0c-3c9b-451a-a228-d64d28a60458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:40:57.727315 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4ff0c-3c9b-451a-a228-d64d28a60458 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:40:57.738608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 597/1211] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:40:57.744429 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110fc7c-6cdf-45ff-8e84-594064529fde None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:40:57.844508 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110fc7c-6cdf-45ff-8e84-594064529fde None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:40:57.846017 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:40:57.878522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6695ca-6d9e-46ce-8b7b-2d733a78319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:40:57.879302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6695ca-6d9e-46ce-8b7b-2d733a78319b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:57.879670 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6695ca-6d9e-46ce-8b7b-2d733a78319b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:57.879868 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6695ca-6d9e-46ce-8b7b-2d733a78319b None admin] PATH_INFO: `/v3/users/placement` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:57.886666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6695ca-6d9e-46ce-8b7b-2d733a78319b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:40:57.888243 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6695ca-6d9e-46ce-8b7b-2d733a78319b None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-eb6695ca-6d9e-46ce-8b7b-2d733a78319b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:40:57.903840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:40:57.905024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:40:57.906206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:40:57.906206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:40:57.906206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:40:57.906206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:40:57.906206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:40:57.906206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:40:57.906206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:40:57.906206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:40:57.906206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 14:40:57.906206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:40:57.906206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 615/1212] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:40:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:40:57.910914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4ff0c-3c9b-451a-a228-d64d28a60458 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:40:58.008877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4ff0c-3c9b-451a-a228-d64d28a60458 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:40:58.041326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e256b-2722-495a-a9cd-da2e23ce9e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:40:58.041982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e256b-2722-495a-a9cd-da2e23ce9e3b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:58.042266 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e256b-2722-495a-a9cd-da2e23ce9e3b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:58.042539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e256b-2722-495a-a9cd-da2e23ce9e3b None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:58.043398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e256b-2722-495a-a9cd-da2e23ce9e3b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:40:58.044328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e256b-2722-495a-a9cd-da2e23ce9e3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:40:58.045893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e256b-2722-495a-a9cd-da2e23ce9e3b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:40:58.062626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 598/1213] 10.222.0.44 () {56 vars in 1143 bytes} [Mon Jun 27 14:40:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:40:58.068416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6695ca-6d9e-46ce-8b7b-2d733a78319b None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:40:58.166592 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6695ca-6d9e-46ce-8b7b-2d733a78319b None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:40:58.199452 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502f8e9-798c-44d9-a905-026ca2bfc0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:40:58.200687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502f8e9-798c-44d9-a905-026ca2bfc0ec None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:58.200969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502f8e9-798c-44d9-a905-026ca2bfc0ec None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:58.201247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502f8e9-798c-44d9-a905-026ca2bfc0ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:58.229735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:40:58.267951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502f8e9-798c-44d9-a905-026ca2bfc0ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:40:58.269430 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502f8e9-798c-44d9-a905-026ca2bfc0ec None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:40:58.365320 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 616/1214] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:40:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:40:58.371031 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e256b-2722-495a-a9cd-da2e23ce9e3b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:40:58.390171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:40:58.470086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e256b-2722-495a-a9cd-da2e23ce9e3b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:40:58.502752 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f589dd-482b-4c42-83b2-a695e35915bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:40:58.503533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f589dd-482b-4c42-83b2-a695e35915bd None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:58.503815 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f589dd-482b-4c42-83b2-a695e35915bd None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:58.504088 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f589dd-482b-4c42-83b2-a695e35915bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:58.514439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f589dd-482b-4c42-83b2-a695e35915bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:40:58.515896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f589dd-482b-4c42-83b2-a695e35915bd None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:40:58.533680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-d5f589dd-482b-4c42-83b2-a695e35915bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:40:58.533680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:40:58.533680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:40:58.533680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:40:58.533680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:40:58.533680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:40:58.533680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:40:58.533680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:40:58.533680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:40:58.533680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:40:58.533680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:40:58.533680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:40:58.533680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:40:58.533680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:40:58.533680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:40:58.534774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:40:58.535743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:40:58.535743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:40:58.535743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:40:58.535743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:40:58.535743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 599/1215] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:40:58.540571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502f8e9-798c-44d9-a905-026ca2bfc0ec None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:40:58.600100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:40:58.638919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502f8e9-798c-44d9-a905-026ca2bfc0ec None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:40:58.671009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0978af-206e-4351-9b4e-c706c16ec1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:40:58.671661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0978af-206e-4351-9b4e-c706c16ec1de None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:58.671939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0978af-206e-4351-9b4e-c706c16ec1de None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:58.672213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0978af-206e-4351-9b4e-c706c16ec1de None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:58.672963 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0978af-206e-4351-9b4e-c706c16ec1de None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:40:58.673268 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0978af-206e-4351-9b4e-c706c16ec1de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:40:58.674620 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0978af-206e-4351-9b4e-c706c16ec1de None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:40:58.686326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 617/1216] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:40:58.691994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f589dd-482b-4c42-83b2-a695e35915bd None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:40:58.767376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:40:58.796668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f589dd-482b-4c42-83b2-a695e35915bd None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:40:58.830410 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cc64b-f70b-468e-addb-092b1b71a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:40:58.831187 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cc64b-f70b-468e-addb-092b1b71a75a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:58.831596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cc64b-f70b-468e-addb-092b1b71a75a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:58.832114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cc64b-f70b-468e-addb-092b1b71a75a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:58.839721 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33cc64b-f70b-468e-addb-092b1b71a75a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:40:58.842800 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33cc64b-f70b-468e-addb-092b1b71a75a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:40:58.856281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-d33cc64b-f70b-468e-addb-092b1b71a75a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:40:58.856281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:40:58.856281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:40:58.856281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:40:58.856281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:40:58.856281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:40:58.856281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:40:58.856281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:40:58.856281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:40:58.856281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:40:58.856281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:40:58.856281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:40:58.856281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:40:58.856281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:40:58.856281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:40:58.857371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:40:58.858504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:40:58.858504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:40:58.858504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:40:58.858504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:40:58.858504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:40:58.858504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:40:58.858504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:40:58.858504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:40:58.858504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 600/1217] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:40:58.863391 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0978af-206e-4351-9b4e-c706c16ec1de None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:40:58.962272 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0978af-206e-4351-9b4e-c706c16ec1de None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:40:58.984901 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:40:58.995999 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ac976-e65c-49c2-a8b3-213549b4fb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:40:58.997253 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ac976-e65c-49c2-a8b3-213549b4fb0a None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:58.997593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ac976-e65c-49c2-a8b3-213549b4fb0a None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:58.997871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ac976-e65c-49c2-a8b3-213549b4fb0a None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:58.998684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ac976-e65c-49c2-a8b3-213549b4fb0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:40:58.999352 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ac976-e65c-49c2-a8b3-213549b4fb0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:40:59.000787 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ac976-e65c-49c2-a8b3-213549b4fb0a None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:40:59.011798 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 618/1218] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:40:59.017901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cc64b-f70b-468e-addb-092b1b71a75a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:40:59.120516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cc64b-f70b-468e-addb-092b1b71a75a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:40:59.148538 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:40:59.154291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e026c-02e6-46b7-bd7d-402d0223ea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:40:59.154942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e026c-02e6-46b7-bd7d-402d0223ea7d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:40:59.155218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e026c-02e6-46b7-bd7d-402d0223ea7d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:40:59.155489 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e026c-02e6-46b7-bd7d-402d0223ea7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:40:59.156338 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e026c-02e6-46b7-bd7d-402d0223ea7d None admin] RBAC: Adding query filter params (role.id=81973b552fbc46a4ad31c60d8f099564, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=f3ced893407a484e8ed0c4918438edf0) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:40:59.156621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e026c-02e6-46b7-bd7d-402d0223ea7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:40:59.158122 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e026c-02e6-46b7-bd7d-402d0223ea7d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:40:59.163484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 601/1219] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:40:59 2022] GET /identity/v3/role_assignments?user.id=f3ced893407a484e8ed0c4918438edf0&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=81973b552fbc46a4ad31c60d8f099564 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:01.150030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb4f80-52c6-4682-8efe-68b1e3800b1e None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:01.150550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb4f80-52c6-4682-8efe-68b1e3800b1e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:01.150644 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb4f80-52c6-4682-8efe-68b1e3800b1e None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:01.152135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 619/1220] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:41:01.157542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac0174-6de5-4fc5-b256-696f22fa2566 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:01.158052 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac0174-6de5-4fc5-b256-696f22fa2566 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:01.158159 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac0174-6de5-4fc5-b256-696f22fa2566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:01.175208 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-1eac0174-6de5-4fc5-b256-696f22fa2566 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:41:01.176361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-1eac0174-6de5-4fc5-b256-696f22fa2566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:41:01.241960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 602/1221] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:41:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:41:01.265332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb4f80-52c6-4682-8efe-68b1e3800b1e None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:01.366602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb4f80-52c6-4682-8efe-68b1e3800b1e None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:01.400202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8a715-446f-40e0-b279-a544cc4b343f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:01.401002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8a715-446f-40e0-b279-a544cc4b343f None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:01.401280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8a715-446f-40e0-b279-a544cc4b343f None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:01.401548 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8a715-446f-40e0-b279-a544cc4b343f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:01.411945 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8a715-446f-40e0-b279-a544cc4b343f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-15e8a715-446f-40e0-b279-a544cc4b343f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:41:01.419556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:01.420706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:01.421589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:01.421589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:01.421589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:01.421589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:01.421589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:41:01.421589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:41:01.421589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:41:01.421589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:41:01.421589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:41:01.421589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:41:01.421589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:41:01.421589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:01.421589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 620/1222] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:41:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:01.427034 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac0174-6de5-4fc5-b256-696f22fa2566 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:01.523004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac0174-6de5-4fc5-b256-696f22fa2566 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:01.546257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:01.556519 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267470f-ef56-4040-81b8-2fb1de023575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:01.557230 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267470f-ef56-4040-81b8-2fb1de023575 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:01.557512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267470f-ef56-4040-81b8-2fb1de023575 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:01.557790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267470f-ef56-4040-81b8-2fb1de023575 None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:01.558537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267470f-ef56-4040-81b8-2fb1de023575 None admin] RBAC: Adding query filter params (name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:01.559397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267470f-ef56-4040-81b8-2fb1de023575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:01.561094 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267470f-ef56-4040-81b8-2fb1de023575 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:01.568832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 603/1223] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:41:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:01.575458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8a715-446f-40e0-b279-a544cc4b343f None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:01.618939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:01.673665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8a715-446f-40e0-b279-a544cc4b343f None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:01.709280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570b3d-2d71-48fb-abc3-b3699f3270d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:01.710061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570b3d-2d71-48fb-abc3-b3699f3270d5 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:01.710343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570b3d-2d71-48fb-abc3-b3699f3270d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:01.710660 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570b3d-2d71-48fb-abc3-b3699f3270d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:01.721545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570b3d-2d71-48fb-abc3-b3699f3270d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:01.722989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570b3d-2d71-48fb-abc3-b3699f3270d5 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:01.740188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-a9570b3d-2d71-48fb-abc3-b3699f3270d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:01.740188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:01.740188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:01.740188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:01.740188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:01.740188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:01.740188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:01.740188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:01.740188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:01.740188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:01.740188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:01.740188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:01.740188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:41:01.740188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:41:01.740188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:01.741323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:01.742398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:41:01.742398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:41:01.742398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:01.742398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:01.742398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 621/1224] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:01.747694 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267470f-ef56-4040-81b8-2fb1de023575 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:01.847771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267470f-ef56-4040-81b8-2fb1de023575 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:01.881644 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2992e-fb1e-4c38-88a6-39fd3bee9d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:01.882229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2992e-fb1e-4c38-88a6-39fd3bee9d7d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:01.882510 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2992e-fb1e-4c38-88a6-39fd3bee9d7d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:01.882784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2992e-fb1e-4c38-88a6-39fd3bee9d7d None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:01.883503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2992e-fb1e-4c38-88a6-39fd3bee9d7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:01.883808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2992e-fb1e-4c38-88a6-39fd3bee9d7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:01.885191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2992e-fb1e-4c38-88a6-39fd3bee9d7d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:01.897746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 604/1225] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:01.903215 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570b3d-2d71-48fb-abc3-b3699f3270d5 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:01.996093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:02.003102 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570b3d-2d71-48fb-abc3-b3699f3270d5 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:02.035943 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce945a27-f219-4367-9e2c-6fc9df9f93e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:02.036802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce945a27-f219-4367-9e2c-6fc9df9f93e1 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:02.037088 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce945a27-f219-4367-9e2c-6fc9df9f93e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:02.037364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce945a27-f219-4367-9e2c-6fc9df9f93e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:02.044902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce945a27-f219-4367-9e2c-6fc9df9f93e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:02.046330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce945a27-f219-4367-9e2c-6fc9df9f93e1 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-ce945a27-f219-4367-9e2c-6fc9df9f93e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:41:02.061330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:02.062467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:02.063580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:02.063580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:02.063580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:41:02.063580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:41:02.063580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:41:02.063580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:41:02.063580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:41:02.063580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:41:02.063580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 14:41:02.063580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:02.063580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 622/1226] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:41:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:02.068259 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2992e-fb1e-4c38-88a6-39fd3bee9d7d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:02.116501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:02.167054 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2992e-fb1e-4c38-88a6-39fd3bee9d7d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:02.200209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f1c39-27e2-4441-8c2f-e321175b45da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:02.200887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f1c39-27e2-4441-8c2f-e321175b45da None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:02.202082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f1c39-27e2-4441-8c2f-e321175b45da None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:02.202082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f1c39-27e2-4441-8c2f-e321175b45da None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:02.202311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f1c39-27e2-4441-8c2f-e321175b45da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:02.202573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f1c39-27e2-4441-8c2f-e321175b45da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:02.203965 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f1c39-27e2-4441-8c2f-e321175b45da None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:02.220262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 605/1227] 10.222.0.44 () {56 vars in 1143 bytes} [Mon Jun 27 14:41:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:02.225959 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce945a27-f219-4367-9e2c-6fc9df9f93e1 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:02.324167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce945a27-f219-4367-9e2c-6fc9df9f93e1 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:02.359443 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaca1e-62c4-4c8f-b348-d13186b1b267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:02.360222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaca1e-62c4-4c8f-b348-d13186b1b267 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:02.360503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaca1e-62c4-4c8f-b348-d13186b1b267 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:02.360805 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaca1e-62c4-4c8f-b348-d13186b1b267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:02.370889 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeaca1e-62c4-4c8f-b348-d13186b1b267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:02.372348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeaca1e-62c4-4c8f-b348-d13186b1b267 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:02.389914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-deeaca1e-62c4-4c8f-b348-d13186b1b267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:02.389914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:02.389914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:02.389914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:02.389914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:02.389914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:02.389914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:02.389914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:02.389914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:02.389914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:02.389914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:02.389914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:02.389914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:41:02.389914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:41:02.389914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:02.391012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:02.396765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:41:02.396765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:41:02.396765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:02.396765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:02.396765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 623/1228] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 14:41:02.397141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f1c39-27e2-4441-8c2f-e321175b45da None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:02.494257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f1c39-27e2-4441-8c2f-e321175b45da None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:02.496719 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:02.527237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8b5fc-257e-48c1-a985-e8ea9fb5ce8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:02.528444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8b5fc-257e-48c1-a985-e8ea9fb5ce8a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:02.528787 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8b5fc-257e-48c1-a985-e8ea9fb5ce8a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:02.529094 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8b5fc-257e-48c1-a985-e8ea9fb5ce8a None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:02.529839 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8b5fc-257e-48c1-a985-e8ea9fb5ce8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:02.530166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8b5fc-257e-48c1-a985-e8ea9fb5ce8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:02.531591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8b5fc-257e-48c1-a985-e8ea9fb5ce8a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:02.542524 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 606/1229] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:41:02.548832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaca1e-62c4-4c8f-b348-d13186b1b267 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:02.557662 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:02.647679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaca1e-62c4-4c8f-b348-d13186b1b267 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:02.681432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45367c-105b-4fbb-a104-4f749720ae96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:02.682214 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45367c-105b-4fbb-a104-4f749720ae96 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:02.682496 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45367c-105b-4fbb-a104-4f749720ae96 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:02.682771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45367c-105b-4fbb-a104-4f749720ae96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:02.689428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45367c-105b-4fbb-a104-4f749720ae96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:02.690845 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45367c-105b-4fbb-a104-4f749720ae96 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:02.705640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-7b45367c-105b-4fbb-a104-4f749720ae96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:41:02.705640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:02.705640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:02.705640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:02.705640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:02.705640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:02.705640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:02.705640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:02.705640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:02.705640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:02.705640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:02.705640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:02.705640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:41:02.705640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:41:02.705640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:02.706715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:02.712668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:41:02.712668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:41:02.712668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:41:02.712668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:41:02.712668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:41:02.712668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:41:02.712668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:41:02.712668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:02.712668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 624/1230] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:41:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:02.713382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8b5fc-257e-48c1-a985-e8ea9fb5ce8a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:02.811565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8b5fc-257e-48c1-a985-e8ea9fb5ce8a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:02.845206 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baa3e6-1a9c-4401-b3df-99735f59327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:02.845856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baa3e6-1a9c-4401-b3df-99735f59327f None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:02.846138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baa3e6-1a9c-4401-b3df-99735f59327f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:02.846412 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baa3e6-1a9c-4401-b3df-99735f59327f None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:02.847192 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13baa3e6-1a9c-4401-b3df-99735f59327f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:02.847501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13baa3e6-1a9c-4401-b3df-99735f59327f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:02.848943 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13baa3e6-1a9c-4401-b3df-99735f59327f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:02.861117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 607/1231] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:02.872762 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45367c-105b-4fbb-a104-4f749720ae96 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:02.932713 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:02.967173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45367c-105b-4fbb-a104-4f749720ae96 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:03.000210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bf506-a567-4b75-8572-b588b132c676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:03.001111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bf506-a567-4b75-8572-b588b132c676 None admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:03.001394 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bf506-a567-4b75-8572-b588b132c676 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:03.001668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bf506-a567-4b75-8572-b588b132c676 None admin] PATH_INFO: `/v3/projects/af4d24603fa24a62946a57fabb774756/users/f3ced893407a484e8ed0c4918438edf0/roles/81973b552fbc46a4ad31c60d8f099564` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:03.015964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bf506-a567-4b75-8572-b588b132c676 None admin] RBAC: Authorizing `identity:create_grant(project_id=af4d24603fa24a62946a57fabb774756, user_id=f3ced893407a484e8ed0c4918438edf0, role_id=81973b552fbc46a4ad31c60d8f099564)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:03.017417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bf506-a567-4b75-8572-b588b132c676 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:03.115089 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 625/1232] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:41:02 2022] PUT /identity/v3/projects/af4d24603fa24a62946a57fabb774756/users/f3ced893407a484e8ed0c4918438edf0/roles/81973b552fbc46a4ad31c60d8f099564 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:41:05.107140 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768ceae-1c12-469e-9eb4-0062ee29a7dd None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:05.107140 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768ceae-1c12-469e-9eb4-0062ee29a7dd None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:05.107767 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768ceae-1c12-469e-9eb4-0062ee29a7dd None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:05.108692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 608/1233] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:41:05.114038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55583fae-6a19-4016-9207-70127f23180f None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:05.114483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55583fae-6a19-4016-9207-70127f23180f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:05.114583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55583fae-6a19-4016-9207-70127f23180f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:05.132043 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-55583fae-6a19-4016-9207-70127f23180f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:41:05.133272 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-55583fae-6a19-4016-9207-70127f23180f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:41:05.198310 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 626/1234] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:41:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:41:05.221255 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768ceae-1c12-469e-9eb4-0062ee29a7dd None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:05.247309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:05.320941 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768ceae-1c12-469e-9eb4-0062ee29a7dd None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:05.355314 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed49f-eb53-4144-83e5-e27aab250466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:05.357136 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed49f-eb53-4144-83e5-e27aab250466 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:05.357394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed49f-eb53-4144-83e5-e27aab250466 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:05.357708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed49f-eb53-4144-83e5-e27aab250466 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:05.367849 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed49f-eb53-4144-83e5-e27aab250466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-21aed49f-eb53-4144-83e5-e27aab250466 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:41:05.376092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:05.377319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:05.378633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:05.378633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:05.378633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:05.378633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:05.378633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:41:05.378633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:41:05.378633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:41:05.378633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:41:05.378633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:41:05.378633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:41:05.378633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 14:41:05.378633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:41:05.378633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 609/1235] 10.222.0.44 () {56 vars in 1102 bytes} [Mon Jun 27 14:41:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:05.383138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55583fae-6a19-4016-9207-70127f23180f None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:05.430145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:05.483069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55583fae-6a19-4016-9207-70127f23180f None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:05.515339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867edb9-2a82-404f-aeb0-8f0a2531c1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:05.517367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867edb9-2a82-404f-aeb0-8f0a2531c1fc None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:05.517367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867edb9-2a82-404f-aeb0-8f0a2531c1fc None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:05.517367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867edb9-2a82-404f-aeb0-8f0a2531c1fc None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:05.517367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867edb9-2a82-404f-aeb0-8f0a2531c1fc None admin] RBAC: Adding query filter params (name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:05.517714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867edb9-2a82-404f-aeb0-8f0a2531c1fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:05.518893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867edb9-2a82-404f-aeb0-8f0a2531c1fc None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:05.526497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 627/1236] 10.222.0.44 () {56 vars in 1103 bytes} [Mon Jun 27 14:41:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:05.532819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed49f-eb53-4144-83e5-e27aab250466 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:05.616256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:05.631410 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed49f-eb53-4144-83e5-e27aab250466 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:05.664032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583e9fd-f02c-418e-9f1a-9c3ba45a0af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:05.664847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583e9fd-f02c-418e-9f1a-9c3ba45a0af2 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:05.665131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583e9fd-f02c-418e-9f1a-9c3ba45a0af2 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:05.665406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583e9fd-f02c-418e-9f1a-9c3ba45a0af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:05.675662 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583e9fd-f02c-418e-9f1a-9c3ba45a0af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:05.677126 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583e9fd-f02c-418e-9f1a-9c3ba45a0af2 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:05.694133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-4583e9fd-f02c-418e-9f1a-9c3ba45a0af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:05.694133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:05.694133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:05.694133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:05.694133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:05.694133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:05.694133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:05.694133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:05.694133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:05.694133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:05.694133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:05.694133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:05.694133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:41:05.694133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:41:05.694133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:05.695453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:05.696413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:41:05.696413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:41:05.696413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:05.696413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:41:05.696413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 610/1237] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:05.701807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867edb9-2a82-404f-aeb0-8f0a2531c1fc None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:05.802055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867edb9-2a82-404f-aeb0-8f0a2531c1fc None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:05.811190 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:05.835447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f169f0-b618-4f17-a0b6-37660f52869c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:05.836100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f169f0-b618-4f17-a0b6-37660f52869c None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:05.836378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f169f0-b618-4f17-a0b6-37660f52869c None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:05.836666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f169f0-b618-4f17-a0b6-37660f52869c None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:05.837400 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f169f0-b618-4f17-a0b6-37660f52869c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:05.837703 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f169f0-b618-4f17-a0b6-37660f52869c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:05.839045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f169f0-b618-4f17-a0b6-37660f52869c None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:05.851009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 628/1238] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:05.856851 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583e9fd-f02c-418e-9f1a-9c3ba45a0af2 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:05.957667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583e9fd-f02c-418e-9f1a-9c3ba45a0af2 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:05.991446 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba59dac-2b7a-405c-9841-3a233a467e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:05.992234 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba59dac-2b7a-405c-9841-3a233a467e73 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:05.992520 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba59dac-2b7a-405c-9841-3a233a467e73 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:05.992830 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba59dac-2b7a-405c-9841-3a233a467e73 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:05.995443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:06.000391 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba59dac-2b7a-405c-9841-3a233a467e73 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:06.005257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba59dac-2b7a-405c-9841-3a233a467e73 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-bba59dac-2b7a-405c-9841-3a233a467e73 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:41:06.017469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:06.018675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:06.019960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:06.019960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:06.019960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:41:06.019960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:41:06.019960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:41:06.019960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:41:06.019960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:41:06.019960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:41:06.019960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 14:41:06.019960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:41:06.019960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 611/1239] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:41:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:06.024421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f169f0-b618-4f17-a0b6-37660f52869c None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:06.123112 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f169f0-b618-4f17-a0b6-37660f52869c None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:06.156066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219b6d8-ed45-4378-8c6e-d321f8edaac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:06.156761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219b6d8-ed45-4378-8c6e-d321f8edaac5 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:06.157043 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219b6d8-ed45-4378-8c6e-d321f8edaac5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:06.157317 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219b6d8-ed45-4378-8c6e-d321f8edaac5 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:06.158220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219b6d8-ed45-4378-8c6e-d321f8edaac5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:06.158448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219b6d8-ed45-4378-8c6e-d321f8edaac5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:06.159851 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219b6d8-ed45-4378-8c6e-d321f8edaac5 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:06.176324 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 629/1240] 10.222.0.44 () {56 vars in 1143 bytes} [Mon Jun 27 14:41:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:41:06.182217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba59dac-2b7a-405c-9841-3a233a467e73 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:06.280811 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba59dac-2b7a-405c-9841-3a233a467e73 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:06.314091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcf27a-f428-4576-bad4-6453a8444c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:06.314721 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcf27a-f428-4576-bad4-6453a8444c3d None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:06.314999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcf27a-f428-4576-bad4-6453a8444c3d None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:06.315267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcf27a-f428-4576-bad4-6453a8444c3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:06.373677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:06.379791 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcf27a-f428-4576-bad4-6453a8444c3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:06.381312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcf27a-f428-4576-bad4-6453a8444c3d None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:06.475270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 612/1241] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:41:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:41:06.481634 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219b6d8-ed45-4378-8c6e-d321f8edaac5 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:06.509239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:06.578681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219b6d8-ed45-4378-8c6e-d321f8edaac5 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:06.611444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb162cdb-7b3a-419d-b126-dff4c79600d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:06.612217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb162cdb-7b3a-419d-b126-dff4c79600d3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:06.612497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb162cdb-7b3a-419d-b126-dff4c79600d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:06.612803 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb162cdb-7b3a-419d-b126-dff4c79600d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:06.623114 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb162cdb-7b3a-419d-b126-dff4c79600d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:06.624534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb162cdb-7b3a-419d-b126-dff4c79600d3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:06.641595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-fb162cdb-7b3a-419d-b126-dff4c79600d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:06.641595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:06.641595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:06.641595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:06.641595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:06.641595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:06.641595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:06.641595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:06.641595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:06.641595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:06.641595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:06.641595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:06.641595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:41:06.641595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:41:06.641595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:06.642697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:06.643829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:41:06.643829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:41:06.643829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:06.643829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:06.643829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 630/1242] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:06.648466 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcf27a-f428-4576-bad4-6453a8444c3d None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:06.739333 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:06.748375 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcf27a-f428-4576-bad4-6453a8444c3d None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:06.781461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51585918-1af1-48cc-8d79-da95c9322252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:06.782181 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51585918-1af1-48cc-8d79-da95c9322252 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:06.785928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51585918-1af1-48cc-8d79-da95c9322252 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:06.785928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51585918-1af1-48cc-8d79-da95c9322252 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:06.785928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51585918-1af1-48cc-8d79-da95c9322252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:06.785928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51585918-1af1-48cc-8d79-da95c9322252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:06.785928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51585918-1af1-48cc-8d79-da95c9322252 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:06.796722 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 613/1243] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:06.802436 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb162cdb-7b3a-419d-b126-dff4c79600d3 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:06.880332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:06.900499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb162cdb-7b3a-419d-b126-dff4c79600d3 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:06.934104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4ee42-18a1-4564-ae86-1ef4343f02c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:06.935203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4ee42-18a1-4564-ae86-1ef4343f02c1 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:06.935500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4ee42-18a1-4564-ae86-1ef4343f02c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:06.935781 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4ee42-18a1-4564-ae86-1ef4343f02c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:06.942406 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4ee42-18a1-4564-ae86-1ef4343f02c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:06.943842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4ee42-18a1-4564-ae86-1ef4343f02c1 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:06.957977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-bef4ee42-18a1-4564-ae86-1ef4343f02c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:41:06.957977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:06.957977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:06.957977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:06.957977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:06.957977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:06.957977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:06.957977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:06.957977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:06.957977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:06.957977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:06.957977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:06.957977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:41:06.957977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:41:06.957977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:06.959040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:06.960163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:41:06.960163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:41:06.960163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:41:06.960163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:41:06.960163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:41:06.960163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:41:06.960163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:41:06.960163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:06.960163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 631/1244] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:41:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:06.965649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51585918-1af1-48cc-8d79-da95c9322252 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:07.064573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51585918-1af1-48cc-8d79-da95c9322252 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:07.098992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c89d00-21b5-468b-be62-12b780fda391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:07.099653 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c89d00-21b5-468b-be62-12b780fda391 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:07.099936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c89d00-21b5-468b-be62-12b780fda391 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:07.100211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c89d00-21b5-468b-be62-12b780fda391 None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:07.101055 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c89d00-21b5-468b-be62-12b780fda391 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:07.101418 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c89d00-21b5-468b-be62-12b780fda391 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:07.102996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c89d00-21b5-468b-be62-12b780fda391 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:07.115106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 614/1245] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:41:07.121825 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4ee42-18a1-4564-ae86-1ef4343f02c1 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:07.221072 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4ee42-18a1-4564-ae86-1ef4343f02c1 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:07.255563 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d3c7b-f498-45e1-bdad-be59c49f11a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:07.256212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d3c7b-f498-45e1-bdad-be59c49f11a5 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:07.256495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d3c7b-f498-45e1-bdad-be59c49f11a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:07.256802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d3c7b-f498-45e1-bdad-be59c49f11a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:07.257627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d3c7b-f498-45e1-bdad-be59c49f11a5 None admin] RBAC: Adding query filter params (role.id=81973b552fbc46a4ad31c60d8f099564, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=f3ced893407a484e8ed0c4918438edf0) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:07.257938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d3c7b-f498-45e1-bdad-be59c49f11a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:07.259348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d3c7b-f498-45e1-bdad-be59c49f11a5 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:07.265420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 632/1246] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:41:07 2022] GET /identity/v3/role_assignments?user.id=f3ced893407a484e8ed0c4918438edf0&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=81973b552fbc46a4ad31c60d8f099564 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:09.341452 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e1345-1466-4e94-87c6-ce4a5069c6b1 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:09.342003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e1345-1466-4e94-87c6-ce4a5069c6b1 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:09.342003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e1345-1466-4e94-87c6-ce4a5069c6b1 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:09.343408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 615/1247] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:41:09.348572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3708786-9616-40dc-a362-1437fc88171a None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:09.349024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3708786-9616-40dc-a362-1437fc88171a None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:09.349163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3708786-9616-40dc-a362-1437fc88171a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:09.354112 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:09.367323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-f3708786-9616-40dc-a362-1437fc88171a None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:41:09.367323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f3708786-9616-40dc-a362-1437fc88171a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:41:09.433108 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 633/1248] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:41:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:41:09.458435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e1345-1466-4e94-87c6-ce4a5069c6b1 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:09.476217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:09.557588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e1345-1466-4e94-87c6-ce4a5069c6b1 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:09.590728 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13252e5-90cf-48f1-b1eb-738bb00853d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:09.591431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13252e5-90cf-48f1-b1eb-738bb00853d4 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:09.591714 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13252e5-90cf-48f1-b1eb-738bb00853d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:09.591986 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13252e5-90cf-48f1-b1eb-738bb00853d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:09.602102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13252e5-90cf-48f1-b1eb-738bb00853d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-b13252e5-90cf-48f1-b1eb-738bb00853d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:41:09.610284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:09.611476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:09.612584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:09.612584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:09.612584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:09.612584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:09.612584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:41:09.612584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:41:09.612584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:41:09.612584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:41:09.612584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:41:09.612584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:41:09.612584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:41:09.612584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:41:09.612584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 616/1249] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:41:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:09.619456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3708786-9616-40dc-a362-1437fc88171a None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:09.714097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3708786-9616-40dc-a362-1437fc88171a None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:09.743115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:09.748751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f99475-6fad-4536-9bd4-45d3ffd98931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:09.749456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f99475-6fad-4536-9bd4-45d3ffd98931 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:09.749735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f99475-6fad-4536-9bd4-45d3ffd98931 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:09.750006 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f99475-6fad-4536-9bd4-45d3ffd98931 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:09.750752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f99475-6fad-4536-9bd4-45d3ffd98931 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:09.751058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f99475-6fad-4536-9bd4-45d3ffd98931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:09.752405 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f99475-6fad-4536-9bd4-45d3ffd98931 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:09.760546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 634/1250] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:09.766334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13252e5-90cf-48f1-b1eb-738bb00853d4 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:09.845368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:09.868302 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13252e5-90cf-48f1-b1eb-738bb00853d4 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:09.900541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0edf6-17d1-4067-9642-34d3b88e239b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:09.901608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0edf6-17d1-4067-9642-34d3b88e239b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:09.902070 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0edf6-17d1-4067-9642-34d3b88e239b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:09.902908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0edf6-17d1-4067-9642-34d3b88e239b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:09.913879 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0edf6-17d1-4067-9642-34d3b88e239b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:09.915369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0edf6-17d1-4067-9642-34d3b88e239b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:09.932864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-a1f0edf6-17d1-4067-9642-34d3b88e239b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:09.932864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:09.932864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:09.932864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:09.932864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:09.932864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:09.932864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:09.932864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:09.932864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:09.932864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:09.932864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:09.932864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:09.932864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:41:09.932864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:41:09.932864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:09.936363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:09.937539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:41:09.937539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:41:09.937539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:09.937539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:41:09.937539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 617/1251] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:09.940147 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f99475-6fad-4536-9bd4-45d3ffd98931 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:10.039311 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f99475-6fad-4536-9bd4-45d3ffd98931 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:10.072442 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a19596-b29b-430e-bc4a-8fed30ea3c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:10.073139 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a19596-b29b-430e-bc4a-8fed30ea3c81 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:10.073422 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a19596-b29b-430e-bc4a-8fed30ea3c81 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:10.073696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a19596-b29b-430e-bc4a-8fed30ea3c81 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:10.074593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a19596-b29b-430e-bc4a-8fed30ea3c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:10.074904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a19596-b29b-430e-bc4a-8fed30ea3c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:10.076249 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a19596-b29b-430e-bc4a-8fed30ea3c81 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:10.089326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 635/1252] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:10.095594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0edf6-17d1-4067-9642-34d3b88e239b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:10.192417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0edf6-17d1-4067-9642-34d3b88e239b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:10.218585 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:10.225982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750acfd0-0660-41e7-95d4-a144be9cdb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:10.226759 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750acfd0-0660-41e7-95d4-a144be9cdb67 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:10.227038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750acfd0-0660-41e7-95d4-a144be9cdb67 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:10.227306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750acfd0-0660-41e7-95d4-a144be9cdb67 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:10.234565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750acfd0-0660-41e7-95d4-a144be9cdb67 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:10.235984 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750acfd0-0660-41e7-95d4-a144be9cdb67 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-750acfd0-0660-41e7-95d4-a144be9cdb67 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:41:10.249918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:10.255726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:10.256828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:10.256828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:10.256828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:41:10.256828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:41:10.256828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:41:10.256828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:41:10.256828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:41:10.256828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:41:10.256828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 14:41:10.256828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:41:10.256828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 618/1253] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:41:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:10.257464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a19596-b29b-430e-bc4a-8fed30ea3c81 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:10.313836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:10.359581 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a19596-b29b-430e-bc4a-8fed30ea3c81 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:10.391761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf57283-514f-46bb-9e94-d539f66479bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:10.392418 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf57283-514f-46bb-9e94-d539f66479bc None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:10.392723 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf57283-514f-46bb-9e94-d539f66479bc None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:10.392998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf57283-514f-46bb-9e94-d539f66479bc None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:10.393877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf57283-514f-46bb-9e94-d539f66479bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:10.394432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf57283-514f-46bb-9e94-d539f66479bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:10.396181 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf57283-514f-46bb-9e94-d539f66479bc None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:10.414892 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 636/1254] 10.222.0.44 () {56 vars in 1143 bytes} [Mon Jun 27 14:41:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:10.420831 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750acfd0-0660-41e7-95d4-a144be9cdb67 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:10.518619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750acfd0-0660-41e7-95d4-a144be9cdb67 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:10.551445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848288c6-2a87-4d96-9ab8-217f405a884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:10.552086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848288c6-2a87-4d96-9ab8-217f405a884b None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:10.552371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848288c6-2a87-4d96-9ab8-217f405a884b None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:10.552670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848288c6-2a87-4d96-9ab8-217f405a884b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:10.608410 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:10.620309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848288c6-2a87-4d96-9ab8-217f405a884b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:10.622490 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848288c6-2a87-4d96-9ab8-217f405a884b None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:10.719678 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 619/1255] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:41:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:41:10.725693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf57283-514f-46bb-9e94-d539f66479bc None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:10.823370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf57283-514f-46bb-9e94-d539f66479bc None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:10.837432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:10.857718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb2dc5-0c16-4dcd-84bf-9f10a170f43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:10.858513 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb2dc5-0c16-4dcd-84bf-9f10a170f43b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:10.858786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb2dc5-0c16-4dcd-84bf-9f10a170f43b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:10.859060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb2dc5-0c16-4dcd-84bf-9f10a170f43b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:10.868760 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb2dc5-0c16-4dcd-84bf-9f10a170f43b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:10.870190 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb2dc5-0c16-4dcd-84bf-9f10a170f43b None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:10.888117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-42eb2dc5-0c16-4dcd-84bf-9f10a170f43b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:10.888117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:10.888117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:10.888117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:10.888117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:10.888117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:10.888117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:10.888117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:10.888117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:10.888117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:10.888117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:10.888117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:10.888117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:41:10.888117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:41:10.888117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:10.892676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:10.893813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:41:10.893813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:41:10.893813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:10.893813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:10.893813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 637/1256] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:10.894937 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848288c6-2a87-4d96-9ab8-217f405a884b None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:10.979687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:10.991685 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848288c6-2a87-4d96-9ab8-217f405a884b None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:11.024357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb327d-190c-43dc-ac4e-5bf937ea030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:11.025041 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb327d-190c-43dc-ac4e-5bf937ea030c None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:11.025406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb327d-190c-43dc-ac4e-5bf937ea030c None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:11.025680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb327d-190c-43dc-ac4e-5bf937ea030c None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:11.026385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb327d-190c-43dc-ac4e-5bf937ea030c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:11.026686 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb327d-190c-43dc-ac4e-5bf937ea030c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:11.028064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb327d-190c-43dc-ac4e-5bf937ea030c None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:11.038989 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 620/1257] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:11.045634 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb2dc5-0c16-4dcd-84bf-9f10a170f43b None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:11.149388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb2dc5-0c16-4dcd-84bf-9f10a170f43b None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:11.184370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd798ae3-957e-46ae-a734-b9fc28210454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:11.185187 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd798ae3-957e-46ae-a734-b9fc28210454 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:11.185470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd798ae3-957e-46ae-a734-b9fc28210454 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:11.185742 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd798ae3-957e-46ae-a734-b9fc28210454 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:11.192460 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd798ae3-957e-46ae-a734-b9fc28210454 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:11.193957 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd798ae3-957e-46ae-a734-b9fc28210454 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:11.207692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-fd798ae3-957e-46ae-a734-b9fc28210454 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:41:11.207692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:11.207692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:11.207692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:11.207692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:11.207692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:11.207692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:11.207692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:11.207692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:11.207692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:11.207692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:11.207692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:11.207692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:41:11.207692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:41:11.207692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:11.208783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:11.210124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:41:11.210124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:41:11.210124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:41:11.210124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:41:11.210124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:41:11.210124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:41:11.210124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:41:11.210124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:11.210124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 638/1258] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:41:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:11.214790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb327d-190c-43dc-ac4e-5bf937ea030c None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:11.314955 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb327d-190c-43dc-ac4e-5bf937ea030c None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:11.348378 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b867e8-2eff-4ab6-9883-b36c57d71490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:11.349060 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b867e8-2eff-4ab6-9883-b36c57d71490 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:11.349344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b867e8-2eff-4ab6-9883-b36c57d71490 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:11.349619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b867e8-2eff-4ab6-9883-b36c57d71490 None admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:11.350399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b867e8-2eff-4ab6-9883-b36c57d71490 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:11.350709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b867e8-2eff-4ab6-9883-b36c57d71490 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:11.352139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b867e8-2eff-4ab6-9883-b36c57d71490 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:11.364853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 621/1259] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:41:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:11.371035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd798ae3-957e-46ae-a734-b9fc28210454 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:11.396210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:11.469514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd798ae3-957e-46ae-a734-b9fc28210454 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:11.502545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e0d8d-aee4-41bb-a6fd-b6323a58bb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:11.503179 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e0d8d-aee4-41bb-a6fd-b6323a58bb34 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:11.503462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e0d8d-aee4-41bb-a6fd-b6323a58bb34 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:11.503755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e0d8d-aee4-41bb-a6fd-b6323a58bb34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:11.504584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e0d8d-aee4-41bb-a6fd-b6323a58bb34 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=f3ced893407a484e8ed0c4918438edf0) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:11.504922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e0d8d-aee4-41bb-a6fd-b6323a58bb34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:11.506329 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e0d8d-aee4-41bb-a6fd-b6323a58bb34 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:11.511682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 639/1260] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:41:11 2022] GET /identity/v3/role_assignments?user.id=f3ced893407a484e8ed0c4918438edf0&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=6036efe96c1948fb98d01c8703a0561a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:13.513543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad9b07-a215-4c97-9fbf-96eee6fcaa26 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:13.514095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad9b07-a215-4c97-9fbf-96eee6fcaa26 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:13.514095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad9b07-a215-4c97-9fbf-96eee6fcaa26 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:13.515442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 622/1261] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:41:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:41:13.520668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d644e-49cd-4072-b193-034529296e14 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:13.521064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d644e-49cd-4072-b193-034529296e14 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:13.521236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d644e-49cd-4072-b193-034529296e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:13.538682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-c17d644e-49cd-4072-b193-034529296e14 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:41:13.539861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-c17d644e-49cd-4072-b193-034529296e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:41:13.607478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 640/1262] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:41:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:41:13.629999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad9b07-a215-4c97-9fbf-96eee6fcaa26 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:13.641005 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:13.731945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad9b07-a215-4c97-9fbf-96eee6fcaa26 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:13.765143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77930e0b-f552-4657-97de-859467e95e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:13.765859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930e0b-f552-4657-97de-859467e95e97 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:13.766141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930e0b-f552-4657-97de-859467e95e97 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:13.766413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930e0b-f552-4657-97de-859467e95e97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:13.776442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77930e0b-f552-4657-97de-859467e95e97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-77930e0b-f552-4657-97de-859467e95e97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:41:13.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:13.787344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:13.788431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:13.788431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:13.788431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:13.788431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:13.788431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:41:13.788431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:41:13.788431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:41:13.788431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:41:13.788431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:41:13.788431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:41:13.788431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:41:13.788431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:41:13.788431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 623/1263] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:41:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:13.791869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d644e-49cd-4072-b193-034529296e14 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:13.810279 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:13.891279 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d644e-49cd-4072-b193-034529296e14 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:13.924732 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf70d8-1592-4c71-898f-f4e1c93229a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:13.925398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf70d8-1592-4c71-898f-f4e1c93229a0 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:13.925683 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf70d8-1592-4c71-898f-f4e1c93229a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:13.925964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf70d8-1592-4c71-898f-f4e1c93229a0 None admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:13.926709 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf70d8-1592-4c71-898f-f4e1c93229a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:13.927018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf70d8-1592-4c71-898f-f4e1c93229a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:13.928378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf70d8-1592-4c71-898f-f4e1c93229a0 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:13.936565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 641/1264] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:13.942610 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77930e0b-f552-4657-97de-859467e95e97 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:14.008466 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:14.041167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77930e0b-f552-4657-97de-859467e95e97 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:14.073253 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9a733-e8b3-4e9f-a1a1-9d90482f9baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:14.074536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9a733-e8b3-4e9f-a1a1-9d90482f9baf None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:14.074822 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9a733-e8b3-4e9f-a1a1-9d90482f9baf None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:14.075098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9a733-e8b3-4e9f-a1a1-9d90482f9baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:14.086083 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9a733-e8b3-4e9f-a1a1-9d90482f9baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:14.087507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9a733-e8b3-4e9f-a1a1-9d90482f9baf None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:14.104960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-b1d9a733-e8b3-4e9f-a1a1-9d90482f9baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:14.104960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:14.104960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:14.104960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:14.104960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:14.104960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:14.104960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:14.104960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:14.104960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:14.104960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:14.104960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:14.104960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:14.104960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:41:14.104960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:41:14.104960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:14.106146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:14.107528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:41:14.107528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:41:14.107528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:14.107528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:41:14.107528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 624/1265] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:14.112260 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf70d8-1592-4c71-898f-f4e1c93229a0 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:14.192949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:14.212016 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf70d8-1592-4c71-898f-f4e1c93229a0 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:14.244474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a41a4-f74c-47df-ae15-cc203c6781d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:14.245238 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a41a4-f74c-47df-ae15-cc203c6781d6 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:14.245523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a41a4-f74c-47df-ae15-cc203c6781d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:14.245796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a41a4-f74c-47df-ae15-cc203c6781d6 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:14.246675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a41a4-f74c-47df-ae15-cc203c6781d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:14.247016 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a41a4-f74c-47df-ae15-cc203c6781d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:14.248358 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a41a4-f74c-47df-ae15-cc203c6781d6 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:14.259112 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 642/1266] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:41:14.265731 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9a733-e8b3-4e9f-a1a1-9d90482f9baf None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:14.365445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9a733-e8b3-4e9f-a1a1-9d90482f9baf None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:14.384553 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:14.398734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8111cd5-dcc6-4309-aaa2-073ee54f8070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:14.399514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8111cd5-dcc6-4309-aaa2-073ee54f8070 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:14.399793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8111cd5-dcc6-4309-aaa2-073ee54f8070 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:14.400064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8111cd5-dcc6-4309-aaa2-073ee54f8070 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:14.407425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8111cd5-dcc6-4309-aaa2-073ee54f8070 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:14.408912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8111cd5-dcc6-4309-aaa2-073ee54f8070 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-e8111cd5-dcc6-4309-aaa2-073ee54f8070 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:41:14.422807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:14.425762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:14.426925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:14.426925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:14.426925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:41:14.426925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:41:14.426925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:41:14.426925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:41:14.426925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:41:14.426925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:41:14.426925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 14:41:14.426925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:41:14.426925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 625/1267] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:41:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:14.429805 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a41a4-f74c-47df-ae15-cc203c6781d6 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:14.530584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a41a4-f74c-47df-ae15-cc203c6781d6 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:14.564840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ced3b-ec10-4803-8e66-0d8221d38334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:14.565505 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ced3b-ec10-4803-8e66-0d8221d38334 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:14.565789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ced3b-ec10-4803-8e66-0d8221d38334 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:14.566062 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ced3b-ec10-4803-8e66-0d8221d38334 None admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:14.566902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ced3b-ec10-4803-8e66-0d8221d38334 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:14.567211 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ced3b-ec10-4803-8e66-0d8221d38334 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:14.568628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ced3b-ec10-4803-8e66-0d8221d38334 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:14.578728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:14.586567 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 643/1268] 10.222.0.44 () {56 vars in 1143 bytes} [Mon Jun 27 14:41:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:14.593573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8111cd5-dcc6-4309-aaa2-073ee54f8070 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:14.694366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8111cd5-dcc6-4309-aaa2-073ee54f8070 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:14.727866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cef87-8db5-4256-9257-2a59e544875a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:14.728630 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cef87-8db5-4256-9257-2a59e544875a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:14.733233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cef87-8db5-4256-9257-2a59e544875a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:14.733233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cef87-8db5-4256-9257-2a59e544875a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:14.739606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cef87-8db5-4256-9257-2a59e544875a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:14.741163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cef87-8db5-4256-9257-2a59e544875a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:14.758235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-220cef87-8db5-4256-9257-2a59e544875a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:14.758235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:14.758235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:14.758235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:14.758235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:14.758235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:14.758235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:14.758235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:14.758235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:14.758235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:14.758235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:14.758235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:14.758235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:41:14.758235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:41:14.758235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:14.762918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:14.763827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:41:14.763827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:41:14.763827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:14.763827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:41:14.763827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 626/1269] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:14.765883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ced3b-ec10-4803-8e66-0d8221d38334 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:14.866602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ced3b-ec10-4803-8e66-0d8221d38334 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:14.899984 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6e71b-bc58-457c-b121-529610e896d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:14.900634 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e71b-bc58-457c-b121-529610e896d1 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:14.900941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e71b-bc58-457c-b121-529610e896d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:14.901215 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e71b-bc58-457c-b121-529610e896d1 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:14.901976 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6e71b-bc58-457c-b121-529610e896d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:14.902847 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6e71b-bc58-457c-b121-529610e896d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:14.904193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6e71b-bc58-457c-b121-529610e896d1 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:14.915051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 644/1270] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:14.921076 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cef87-8db5-4256-9257-2a59e544875a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:14.954219 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:15.021875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cef87-8db5-4256-9257-2a59e544875a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:15.055520 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b0380-730f-40c7-a84b-1619a42fee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:15.056307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b0380-730f-40c7-a84b-1619a42fee70 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:15.056574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b0380-730f-40c7-a84b-1619a42fee70 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:15.056875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b0380-730f-40c7-a84b-1619a42fee70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:15.063831 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b0380-730f-40c7-a84b-1619a42fee70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:15.068168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b0380-730f-40c7-a84b-1619a42fee70 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:15.079285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-ac1b0380-730f-40c7-a84b-1619a42fee70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:41:15.079285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:15.079285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:15.079285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:15.079285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:15.079285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:15.079285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:15.079285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:15.079285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:15.079285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:15.079285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:15.079285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:15.079285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:41:15.079285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:41:15.079285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:15.080146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:15.081132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:41:15.081132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:41:15.081132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:41:15.081132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:41:15.081132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:41:15.081132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:41:15.081132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:41:15.081132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:41:15.081587 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 627/1271] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:41:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:15.086383 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6e71b-bc58-457c-b121-529610e896d1 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:15.145568 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:15.189042 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6e71b-bc58-457c-b121-529610e896d1 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:15.222913 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d7383-89de-4d26-95a7-233d70ae08fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:15.223507 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d7383-89de-4d26-95a7-233d70ae08fc None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:15.223789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d7383-89de-4d26-95a7-233d70ae08fc None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:15.224061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d7383-89de-4d26-95a7-233d70ae08fc None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:15.224871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d7383-89de-4d26-95a7-233d70ae08fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:15.225186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d7383-89de-4d26-95a7-233d70ae08fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:15.226592 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d7383-89de-4d26-95a7-233d70ae08fc None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:15.238402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 645/1272] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:41:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:15.244564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b0380-730f-40c7-a84b-1619a42fee70 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:15.339875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:15.348286 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b0380-730f-40c7-a84b-1619a42fee70 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:15.381556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5734b37-f153-47e7-b5a8-8d5165dafcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:15.382424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5734b37-f153-47e7-b5a8-8d5165dafcbc None admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:15.382704 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5734b37-f153-47e7-b5a8-8d5165dafcbc None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:15.382975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5734b37-f153-47e7-b5a8-8d5165dafcbc None admin] PATH_INFO: `/v3/projects/af4d24603fa24a62946a57fabb774756/users/f3ced893407a484e8ed0c4918438edf0/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:15.384899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5734b37-f153-47e7-b5a8-8d5165dafcbc None admin] RBAC: Authorizing `identity:create_grant(project_id=af4d24603fa24a62946a57fabb774756, user_id=f3ced893407a484e8ed0c4918438edf0, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:15.386368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5734b37-f153-47e7-b5a8-8d5165dafcbc None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:15.451808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 628/1273] 10.222.0.44 () {58 vars in 1439 bytes} [Mon Jun 27 14:41:15 2022] PUT /identity/v3/projects/af4d24603fa24a62946a57fabb774756/users/f3ced893407a484e8ed0c4918438edf0/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:41:17.467927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71fc4b-9d6d-42a2-92de-382f5780651c None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:17.468485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71fc4b-9d6d-42a2-92de-382f5780651c None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:17.468485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71fc4b-9d6d-42a2-92de-382f5780651c None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:17.469866 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 646/1274] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:41:17.475075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee701ca-c63d-4a0b-93d7-58d562ac6f4f None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:17.475480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee701ca-c63d-4a0b-93d7-58d562ac6f4f None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:17.475627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee701ca-c63d-4a0b-93d7-58d562ac6f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:17.491879 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-3ee701ca-c63d-4a0b-93d7-58d562ac6f4f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:41:17.493097 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-3ee701ca-c63d-4a0b-93d7-58d562ac6f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:41:17.559068 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 629/1275] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:41:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:41:17.583729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71fc4b-9d6d-42a2-92de-382f5780651c None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:17.685455 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71fc4b-9d6d-42a2-92de-382f5780651c None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:17.702915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:17.719129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3da46-d94e-4ad6-8e2e-9f2fa067b21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:17.719816 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3da46-d94e-4ad6-8e2e-9f2fa067b21e None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:17.720100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3da46-d94e-4ad6-8e2e-9f2fa067b21e None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:17.720377 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3da46-d94e-4ad6-8e2e-9f2fa067b21e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:17.731277 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3da46-d94e-4ad6-8e2e-9f2fa067b21e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-dab3da46-d94e-4ad6-8e2e-9f2fa067b21e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 14:41:17.739035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:17.740203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:17.741492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:17.741492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:17.741492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:17.741492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:17.741492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 14:41:17.741492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 14:41:17.741492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 14:41:17.741492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 14:41:17.741492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 14:41:17.741492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 14:41:17.741492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 14:41:17.741492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:17.741492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 647/1276] 10.222.0.44 () {56 vars in 1096 bytes} [Mon Jun 27 14:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:17.747153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee701ca-c63d-4a0b-93d7-58d562ac6f4f None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:17.829628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:17.847034 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee701ca-c63d-4a0b-93d7-58d562ac6f4f None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:17.879968 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16070178-a61a-4ead-b5ae-633f0d8da28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:17.880634 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16070178-a61a-4ead-b5ae-633f0d8da28a None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:17.880964 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16070178-a61a-4ead-b5ae-633f0d8da28a None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:17.881239 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16070178-a61a-4ead-b5ae-633f0d8da28a None admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:17.881990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16070178-a61a-4ead-b5ae-633f0d8da28a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:17.882298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16070178-a61a-4ead-b5ae-633f0d8da28a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:17.883662 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16070178-a61a-4ead-b5ae-633f0d8da28a None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:17.892233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 630/1277] 10.222.0.44 () {56 vars in 1099 bytes} [Mon Jun 27 14:41:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:17.898179 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3da46-d94e-4ad6-8e2e-9f2fa067b21e None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:17.999191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3da46-d94e-4ad6-8e2e-9f2fa067b21e None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:18.031330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50968d0-47ea-46f9-b562-8f1cbd19c005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:18.032132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50968d0-47ea-46f9-b562-8f1cbd19c005 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:18.032382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50968d0-47ea-46f9-b562-8f1cbd19c005 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:18.032678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50968d0-47ea-46f9-b562-8f1cbd19c005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:18.043388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50968d0-47ea-46f9-b562-8f1cbd19c005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:18.044834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50968d0-47ea-46f9-b562-8f1cbd19c005 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:18.061822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-a50968d0-47ea-46f9-b562-8f1cbd19c005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:18.061822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:18.061822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:18.061822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:18.061822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:18.061822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:18.061822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:18.061822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:18.061822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:18.061822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:18.061822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:18.061822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:18.061822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:41:18.061822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:41:18.061822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:18.062912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:18.064021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:41:18.064021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:41:18.064021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:18.064021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:18.064021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 648/1278] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:18.068728 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16070178-a61a-4ead-b5ae-633f0d8da28a None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:18.171135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16070178-a61a-4ead-b5ae-633f0d8da28a None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:18.203790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef7607-24b6-4629-8b11-4d13420691d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:18.204457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7607-24b6-4629-8b11-4d13420691d7 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:18.204849 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7607-24b6-4629-8b11-4d13420691d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:18.205023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef7607-24b6-4629-8b11-4d13420691d7 None admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:18.205734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef7607-24b6-4629-8b11-4d13420691d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:18.206035 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef7607-24b6-4629-8b11-4d13420691d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:18.207375 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef7607-24b6-4629-8b11-4d13420691d7 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:18.219234 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 631/1279] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:18.225036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50968d0-47ea-46f9-b562-8f1cbd19c005 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:18.256666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:18.324308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50968d0-47ea-46f9-b562-8f1cbd19c005 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:18.359276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2d783-3a27-4c93-8525-ffc549314337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:18.360118 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2d783-3a27-4c93-8525-ffc549314337 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:18.360404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2d783-3a27-4c93-8525-ffc549314337 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:18.360708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2d783-3a27-4c93-8525-ffc549314337 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:18.367653 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2d783-3a27-4c93-8525-ffc549314337 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:18.369170 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2d783-3a27-4c93-8525-ffc549314337 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-2cd2d783-3a27-4c93-8525-ffc549314337 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 14:41:18.383586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:18.388579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:18.389873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:18.389873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:18.389873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 14:41:18.389873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 14:41:18.389873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 14:41:18.389873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 14:41:18.389873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 14:41:18.389873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 14:41:18.389873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 14:41:18.389873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:18.389873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 649/1280] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:41:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:18.390643 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef7607-24b6-4629-8b11-4d13420691d7 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:18.394197 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:18.487872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef7607-24b6-4629-8b11-4d13420691d7 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:18.521300 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8aeb74-99ce-4c52-bb2e-749c070b39ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:18.521900 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8aeb74-99ce-4c52-bb2e-749c070b39ae None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:18.522183 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8aeb74-99ce-4c52-bb2e-749c070b39ae None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:18.522457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8aeb74-99ce-4c52-bb2e-749c070b39ae None admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:18.523292 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8aeb74-99ce-4c52-bb2e-749c070b39ae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:18.523601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8aeb74-99ce-4c52-bb2e-749c070b39ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:18.525047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8aeb74-99ce-4c52-bb2e-749c070b39ae None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:18.543062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 632/1281] 10.222.0.44 () {56 vars in 1143 bytes} [Mon Jun 27 14:41:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:18.548709 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2d783-3a27-4c93-8525-ffc549314337 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:18.639502 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:18.648527 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2d783-3a27-4c93-8525-ffc549314337 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:18.682268 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35706033-f521-4e2e-b196-d13c843cd401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:18.682910 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35706033-f521-4e2e-b196-d13c843cd401 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:18.683289 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35706033-f521-4e2e-b196-d13c843cd401 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:18.683800 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35706033-f521-4e2e-b196-d13c843cd401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:18.750839 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35706033-f521-4e2e-b196-d13c843cd401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:18.752274 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35706033-f521-4e2e-b196-d13c843cd401 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:18.840069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:18.850091 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 650/1282] 10.222.0.44 () {58 vars in 1282 bytes} [Mon Jun 27 14:41:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 14:41:18.855923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8aeb74-99ce-4c52-bb2e-749c070b39ae None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:18.916850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:18.954693 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8aeb74-99ce-4c52-bb2e-749c070b39ae None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:18.986956 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488f260-155f-4d9c-ac5e-c81ceb68dfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:18.987763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488f260-155f-4d9c-ac5e-c81ceb68dfd7 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:18.988046 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488f260-155f-4d9c-ac5e-c81ceb68dfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:18.988321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488f260-155f-4d9c-ac5e-c81ceb68dfd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:18.998590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488f260-155f-4d9c-ac5e-c81ceb68dfd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:19.000019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488f260-155f-4d9c-ac5e-c81ceb68dfd7 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:19.017590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-7488f260-155f-4d9c-ac5e-c81ceb68dfd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:19.017590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:19.017590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:19.017590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:19.017590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:19.017590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:19.017590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:19.017590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:19.017590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:19.017590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:19.017590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:19.017590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:19.017590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 14:41:19.017590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 14:41:19.017590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:19.018802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:19.019948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 14:41:19.019948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 14:41:19.019948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 14:41:19.019948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:41:19.019948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 633/1283] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:19.024633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35706033-f521-4e2e-b196-d13c843cd401 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:19.122729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35706033-f521-4e2e-b196-d13c843cd401 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:19.157005 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490ba15-f97a-48da-90af-754c317f2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:19.157691 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490ba15-f97a-48da-90af-754c317f2da6 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:19.157977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490ba15-f97a-48da-90af-754c317f2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:19.158256 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490ba15-f97a-48da-90af-754c317f2da6 None admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:19.158973 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490ba15-f97a-48da-90af-754c317f2da6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:19.159282 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490ba15-f97a-48da-90af-754c317f2da6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:19.160635 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490ba15-f97a-48da-90af-754c317f2da6 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:19.172261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 651/1284] 10.222.0.44 () {56 vars in 1109 bytes} [Mon Jun 27 14:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:19.177978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488f260-155f-4d9c-ac5e-c81ceb68dfd7 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:19.277868 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488f260-155f-4d9c-ac5e-c81ceb68dfd7 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:19.291384 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:19.310870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697e7c1-9ac3-42f4-b055-30d7bfdf4d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:19.311677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697e7c1-9ac3-42f4-b055-30d7bfdf4d45 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:19.311958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697e7c1-9ac3-42f4-b055-30d7bfdf4d45 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:19.312256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697e7c1-9ac3-42f4-b055-30d7bfdf4d45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:19.318801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697e7c1-9ac3-42f4-b055-30d7bfdf4d45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:19.321423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697e7c1-9ac3-42f4-b055-30d7bfdf4d45 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:19.334918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application [None req-c697e7c1-9ac3-42f4-b055-30d7bfdf4d45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:41:19.334918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:19.334918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:19.334918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:19.334918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:19.334918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:19.334918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:19.334918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:19.334918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:19.334918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:19.334918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:19.334918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:19.334918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 14:41:19.334918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 14:41:19.334918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:19.337249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:19.338435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 14:41:19.338435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 14:41:19.338435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 14:41:19.338435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 14:41:19.338435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 14:41:19.338435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 14:41:19.338435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 14:41:19.338435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: ERROR keystone.server.flask.application Jun 27 14:41:19.338435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 634/1285] 10.222.0.44 () {56 vars in 1111 bytes} [Mon Jun 27 14:41:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:19.342697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490ba15-f97a-48da-90af-754c317f2da6 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:19.393420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:19.447703 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490ba15-f97a-48da-90af-754c317f2da6 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:19.482326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f27bb5-452f-4613-9e75-bf3e878ee0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:19.483003 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f27bb5-452f-4613-9e75-bf3e878ee0a0 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:19.483285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f27bb5-452f-4613-9e75-bf3e878ee0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:19.483613 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f27bb5-452f-4613-9e75-bf3e878ee0a0 None admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:19.484399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f27bb5-452f-4613-9e75-bf3e878ee0a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:19.484747 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f27bb5-452f-4613-9e75-bf3e878ee0a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:19.489067 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f27bb5-452f-4613-9e75-bf3e878ee0a0 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:19.498118 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 652/1286] 10.222.0.44 () {56 vars in 1148 bytes} [Mon Jun 27 14:41:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:19.504358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697e7c1-9ac3-42f4-b055-30d7bfdf4d45 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:19.607815 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697e7c1-9ac3-42f4-b055-30d7bfdf4d45 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:19.644586 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960656f-2305-4777-a4fa-17f079204674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:19.645198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960656f-2305-4777-a4fa-17f079204674 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:19.645482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960656f-2305-4777-a4fa-17f079204674 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:19.645759 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960656f-2305-4777-a4fa-17f079204674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:19.647201 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960656f-2305-4777-a4fa-17f079204674 None admin] RBAC: Adding query filter params (role.id=6036efe96c1948fb98d01c8703a0561a, scope.project.id=af4d24603fa24a62946a57fabb774756, user.id=f3ced893407a484e8ed0c4918438edf0) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:19.647733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960656f-2305-4777-a4fa-17f079204674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:19.649529 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960656f-2305-4777-a4fa-17f079204674 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:19.657769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 635/1287] 10.222.0.44 () {56 vars in 1374 bytes} [Mon Jun 27 14:41:19 2022] GET /identity/v3/role_assignments?user.id=f3ced893407a484e8ed0c4918438edf0&scope.project.id=af4d24603fa24a62946a57fabb774756&role.id=6036efe96c1948fb98d01c8703a0561a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:21.799796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c494a22-3a9d-44e9-b80d-6a60160fc0c4 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:21.800359 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c494a22-3a9d-44e9-b80d-6a60160fc0c4 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:21.800359 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c494a22-3a9d-44e9-b80d-6a60160fc0c4 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:21.801727 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 653/1288] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:41:21.806934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108f402-22d2-4f52-85de-95742e030a32 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:21.807362 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108f402-22d2-4f52-85de-95742e030a32 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:21.807481 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108f402-22d2-4f52-85de-95742e030a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:21.825344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-7108f402-22d2-4f52-85de-95742e030a32 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:41:21.826505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7108f402-22d2-4f52-85de-95742e030a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:41:21.854577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:21.890274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 636/1289] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:41:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:41:21.912699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c494a22-3a9d-44e9-b80d-6a60160fc0c4 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:22.013872 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c494a22-3a9d-44e9-b80d-6a60160fc0c4 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:22.024278 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:22.047595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a0ff8-5700-418b-8db4-abd5b05a0970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:22.048371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a0ff8-5700-418b-8db4-abd5b05a0970 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:22.048667 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a0ff8-5700-418b-8db4-abd5b05a0970 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:22.049023 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a0ff8-5700-418b-8db4-abd5b05a0970 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:22.049662 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a0ff8-5700-418b-8db4-abd5b05a0970 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:22.051113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a0ff8-5700-418b-8db4-abd5b05a0970 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-d72a0ff8-5700-418b-8db4-abd5b05a0970 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:22.062843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:22.064103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:22.065217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:22.065217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:22.065217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:22.065217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:22.065217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:22.065217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:22.065217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:22.065217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:22.065217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:22.065217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:22.065217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:41:22.065217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:41:22.065217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 14:41:22.065217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:22.065217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 654/1290] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Jun 27 14:41:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:22.070428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108f402-22d2-4f52-85de-95742e030a32 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:22.171716 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108f402-22d2-4f52-85de-95742e030a32 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:22.204526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b4217-0286-40a2-9ac4-008f1a742d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:22.205199 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b4217-0286-40a2-9ac4-008f1a742d64 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:22.205477 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b4217-0286-40a2-9ac4-008f1a742d64 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:22.205750 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b4217-0286-40a2-9ac4-008f1a742d64 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:22.206481 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b4217-0286-40a2-9ac4-008f1a742d64 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:22.206780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b4217-0286-40a2-9ac4-008f1a742d64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:22.208121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b4217-0286-40a2-9ac4-008f1a742d64 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:22.212897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 637/1291] 10.222.0.44 () {56 vars in 1116 bytes} [Mon Jun 27 14:41:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:22.219537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a0ff8-5700-418b-8db4-abd5b05a0970 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:22.323197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a0ff8-5700-418b-8db4-abd5b05a0970 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:22.356855 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0b3bf-f5c9-40cd-97cb-704726d48f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:22.357503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0b3bf-f5c9-40cd-97cb-704726d48f8b None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:22.357783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0b3bf-f5c9-40cd-97cb-704726d48f8b None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:22.358066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0b3bf-f5c9-40cd-97cb-704726d48f8b None admin] PATH_INFO: `/v3/services` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:22.358760 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0b3bf-f5c9-40cd-97cb-704726d48f8b None admin] RBAC: Adding query filter params (type=placement) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:22.359062 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0b3bf-f5c9-40cd-97cb-704726d48f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:22.360404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0b3bf-f5c9-40cd-97cb-704726d48f8b None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:22.364817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 655/1292] 10.222.0.44 () {56 vars in 1116 bytes} [Mon Jun 27 14:41:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:41:24.423099 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e6aea-8471-4721-a25f-84eb03cfa6b3 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:24.423674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e6aea-8471-4721-a25f-84eb03cfa6b3 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:24.423770 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e6aea-8471-4721-a25f-84eb03cfa6b3 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:24.425115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 638/1293] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:41:24.430262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a855979-e76b-4147-bf05-1c1593e52780 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:24.430692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a855979-e76b-4147-bf05-1c1593e52780 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:24.430818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a855979-e76b-4147-bf05-1c1593e52780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:24.447776 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-8a855979-e76b-4147-bf05-1c1593e52780 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:41:24.450811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-8a855979-e76b-4147-bf05-1c1593e52780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:41:24.478195 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:24.514090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 656/1294] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:41:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:41:24.536457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e6aea-8471-4721-a25f-84eb03cfa6b3 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:24.568056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:24.637062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e6aea-8471-4721-a25f-84eb03cfa6b3 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:24.670432 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a35346-2a5b-4302-95e3-e8876190ca5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:24.671170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a35346-2a5b-4302-95e3-e8876190ca5f None admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:24.671455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a35346-2a5b-4302-95e3-e8876190ca5f None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:24.671794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a35346-2a5b-4302-95e3-e8876190ca5f None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:24.672522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a35346-2a5b-4302-95e3-e8876190ca5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:24.674022 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a35346-2a5b-4302-95e3-e8876190ca5f None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:24.766352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 639/1295] 10.222.0.44 () {60 vars in 1141 bytes} [Mon Jun 27 14:41:24 2022] POST /identity/v3/services => generated 246 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:41:26.804261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0194-987c-4c07-8c23-f53de816ee57 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:26.804851 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0194-987c-4c07-8c23-f53de816ee57 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:26.804851 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0194-987c-4c07-8c23-f53de816ee57 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:26.806255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 657/1296] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:41:26.812427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a9a7f-6b7c-442b-b7da-5a9b6ec55be0 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:26.812898 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a9a7f-6b7c-442b-b7da-5a9b6ec55be0 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:26.813033 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a9a7f-6b7c-442b-b7da-5a9b6ec55be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:26.831058 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-100a9a7f-6b7c-442b-b7da-5a9b6ec55be0 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:41:26.832403 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-100a9a7f-6b7c-442b-b7da-5a9b6ec55be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:41:26.906594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 640/1297] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:41:26 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:41:26.930429 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0194-987c-4c07-8c23-f53de816ee57 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:27.030185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0194-987c-4c07-8c23-f53de816ee57 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:27.065106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf48d7-07bb-48c1-98e4-1b5a7f1d65e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:27.065906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf48d7-07bb-48c1-98e4-1b5a7f1d65e3 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:27.066191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf48d7-07bb-48c1-98e4-1b5a7f1d65e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:27.066469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf48d7-07bb-48c1-98e4-1b5a7f1d65e3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:27.067119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf48d7-07bb-48c1-98e4-1b5a7f1d65e3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:27.068469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf48d7-07bb-48c1-98e4-1b5a7f1d65e3 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-d9bf48d7-07bb-48c1-98e4-1b5a7f1d65e3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:27.081007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:27.082932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:27.083918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:27.083918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:27.083918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:27.083918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:27.083918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:27.083918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:27.083918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:27.083918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:27.083918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:27.083918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:27.083918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:41:27.083918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:41:27.083918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 14:41:27.083918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:27.083918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 658/1298] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Jun 27 14:41:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:27.088535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a9a7f-6b7c-442b-b7da-5a9b6ec55be0 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:27.107198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:27.186407 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a9a7f-6b7c-442b-b7da-5a9b6ec55be0 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:27.219350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac15ad-4ce2-4c3a-bcbe-11db96340bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:27.219999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac15ad-4ce2-4c3a-bcbe-11db96340bf3 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:27.220280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac15ad-4ce2-4c3a-bcbe-11db96340bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:27.220571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac15ad-4ce2-4c3a-bcbe-11db96340bf3 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:27.221295 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac15ad-4ce2-4c3a-bcbe-11db96340bf3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:27.221601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac15ad-4ce2-4c3a-bcbe-11db96340bf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:27.222940 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac15ad-4ce2-4c3a-bcbe-11db96340bf3 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:27.227964 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 641/1299] 10.222.0.44 () {56 vars in 1116 bytes} [Mon Jun 27 14:41:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:27.233864 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf48d7-07bb-48c1-98e4-1b5a7f1d65e3 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:27.266011 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:27.332314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf48d7-07bb-48c1-98e4-1b5a7f1d65e3 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:27.364973 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf8c01-e11e-4039-8dbc-0e53d0145818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:27.365719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf8c01-e11e-4039-8dbc-0e53d0145818 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:27.366000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf8c01-e11e-4039-8dbc-0e53d0145818 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:27.366275 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf8c01-e11e-4039-8dbc-0e53d0145818 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:27.367060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf8c01-e11e-4039-8dbc-0e53d0145818 None admin] RBAC: Adding query filter params (interface=public, service_id=3f5200b8ecaa4946ad7fa12bbf02fb84, region_id=RegionOne) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:27.367364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf8c01-e11e-4039-8dbc-0e53d0145818 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:27.368725 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf8c01-e11e-4039-8dbc-0e53d0145818 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:27.374208 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 659/1300] 10.222.0.44 () {56 vars in 1251 bytes} [Mon Jun 27 14:41:27 2022] GET /identity/v3/endpoints?service_id=3f5200b8ecaa4946ad7fa12bbf02fb84&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:27.379825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac15ad-4ce2-4c3a-bcbe-11db96340bf3 None admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:27.460458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:27.477562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac15ad-4ce2-4c3a-bcbe-11db96340bf3 None admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:27.511387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fde321-b666-4b7f-905f-18ac801d9e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:27.512029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde321-b666-4b7f-905f-18ac801d9e18 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:27.512307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde321-b666-4b7f-905f-18ac801d9e18 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:27.512577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde321-b666-4b7f-905f-18ac801d9e18 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:27.513310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fde321-b666-4b7f-905f-18ac801d9e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:27.514650 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fde321-b666-4b7f-905f-18ac801d9e18 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:27.521297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 642/1301] 10.222.0.44 () {56 vars in 1087 bytes} [Mon Jun 27 14:41:27 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:41:29.574871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd164f1-0e7a-4c36-bce8-1fd41ae6d72d None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:29.575408 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd164f1-0e7a-4c36-bce8-1fd41ae6d72d None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:29.575408 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd164f1-0e7a-4c36-bce8-1fd41ae6d72d None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:29.576816 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 660/1302] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:41:29.582144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106be1e-7b73-4d29-bec3-12a9303e80b1 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:29.582554 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106be1e-7b73-4d29-bec3-12a9303e80b1 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:29.582729 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106be1e-7b73-4d29-bec3-12a9303e80b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:29.599705 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-6106be1e-7b73-4d29-bec3-12a9303e80b1 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:41:29.600921 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6106be1e-7b73-4d29-bec3-12a9303e80b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:41:29.666157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 643/1303] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:41:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 14:41:29.690118 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd164f1-0e7a-4c36-bce8-1fd41ae6d72d None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:29.785100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:29.791560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd164f1-0e7a-4c36-bce8-1fd41ae6d72d None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:29.824449 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4952ca5-f4b2-48d5-8a27-48d15675b724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:29.825313 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4952ca5-f4b2-48d5-8a27-48d15675b724 None admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:29.825540 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4952ca5-f4b2-48d5-8a27-48d15675b724 None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:29.825813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4952ca5-f4b2-48d5-8a27-48d15675b724 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:29.826456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4952ca5-f4b2-48d5-8a27-48d15675b724 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:29.827799 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4952ca5-f4b2-48d5-8a27-48d15675b724 None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application [None req-f4952ca5-f4b2-48d5-8a27-48d15675b724 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 14:41:29.839993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 14:41:29.841457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 14:41:29.842614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 14:41:29.842614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application with Lock( Jun 27 14:41:29.842614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 14:41:29.842614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self._enter() Jun 27 14:41:29.842614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 14:41:29.842614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 14:41:29.842614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 14:41:29.842614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application return self.creator() Jun 27 14:41:29.842614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 14:41:29.842614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application created_value = creator( Jun 27 14:41:29.842614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 14:41:29.842614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 14:41:29.842614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 14:41:29.842614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: ERROR keystone.server.flask.application Jun 27 14:41:29.842614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 661/1304] 10.222.0.44 () {56 vars in 1117 bytes} [Mon Jun 27 14:41:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 14:41:29.847149 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106be1e-7b73-4d29-bec3-12a9303e80b1 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:29.921211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:29.942764 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106be1e-7b73-4d29-bec3-12a9303e80b1 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:29.976616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec38c47-35f1-4cfc-a4f5-ae6cbd234ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:29.977288 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec38c47-35f1-4cfc-a4f5-ae6cbd234ab4 None admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:29.977566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec38c47-35f1-4cfc-a4f5-ae6cbd234ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:29.977837 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec38c47-35f1-4cfc-a4f5-ae6cbd234ab4 None admin] PATH_INFO: `/v3/services` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:29.978537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec38c47-35f1-4cfc-a4f5-ae6cbd234ab4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:41:29.978837 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec38c47-35f1-4cfc-a4f5-ae6cbd234ab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:29.980271 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec38c47-35f1-4cfc-a4f5-ae6cbd234ab4 None admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:29.985377 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 644/1305] 10.222.0.44 () {56 vars in 1116 bytes} [Mon Jun 27 14:41:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:41:29.991171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4952ca5-f4b2-48d5-8a27-48d15675b724 None admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:41:30.091123 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4952ca5-f4b2-48d5-8a27-48d15675b724 None admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:41:30.124417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352d326-e2f3-4558-8bde-e5cca2228c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:41:30.125101 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352d326-e2f3-4558-8bde-e5cca2228c6a None admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:41:30.125388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352d326-e2f3-4558-8bde-e5cca2228c6a None admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:41:30.125666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352d326-e2f3-4558-8bde-e5cca2228c6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:41:30.126396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352d326-e2f3-4558-8bde-e5cca2228c6a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:41:30.127765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352d326-e2f3-4558-8bde-e5cca2228c6a None admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:41:30.226631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 662/1306] 10.222.0.44 () {60 vars in 1144 bytes} [Mon Jun 27 14:41:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:41:39.982322 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=30 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:41:40.222103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:31.002754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf0cf-e0d1-4306-bce6-71c7b4ed3d3a None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:31.003361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf0cf-e0d1-4306-bce6-71c7b4ed3d3a None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:31.003361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf0cf-e0d1-4306-bce6-71c7b4ed3d3a None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:31.011251 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737002f-2408-438b-9d89-9ffd26880404 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:31.011660 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737002f-2408-438b-9d89-9ffd26880404 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:31.012085 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737002f-2408-438b-9d89-9ffd26880404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:31.017155 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 645/1307] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:47:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:47:31.114492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-9737002f-2408-438b-9d89-9ffd26880404 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:47:31.115706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9737002f-2408-438b-9d89-9ffd26880404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:31.245240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 663/1308] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:47:31.281405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20791c74-7c4b-46da-bb4b-c7250f796576 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:31.282037 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20791c74-7c4b-46da-bb4b-c7250f796576 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:31.282520 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20791c74-7c4b-46da-bb4b-c7250f796576 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:31.285044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 646/1309] 10.222.0.44 () {54 vars in 964 bytes} [Mon Jun 27 14:47:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:47:31.292218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ef133-090e-4e56-a0b6-9e94bbf3fc37 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:31.292537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ef133-090e-4e56-a0b6-9e94bbf3fc37 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:31.299373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ef133-090e-4e56-a0b6-9e94bbf3fc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:31.431914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-365ef133-090e-4e56-a0b6-9e94bbf3fc37 None None] MFA Rules not processed for user `bdf31d7d8c164809bde0e12b71ecfca0`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:47:31.433444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-365ef133-090e-4e56-a0b6-9e94bbf3fc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:31.480267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:31.598298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 664/1310] 10.222.0.44 () {58 vars in 1061 bytes} [Mon Jun 27 14:47:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:47:31.607327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20791c74-7c4b-46da-bb4b-c7250f796576 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:47:31.609095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-20791c74-7c4b-46da-bb4b-c7250f796576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:31.727313 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20791c74-7c4b-46da-bb4b-c7250f796576 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:47:31.806568 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794876c2-cbbf-4986-a84d-431c5f66a560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:47:31.807136 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794876c2-cbbf-4986-a84d-431c5f66a560 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:31.807416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794876c2-cbbf-4986-a84d-431c5f66a560 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:31.807685 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794876c2-cbbf-4986-a84d-431c5f66a560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:31.809383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-794876c2-cbbf-4986-a84d-431c5f66a560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:31.867282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:31.930721 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794876c2-cbbf-4986-a84d-431c5f66a560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:47:31.932204 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794876c2-cbbf-4986-a84d-431c5f66a560 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:47:31.956599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 647/1311] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:47:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:47:34.260491 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596138e4-f696-481a-9cdb-bb22c7827248 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:34.261071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596138e4-f696-481a-9cdb-bb22c7827248 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:34.261071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596138e4-f696-481a-9cdb-bb22c7827248 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:34.262662 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 665/1312] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:47:34.268929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a5221-50db-4672-8daa-944a333bc853 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:34.269453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a5221-50db-4672-8daa-944a333bc853 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:34.269453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a5221-50db-4672-8daa-944a333bc853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:34.346268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-7a4a5221-50db-4672-8daa-944a333bc853 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:47:34.347538 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7a4a5221-50db-4672-8daa-944a333bc853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:34.447692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 648/1313] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:47:34.486770 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596138e4-f696-481a-9cdb-bb22c7827248 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:47:34.488300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-596138e4-f696-481a-9cdb-bb22c7827248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:34.594328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596138e4-f696-481a-9cdb-bb22c7827248 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:47:34.668974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:34.671401 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d5cdf-b7cd-4d75-b380-554cc128a2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:47:34.672040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d5cdf-b7cd-4d75-b380-554cc128a2da service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:34.672320 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d5cdf-b7cd-4d75-b380-554cc128a2da service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:34.672594 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d5cdf-b7cd-4d75-b380-554cc128a2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:34.674288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-5c3d5cdf-b7cd-4d75-b380-554cc128a2da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:34.781290 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d5cdf-b7cd-4d75-b380-554cc128a2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:47:34.782715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d5cdf-b7cd-4d75-b380-554cc128a2da service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:47:34.800475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 666/1314] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:47:37.331748 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69329e2a-2ec4-4309-91c0-a9566391bb63 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:37.332325 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69329e2a-2ec4-4309-91c0-a9566391bb63 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:37.332325 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69329e2a-2ec4-4309-91c0-a9566391bb63 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:37.333771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 649/1315] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:47:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:47:37.339047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3c22-fcbd-4112-b827-81e935cf549b None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:37.339477 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3c22-fcbd-4112-b827-81e935cf549b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:37.339602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3c22-fcbd-4112-b827-81e935cf549b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:37.406482 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-40ed3c22-fcbd-4112-b827-81e935cf549b None None] MFA Rules not processed for user `6b3f273238ff429fb6fd5818edbed0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:47:37.407688 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-40ed3c22-fcbd-4112-b827-81e935cf549b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:37.460728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:37.506357 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 667/1316] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:47:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:47:37.545276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69329e2a-2ec4-4309-91c0-a9566391bb63 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:47:37.546843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-69329e2a-2ec4-4309-91c0-a9566391bb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:37.557228 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:37.654812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69329e2a-2ec4-4309-91c0-a9566391bb63 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:47:37.726564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31803f1c-fcb8-4a48-a348-7e7bca5f5406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:47:37.727200 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31803f1c-fcb8-4a48-a348-7e7bca5f5406 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:37.727478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31803f1c-fcb8-4a48-a348-7e7bca5f5406 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:37.727748 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31803f1c-fcb8-4a48-a348-7e7bca5f5406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:37.729428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-31803f1c-fcb8-4a48-a348-7e7bca5f5406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:37.790039 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:37.835632 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31803f1c-fcb8-4a48-a348-7e7bca5f5406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:47:37.837079 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31803f1c-fcb8-4a48-a348-7e7bca5f5406 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:47:37.856681 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 650/1317] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:47:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:47:40.723815 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a1035-aa27-4492-bc60-4c51f1c84b01 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:40.724329 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a1035-aa27-4492-bc60-4c51f1c84b01 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:40.724424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a1035-aa27-4492-bc60-4c51f1c84b01 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:40.725780 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 668/1318] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:47:40.730808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13940c-4572-428f-b423-1dca6720f704 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:40.731248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13940c-4572-428f-b423-1dca6720f704 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:40.731365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13940c-4572-428f-b423-1dca6720f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:40.793467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-cb13940c-4572-428f-b423-1dca6720f704 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:47:40.794651 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-cb13940c-4572-428f-b423-1dca6720f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:40.887602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 651/1319] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:47:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:47:40.942163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc386f41-ae7a-409e-a78a-5924ceb5d654 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:40.942450 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc386f41-ae7a-409e-a78a-5924ceb5d654 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:40.942727 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc386f41-ae7a-409e-a78a-5924ceb5d654 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:40.944078 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 669/1320] 10.222.0.44 () {54 vars in 964 bytes} [Mon Jun 27 14:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:47:40.950085 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba813e96-11d7-4042-9238-d0ba50e1dcab None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:40.950370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba813e96-11d7-4042-9238-d0ba50e1dcab None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:40.950657 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba813e96-11d7-4042-9238-d0ba50e1dcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:40.972455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:41.024866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-ba813e96-11d7-4042-9238-d0ba50e1dcab None None] MFA Rules not processed for user `bdf31d7d8c164809bde0e12b71ecfca0`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:47:41.026055 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ba813e96-11d7-4042-9238-d0ba50e1dcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:41.099892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 652/1321] 10.222.0.44 () {58 vars in 1061 bytes} [Mon Jun 27 14:47:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:47:41.108856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc386f41-ae7a-409e-a78a-5924ceb5d654 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:47:41.110366 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-cc386f41-ae7a-409e-a78a-5924ceb5d654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:41.210650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc386f41-ae7a-409e-a78a-5924ceb5d654 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:47:41.280373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae67be8-60cc-4de8-b76b-153371e10273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:47:41.281146 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae67be8-60cc-4de8-b76b-153371e10273 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:41.281428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae67be8-60cc-4de8-b76b-153371e10273 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:41.281700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae67be8-60cc-4de8-b76b-153371e10273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:41.283472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-dae67be8-60cc-4de8-b76b-153371e10273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:41.290720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:41.390911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae67be8-60cc-4de8-b76b-153371e10273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:47:41.392484 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae67be8-60cc-4de8-b76b-153371e10273 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:47:41.410354 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 670/1322] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:47:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:47:44.852933 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44815e5e-caa9-427e-9962-b9cede5ac752 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:44.853526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44815e5e-caa9-427e-9962-b9cede5ac752 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:44.853526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44815e5e-caa9-427e-9962-b9cede5ac752 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:44.854848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 653/1323] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:47:44.860267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238ce49-a8fb-40fb-9565-a3550111e7a9 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:44.860739 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238ce49-a8fb-40fb-9565-a3550111e7a9 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:44.861399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238ce49-a8fb-40fb-9565-a3550111e7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:44.926059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-0238ce49-a8fb-40fb-9565-a3550111e7a9 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:47:44.927165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-0238ce49-a8fb-40fb-9565-a3550111e7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:44.983624 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:45.024628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 671/1324] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:47:45.060594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44815e5e-caa9-427e-9962-b9cede5ac752 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:47:45.062255 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-44815e5e-caa9-427e-9962-b9cede5ac752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:45.179956 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44815e5e-caa9-427e-9962-b9cede5ac752 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:47:45.193672 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:45.258114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a6e65-6630-4b8f-9c9e-475ddff842d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:47:45.258767 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a6e65-6630-4b8f-9c9e-475ddff842d0 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:45.259046 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a6e65-6630-4b8f-9c9e-475ddff842d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:45.259318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a6e65-6630-4b8f-9c9e-475ddff842d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:45.261123 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0f2a6e65-6630-4b8f-9c9e-475ddff842d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:45.373062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a6e65-6630-4b8f-9c9e-475ddff842d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:47:45.374510 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a6e65-6630-4b8f-9c9e-475ddff842d0 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:47:45.391985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 654/1325] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:47:47.561555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da309b7e-55f4-4427-80a3-bd60727ca5c0 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:47.562120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da309b7e-55f4-4427-80a3-bd60727ca5c0 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:47.562120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da309b7e-55f4-4427-80a3-bd60727ca5c0 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:47.563400 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 672/1326] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:47:47.569438 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9ad87-614e-430c-bbda-a64ce2df2ce1 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:47.569991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9ad87-614e-430c-bbda-a64ce2df2ce1 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:47.571740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9ad87-614e-430c-bbda-a64ce2df2ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:47.619428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:47.638148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-c3c9ad87-614e-430c-bbda-a64ce2df2ce1 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:47:47.639321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-c3c9ad87-614e-430c-bbda-a64ce2df2ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:47.739127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 655/1327] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:47:47.775899 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da309b7e-55f4-4427-80a3-bd60727ca5c0 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:47:47.777507 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-da309b7e-55f4-4427-80a3-bd60727ca5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:47.882035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da309b7e-55f4-4427-80a3-bd60727ca5c0 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:47:47.956350 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf54847-973d-4220-98bd-a8cd8eb1833c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:47:47.957033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf54847-973d-4220-98bd-a8cd8eb1833c service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:47.957314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf54847-973d-4220-98bd-a8cd8eb1833c service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:47.957587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf54847-973d-4220-98bd-a8cd8eb1833c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:47.959334 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4bf54847-973d-4220-98bd-a8cd8eb1833c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:47.977957 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:48.070793 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf54847-973d-4220-98bd-a8cd8eb1833c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:47:48.072474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf54847-973d-4220-98bd-a8cd8eb1833c service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:47:48.091089 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 673/1328] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:47:50.165964 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517115d-5b9e-4e63-87a7-638758338272 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:50.166524 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517115d-5b9e-4e63-87a7-638758338272 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:50.166524 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517115d-5b9e-4e63-87a7-638758338272 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:50.168007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 656/1329] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:47:50.173029 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b77d7c-ac78-41e3-bac3-d8efce8d31f3 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:50.173982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b77d7c-ac78-41e3-bac3-d8efce8d31f3 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:50.174285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b77d7c-ac78-41e3-bac3-d8efce8d31f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:50.242111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-22b77d7c-ac78-41e3-bac3-d8efce8d31f3 None None] MFA Rules not processed for user `6b3f273238ff429fb6fd5818edbed0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:47:50.243393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-22b77d7c-ac78-41e3-bac3-d8efce8d31f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:50.312731 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:50.347063 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 674/1330] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:47:50.384588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517115d-5b9e-4e63-87a7-638758338272 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:47:50.386133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-1517115d-5b9e-4e63-87a7-638758338272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:50.493414 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517115d-5b9e-4e63-87a7-638758338272 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:47:50.513287 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:50.568163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b962f3-5c5a-4ef7-8b93-430b8bcc72f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:47:50.568851 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b962f3-5c5a-4ef7-8b93-430b8bcc72f4 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:50.569134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b962f3-5c5a-4ef7-8b93-430b8bcc72f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:50.569409 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b962f3-5c5a-4ef7-8b93-430b8bcc72f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:50.571063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-a4b962f3-5c5a-4ef7-8b93-430b8bcc72f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:50.682471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b962f3-5c5a-4ef7-8b93-430b8bcc72f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:47:50.683886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b962f3-5c5a-4ef7-8b93-430b8bcc72f4 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:47:50.702925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 657/1331] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:47:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:47:53.179626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59e0e-9b58-4b27-beca-4d83578e54e8 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:53.180134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59e0e-9b58-4b27-beca-4d83578e54e8 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:53.180226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59e0e-9b58-4b27-beca-4d83578e54e8 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:53.181629 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 675/1332] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:47:53.186985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8ad84-2b6d-42a2-8465-8e8244aaf75a None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:53.187383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8ad84-2b6d-42a2-8465-8e8244aaf75a None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:53.187566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8ad84-2b6d-42a2-8465-8e8244aaf75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:53.249715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:53.252385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-47c8ad84-2b6d-42a2-8465-8e8244aaf75a None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:47:53.253630 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-47c8ad84-2b6d-42a2-8465-8e8244aaf75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:53.348365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 658/1333] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:47:53.383830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f59e0e-9b58-4b27-beca-4d83578e54e8 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:47:53.385423 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-12f59e0e-9b58-4b27-beca-4d83578e54e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:53.487132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f59e0e-9b58-4b27-beca-4d83578e54e8 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:47:53.563735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc7ca7-15c5-4ef7-9cf0-7c69e73159ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:47:53.565098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc7ca7-15c5-4ef7-9cf0-7c69e73159ab service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:53.565425 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc7ca7-15c5-4ef7-9cf0-7c69e73159ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:53.565705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc7ca7-15c5-4ef7-9cf0-7c69e73159ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:53.567583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-71bc7ca7-15c5-4ef7-9cf0-7c69e73159ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:53.596065 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:53.676191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc7ca7-15c5-4ef7-9cf0-7c69e73159ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:47:53.680090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc7ca7-15c5-4ef7-9cf0-7c69e73159ab service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:47:53.696717 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 676/1334] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:47:55.781449 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5de30-2f2e-4771-bafd-9f6543685672 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:55.782028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5de30-2f2e-4771-bafd-9f6543685672 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:55.782028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5de30-2f2e-4771-bafd-9f6543685672 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:55.784054 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 659/1335] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:47:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:47:55.789163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f433d-ca91-460e-83eb-80e019981367 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:55.789577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f433d-ca91-460e-83eb-80e019981367 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:55.789696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f433d-ca91-460e-83eb-80e019981367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:55.853651 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-fd6f433d-ca91-460e-83eb-80e019981367 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:47:55.854844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-fd6f433d-ca91-460e-83eb-80e019981367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:55.928375 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:55.950153 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 677/1336] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:47:55.990008 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5de30-2f2e-4771-bafd-9f6543685672 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:47:55.991576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b0a5de30-2f2e-4771-bafd-9f6543685672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:56.092897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5de30-2f2e-4771-bafd-9f6543685672 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:47:56.121485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:56.168069 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a554b-d919-4961-8784-ea27db3fc27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:47:56.168738 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a554b-d919-4961-8784-ea27db3fc27e service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:56.169026 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a554b-d919-4961-8784-ea27db3fc27e service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:56.169300 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a554b-d919-4961-8784-ea27db3fc27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:56.170929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-9a7a554b-d919-4961-8784-ea27db3fc27e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:56.276393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a554b-d919-4961-8784-ea27db3fc27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:47:56.277868 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a554b-d919-4961-8784-ea27db3fc27e service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:47:56.296356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 660/1337] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:47:58.941462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5922fc-7009-4f08-9c84-df2c1cbf0863 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:58.941975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5922fc-7009-4f08-9c84-df2c1cbf0863 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:58.941975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5922fc-7009-4f08-9c84-df2c1cbf0863 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:58.943294 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 678/1338] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:47:58.949004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806eba19-ba5b-4a94-8ae2-c83931593a56 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:58.949423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806eba19-ba5b-4a94-8ae2-c83931593a56 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:58.949562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806eba19-ba5b-4a94-8ae2-c83931593a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:59.013180 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-806eba19-ba5b-4a94-8ae2-c83931593a56 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:47:59.014368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-806eba19-ba5b-4a94-8ae2-c83931593a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:59.022581 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:59.110104 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 661/1339] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:47:59.147352 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5922fc-7009-4f08-9c84-df2c1cbf0863 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:47:59.148979 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-ad5922fc-7009-4f08-9c84-df2c1cbf0863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:59.249054 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5922fc-7009-4f08-9c84-df2c1cbf0863 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:47:59.319449 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d782ec-0979-4630-ba5d-86b46cce0adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:47:59.320079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d782ec-0979-4630-ba5d-86b46cce0adb service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:47:59.320359 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d782ec-0979-4630-ba5d-86b46cce0adb service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:47:59.320631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d782ec-0979-4630-ba5d-86b46cce0adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:47:59.322523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-19d782ec-0979-4630-ba5d-86b46cce0adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:47:59.357195 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:47:59.430717 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d782ec-0979-4630-ba5d-86b46cce0adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:47:59.432134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d782ec-0979-4630-ba5d-86b46cce0adb service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:47:59.450311 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 679/1340] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:47:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:03.617204 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9f384-bf98-4aa1-9550-1062225dfe16 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:03.617759 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9f384-bf98-4aa1-9550-1062225dfe16 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:03.617759 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9f384-bf98-4aa1-9550-1062225dfe16 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:03.619120 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 662/1341] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:03.624424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fff1d-59e9-439d-a9eb-f2d612f94931 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:03.624916 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fff1d-59e9-439d-a9eb-f2d612f94931 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:03.625233 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fff1d-59e9-439d-a9eb-f2d612f94931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:03.708184 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-2c4fff1d-59e9-439d-a9eb-f2d612f94931 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:03.709409 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2c4fff1d-59e9-439d-a9eb-f2d612f94931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:03.799930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:48:03.812322 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 680/1342] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:03.851071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9f384-bf98-4aa1-9550-1062225dfe16 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:03.853185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-bfe9f384-bf98-4aa1-9550-1062225dfe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:03.951349 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9f384-bf98-4aa1-9550-1062225dfe16 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:03.955439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94044545-a1cb-47a5-aaeb-7082e6109ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:03.956085 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94044545-a1cb-47a5-aaeb-7082e6109ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:03.956496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94044545-a1cb-47a5-aaeb-7082e6109ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:03.956802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94044545-a1cb-47a5-aaeb-7082e6109ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:03.966054 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94044545-a1cb-47a5-aaeb-7082e6109ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:03.967497 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94044545-a1cb-47a5-aaeb-7082e6109ee7 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:03.977734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 663/1343] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:07.105162 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791719d-53f5-4617-85aa-aadcc2f916e3 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:07.105750 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791719d-53f5-4617-85aa-aadcc2f916e3 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:07.105750 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791719d-53f5-4617-85aa-aadcc2f916e3 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:07.107118 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 681/1344] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:07.112875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3219a-42b1-4e78-ad12-cc8c9f617ce3 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:07.113310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3219a-42b1-4e78-ad12-cc8c9f617ce3 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:07.113435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3219a-42b1-4e78-ad12-cc8c9f617ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:07.141163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-88a3219a-42b1-4e78-ad12-cc8c9f617ce3 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:07.142948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-88a3219a-42b1-4e78-ad12-cc8c9f617ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:07.171036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:48:07.219567 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 664/1345] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:07.257157 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791719d-53f5-4617-85aa-aadcc2f916e3 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:07.268356 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791719d-53f5-4617-85aa-aadcc2f916e3 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:07.271861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0daa1b-df0c-4662-a234-5d5cc07ebc11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:07.272493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0daa1b-df0c-4662-a234-5d5cc07ebc11 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:07.272810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0daa1b-df0c-4662-a234-5d5cc07ebc11 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:07.273090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0daa1b-df0c-4662-a234-5d5cc07ebc11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:07.281933 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0daa1b-df0c-4662-a234-5d5cc07ebc11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:07.283380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0daa1b-df0c-4662-a234-5d5cc07ebc11 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:07.292717 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 682/1346] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:11.766765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0ce06-8573-422d-9fbe-cc5395ec2617 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:11.767297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0ce06-8573-422d-9fbe-cc5395ec2617 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:11.767693 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0ce06-8573-422d-9fbe-cc5395ec2617 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:11.769125 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 665/1347] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:11.774675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfff9e-b756-4cbe-969c-880abfff6d35 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:11.775177 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfff9e-b756-4cbe-969c-880abfff6d35 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:11.775271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfff9e-b756-4cbe-969c-880abfff6d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:11.794948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-75cfff9e-b756-4cbe-969c-880abfff6d35 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:11.796110 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-75cfff9e-b756-4cbe-969c-880abfff6d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:11.804928 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 683/1348] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:11.842900 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0ce06-8573-422d-9fbe-cc5395ec2617 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:11.854067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0ce06-8573-422d-9fbe-cc5395ec2617 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:11.857661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709b8c5-7ab0-4504-ba07-2d49a3ee5966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:11.858297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709b8c5-7ab0-4504-ba07-2d49a3ee5966 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:11.858566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709b8c5-7ab0-4504-ba07-2d49a3ee5966 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:11.858838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709b8c5-7ab0-4504-ba07-2d49a3ee5966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:11.869917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709b8c5-7ab0-4504-ba07-2d49a3ee5966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:11.871441 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709b8c5-7ab0-4504-ba07-2d49a3ee5966 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:11.881785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 666/1349] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:16.824137 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64baed-4655-4027-867e-b4bacf262cef None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:16.825226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64baed-4655-4027-867e-b4bacf262cef None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:16.825729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64baed-4655-4027-867e-b4bacf262cef None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:16.827553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 684/1350] 10.222.0.44 () {54 vars in 921 bytes} [Mon Jun 27 14:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:16.833708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfba666-023a-4283-86e1-aa0ff530711e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:16.834164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfba666-023a-4283-86e1-aa0ff530711e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:16.834453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfba666-023a-4283-86e1-aa0ff530711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:16.930472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-acfba666-023a-4283-86e1-aa0ff530711e None None] MFA Rules not processed for user `f3ced893407a484e8ed0c4918438edf0`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:16.931940 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-acfba666-023a-4283-86e1-aa0ff530711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:17.022847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 667/1351] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Jun 27 14:48:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:21.152026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd94724-b5ed-4134-a8bc-6bca20fcefbb None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:21.152566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd94724-b5ed-4134-a8bc-6bca20fcefbb None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:21.152566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd94724-b5ed-4134-a8bc-6bca20fcefbb None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:21.154149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 685/1352] 10.222.0.44 () {54 vars in 921 bytes} [Mon Jun 27 14:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:21.159598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985da85-e2a3-4ad4-bcbe-cbae9bb7e4f3 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:21.160030 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985da85-e2a3-4ad4-bcbe-cbae9bb7e4f3 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:21.160208 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985da85-e2a3-4ad4-bcbe-cbae9bb7e4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:21.178612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-1985da85-e2a3-4ad4-bcbe-cbae9bb7e4f3 None None] MFA Rules not processed for user `f3ced893407a484e8ed0c4918438edf0`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:21.179800 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-1985da85-e2a3-4ad4-bcbe-cbae9bb7e4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:21.188760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 668/1353] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Jun 27 14:48:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:21.788921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=13 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:48:22.897927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7be029-58f7-4175-bb5e-a7f3d1e3fba2 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:22.898572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7be029-58f7-4175-bb5e-a7f3d1e3fba2 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:22.898572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7be029-58f7-4175-bb5e-a7f3d1e3fba2 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:22.899825 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 686/1354] 10.222.0.44 () {54 vars in 921 bytes} [Mon Jun 27 14:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:22.904873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458be18-452c-4ba0-ba28-266131c3287b None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:22.905337 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458be18-452c-4ba0-ba28-266131c3287b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:22.905548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458be18-452c-4ba0-ba28-266131c3287b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:22.925341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-0458be18-452c-4ba0-ba28-266131c3287b None None] MFA Rules not processed for user `f3ced893407a484e8ed0c4918438edf0`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:22.926585 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0458be18-452c-4ba0-ba28-266131c3287b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:22.935499 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 669/1355] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Jun 27 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:26.645238 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42151479-4947-4f38-9e9c-aeebec3b9bb9 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:26.645764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42151479-4947-4f38-9e9c-aeebec3b9bb9 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:26.645873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42151479-4947-4f38-9e9c-aeebec3b9bb9 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:26.647813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 687/1356] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:26.655117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccea8a-49a1-4289-a295-a494cc4eb36c None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:26.655645 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccea8a-49a1-4289-a295-a494cc4eb36c None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:26.656067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccea8a-49a1-4289-a295-a494cc4eb36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:26.679366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-05ccea8a-49a1-4289-a295-a494cc4eb36c None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:26.679366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-05ccea8a-49a1-4289-a295-a494cc4eb36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:26.689038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 670/1357] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:26.758253 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311cc61-cb19-44da-b370-d1ed45775010 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:26.758895 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311cc61-cb19-44da-b370-d1ed45775010 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:26.759398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311cc61-cb19-44da-b370-d1ed45775010 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:26.761242 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 688/1358] 10.222.0.44 () {54 vars in 961 bytes} [Mon Jun 27 14:48:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:26.772091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a314137-26fb-42dd-a63d-631158a04dd8 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:26.772798 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a314137-26fb-42dd-a63d-631158a04dd8 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:26.780043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a314137-26fb-42dd-a63d-631158a04dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:26.843181 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:48:26.855289 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-7a314137-26fb-42dd-a63d-631158a04dd8 None None] MFA Rules not processed for user `08529776af224c36ab560c13f5941e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:26.857284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7a314137-26fb-42dd-a63d-631158a04dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:26.955237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 671/1359] 10.222.0.44 () {58 vars in 1058 bytes} [Mon Jun 27 14:48:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:26.966140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311cc61-cb19-44da-b370-d1ed45775010 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:26.985385 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311cc61-cb19-44da-b370-d1ed45775010 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:26.992490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec7eac-9a46-4535-bebc-de518d61996e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:26.994536 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec7eac-9a46-4535-bebc-de518d61996e service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:26.995340 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec7eac-9a46-4535-bebc-de518d61996e service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:26.997860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec7eac-9a46-4535-bebc-de518d61996e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:27.006838 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec7eac-9a46-4535-bebc-de518d61996e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:27.008730 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec7eac-9a46-4535-bebc-de518d61996e service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:27.020502 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 689/1360] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:29.351731 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c3600-6ebc-4196-994e-03b15f88edd0 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:29.352275 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c3600-6ebc-4196-994e-03b15f88edd0 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:29.352275 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c3600-6ebc-4196-994e-03b15f88edd0 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:29.353815 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 672/1361] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:29.358723 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4195c-a68e-4af0-bdfe-85f4beb66b72 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:29.359125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4195c-a68e-4af0-bdfe-85f4beb66b72 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:29.359274 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4195c-a68e-4af0-bdfe-85f4beb66b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:29.377090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-9fb4195c-a68e-4af0-bdfe-85f4beb66b72 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:29.378532 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9fb4195c-a68e-4af0-bdfe-85f4beb66b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:29.386428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 690/1362] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:29.431682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c3600-6ebc-4196-994e-03b15f88edd0 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:29.447650 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c3600-6ebc-4196-994e-03b15f88edd0 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:29.454874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b790dc-ccc7-4df5-9db4-a308d89f203b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:29.455553 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b790dc-ccc7-4df5-9db4-a308d89f203b service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:29.455838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b790dc-ccc7-4df5-9db4-a308d89f203b service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:29.456117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b790dc-ccc7-4df5-9db4-a308d89f203b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:29.466186 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b790dc-ccc7-4df5-9db4-a308d89f203b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:29.467803 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b790dc-ccc7-4df5-9db4-a308d89f203b service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:29.479993 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 673/1363] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:31.982534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b9578-3a57-4367-ab23-b14442fa5dfb None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:31.983036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b9578-3a57-4367-ab23-b14442fa5dfb None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:31.983036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b9578-3a57-4367-ab23-b14442fa5dfb None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:31.984374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 691/1364] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:31.989635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dacd9-197c-49f5-97cc-5fc143fa6a91 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:31.990069 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dacd9-197c-49f5-97cc-5fc143fa6a91 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:31.990277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dacd9-197c-49f5-97cc-5fc143fa6a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:32.008574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-8f3dacd9-197c-49f5-97cc-5fc143fa6a91 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:32.009795 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8f3dacd9-197c-49f5-97cc-5fc143fa6a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:32.018154 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 674/1365] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:32.064999 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe87b9-bd49-430e-8bb0-71da4389fb26 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:32.065403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe87b9-bd49-430e-8bb0-71da4389fb26 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:32.065866 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe87b9-bd49-430e-8bb0-71da4389fb26 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:32.067288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 692/1366] 10.222.0.44 () {54 vars in 961 bytes} [Mon Jun 27 14:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:32.073036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32207fd3-256d-412f-b6a7-79ed14fd017f None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:32.079737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32207fd3-256d-412f-b6a7-79ed14fd017f None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:32.079737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32207fd3-256d-412f-b6a7-79ed14fd017f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:32.093979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-32207fd3-256d-412f-b6a7-79ed14fd017f None None] MFA Rules not processed for user `08529776af224c36ab560c13f5941e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:32.095559 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-32207fd3-256d-412f-b6a7-79ed14fd017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:32.105069 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 675/1367] 10.222.0.44 () {58 vars in 1058 bytes} [Mon Jun 27 14:48:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:32.114017 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe87b9-bd49-430e-8bb0-71da4389fb26 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:32.129171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe87b9-bd49-430e-8bb0-71da4389fb26 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:32.134591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e867cf-6b3a-4505-88b2-ac674f3194f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:32.135228 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e867cf-6b3a-4505-88b2-ac674f3194f9 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:32.135512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e867cf-6b3a-4505-88b2-ac674f3194f9 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:32.135790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e867cf-6b3a-4505-88b2-ac674f3194f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:32.144421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e867cf-6b3a-4505-88b2-ac674f3194f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:32.146038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e867cf-6b3a-4505-88b2-ac674f3194f9 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:32.155504 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 693/1368] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:34.471484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe913b45-b6ce-4595-89b2-ea3b1f46fbe6 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:34.472028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe913b45-b6ce-4595-89b2-ea3b1f46fbe6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:34.472028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe913b45-b6ce-4595-89b2-ea3b1f46fbe6 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:34.473505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 676/1369] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:34.479110 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc60c4-8c47-42ca-a4af-ba7732b4aca2 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:34.480085 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc60c4-8c47-42ca-a4af-ba7732b4aca2 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:34.480399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc60c4-8c47-42ca-a4af-ba7732b4aca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:34.501501 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-ffbc60c4-8c47-42ca-a4af-ba7732b4aca2 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:34.502747 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-ffbc60c4-8c47-42ca-a4af-ba7732b4aca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:34.512684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 694/1370] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:34.556873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe913b45-b6ce-4595-89b2-ea3b1f46fbe6 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:34.572473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe913b45-b6ce-4595-89b2-ea3b1f46fbe6 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:34.578285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90638a-0654-42ad-af86-1f57756029d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:34.579773 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90638a-0654-42ad-af86-1f57756029d1 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:34.580173 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90638a-0654-42ad-af86-1f57756029d1 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:34.580524 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90638a-0654-42ad-af86-1f57756029d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:34.589932 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90638a-0654-42ad-af86-1f57756029d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:34.591603 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90638a-0654-42ad-af86-1f57756029d1 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:34.603132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 677/1371] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:34.886917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d5a2a-1c4d-4f52-9e92-e6b15ae12613 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:34.887273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d5a2a-1c4d-4f52-9e92-e6b15ae12613 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:34.887490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d5a2a-1c4d-4f52-9e92-e6b15ae12613 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:34.889398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 695/1372] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:34.895488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aabd38-7ddd-4a50-9de7-454d1bb9d5d2 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:34.895774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aabd38-7ddd-4a50-9de7-454d1bb9d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:34.896233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aabd38-7ddd-4a50-9de7-454d1bb9d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:34.915218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-93aabd38-7ddd-4a50-9de7-454d1bb9d5d2 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:34.916459 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-93aabd38-7ddd-4a50-9de7-454d1bb9d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:34.925406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 678/1373] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:35.272052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68975c44-8ae0-43ae-9add-21b2261ced2f None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:35.272349 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68975c44-8ae0-43ae-9add-21b2261ced2f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:35.272631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68975c44-8ae0-43ae-9add-21b2261ced2f None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:35.274155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 696/1374] 10.222.0.44 () {54 vars in 963 bytes} [Mon Jun 27 14:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:35.278950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fa4e3-a353-499d-8a6a-70cb06aebf07 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:35.279243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fa4e3-a353-499d-8a6a-70cb06aebf07 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:35.279523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fa4e3-a353-499d-8a6a-70cb06aebf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:35.332222 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-d87fa4e3-a353-499d-8a6a-70cb06aebf07 None None] MFA Rules not processed for user `015326e75ae14b778e4478627d07c17f`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:35.334026 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-d87fa4e3-a353-499d-8a6a-70cb06aebf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:35.405387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 679/1375] 10.222.0.44 () {58 vars in 1060 bytes} [Mon Jun 27 14:48:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:35.413413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68975c44-8ae0-43ae-9add-21b2261ced2f None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:35.424561 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68975c44-8ae0-43ae-9add-21b2261ced2f None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:35.428120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a015b8-66f4-4a5a-b16e-8dc9b64f4da6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:35.428789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a015b8-66f4-4a5a-b16e-8dc9b64f4da6 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:35.429257 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a015b8-66f4-4a5a-b16e-8dc9b64f4da6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:35.429533 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a015b8-66f4-4a5a-b16e-8dc9b64f4da6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:35.439075 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a015b8-66f4-4a5a-b16e-8dc9b64f4da6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:35.440508 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a015b8-66f4-4a5a-b16e-8dc9b64f4da6 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:35.460775 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 697/1376] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:36.836625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a486cf3-7b8d-49fc-9df3-aa0cc6ca062c None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:36.837273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a486cf3-7b8d-49fc-9df3-aa0cc6ca062c None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:36.837273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a486cf3-7b8d-49fc-9df3-aa0cc6ca062c None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:36.838619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 680/1377] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:36.843815 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e788d08-910b-479a-bafb-4500f22b20b1 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:36.844436 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e788d08-910b-479a-bafb-4500f22b20b1 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:36.844635 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e788d08-910b-479a-bafb-4500f22b20b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:36.864353 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-8e788d08-910b-479a-bafb-4500f22b20b1 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:36.865593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-8e788d08-910b-479a-bafb-4500f22b20b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:36.874155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 698/1378] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:36.919891 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a486cf3-7b8d-49fc-9df3-aa0cc6ca062c None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:36.935187 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a486cf3-7b8d-49fc-9df3-aa0cc6ca062c None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:36.941335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fb9e1-2078-4be8-949c-ac3684235490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:36.941972 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fb9e1-2078-4be8-949c-ac3684235490 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:36.942257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fb9e1-2078-4be8-949c-ac3684235490 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:36.942532 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fb9e1-2078-4be8-949c-ac3684235490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:36.951098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fb9e1-2078-4be8-949c-ac3684235490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:36.952693 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fb9e1-2078-4be8-949c-ac3684235490 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:36.956571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:48:36.962593 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 681/1379] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:39.197266 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233e49e-2d0f-474e-b7ae-70a35303127b None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:39.198207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233e49e-2d0f-474e-b7ae-70a35303127b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:39.198694 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233e49e-2d0f-474e-b7ae-70a35303127b None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:39.201791 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 699/1380] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:39.206506 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51d8af-8d7b-4648-9b9b-0d8d36921131 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:39.206986 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51d8af-8d7b-4648-9b9b-0d8d36921131 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:39.207070 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51d8af-8d7b-4648-9b9b-0d8d36921131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:39.228131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-3a51d8af-8d7b-4648-9b9b-0d8d36921131 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:39.229626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-3a51d8af-8d7b-4648-9b9b-0d8d36921131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:39.238379 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 682/1381] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:39.283364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233e49e-2d0f-474e-b7ae-70a35303127b None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:39.298273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233e49e-2d0f-474e-b7ae-70a35303127b None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:39.303955 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3b7f1-2c29-4de9-83e6-2fcff0ef586a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:39.304694 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3b7f1-2c29-4de9-83e6-2fcff0ef586a service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:39.305045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3b7f1-2c29-4de9-83e6-2fcff0ef586a service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:39.305388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3b7f1-2c29-4de9-83e6-2fcff0ef586a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:39.314413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3b7f1-2c29-4de9-83e6-2fcff0ef586a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:39.316081 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3b7f1-2c29-4de9-83e6-2fcff0ef586a service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:39.326325 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 700/1382] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:41.512946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e582362-6220-4e92-9488-33db200ae11f None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:41.513397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e582362-6220-4e92-9488-33db200ae11f None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:41.513664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e582362-6220-4e92-9488-33db200ae11f None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:41.515319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 683/1383] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:41.521079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4270c0-9872-45ba-a435-168fe0a2a909 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:41.521537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4270c0-9872-45ba-a435-168fe0a2a909 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:41.521829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4270c0-9872-45ba-a435-168fe0a2a909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:41.540856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-7c4270c0-9872-45ba-a435-168fe0a2a909 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:41.542155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7c4270c0-9872-45ba-a435-168fe0a2a909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:41.550870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 701/1384] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:41.591473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e582362-6220-4e92-9488-33db200ae11f None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:41.606032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e582362-6220-4e92-9488-33db200ae11f None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:41.612011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c8b63-6b92-449f-af0d-c96881fd4f8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:41.612635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c8b63-6b92-449f-af0d-c96881fd4f8e service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:41.612940 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c8b63-6b92-449f-af0d-c96881fd4f8e service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:41.613216 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c8b63-6b92-449f-af0d-c96881fd4f8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:41.621406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c8b63-6b92-449f-af0d-c96881fd4f8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:41.622970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c8b63-6b92-449f-af0d-c96881fd4f8e service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:41.632592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 684/1385] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:43.694756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293ca1d-feb7-4440-bd2e-c3e7ddaf21f2 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:43.695293 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293ca1d-feb7-4440-bd2e-c3e7ddaf21f2 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:43.695387 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293ca1d-feb7-4440-bd2e-c3e7ddaf21f2 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:43.697198 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 702/1386] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:43.702829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d6d01-1a9a-4089-8b3c-1f9c3bacbeaa None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:43.703912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d6d01-1a9a-4089-8b3c-1f9c3bacbeaa None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:43.703912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d6d01-1a9a-4089-8b3c-1f9c3bacbeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:43.724149 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-801d6d01-1a9a-4089-8b3c-1f9c3bacbeaa None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:43.725415 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-801d6d01-1a9a-4089-8b3c-1f9c3bacbeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:43.733874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 685/1387] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:43.783727 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293ca1d-feb7-4440-bd2e-c3e7ddaf21f2 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:43.799741 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293ca1d-feb7-4440-bd2e-c3e7ddaf21f2 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:43.805263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62edf47-886f-4c20-88db-519f2f64f502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:43.805904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62edf47-886f-4c20-88db-519f2f64f502 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:43.806188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62edf47-886f-4c20-88db-519f2f64f502 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:43.806465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62edf47-886f-4c20-88db-519f2f64f502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:43.815555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62edf47-886f-4c20-88db-519f2f64f502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:43.817154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62edf47-886f-4c20-88db-519f2f64f502 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:43.826871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 703/1388] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:46.120843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87546-8ec8-41d4-b434-6a04e5b8f8d2 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:46.121399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87546-8ec8-41d4-b434-6a04e5b8f8d2 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:46.121399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87546-8ec8-41d4-b434-6a04e5b8f8d2 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:46.122787 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 686/1389] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:46.128377 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae9c1f-bfdc-4b2b-9c77-115135c0d515 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:46.128843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae9c1f-bfdc-4b2b-9c77-115135c0d515 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:46.128979 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae9c1f-bfdc-4b2b-9c77-115135c0d515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:46.147439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-5dae9c1f-bfdc-4b2b-9c77-115135c0d515 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:46.148714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-5dae9c1f-bfdc-4b2b-9c77-115135c0d515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:46.157399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 704/1390] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:46.204986 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf87546-8ec8-41d4-b434-6a04e5b8f8d2 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:46.221262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf87546-8ec8-41d4-b434-6a04e5b8f8d2 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:46.227182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dde7ca-1953-4837-9fda-e3388cb0a9f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:46.228099 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dde7ca-1953-4837-9fda-e3388cb0a9f9 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:46.228721 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dde7ca-1953-4837-9fda-e3388cb0a9f9 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:46.229071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dde7ca-1953-4837-9fda-e3388cb0a9f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:46.240446 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dde7ca-1953-4837-9fda-e3388cb0a9f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:46.242533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dde7ca-1953-4837-9fda-e3388cb0a9f9 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:46.254932 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 687/1391] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:48.445558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28355d8a-ca29-4e4c-91bc-84290f602004 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:48.446382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28355d8a-ca29-4e4c-91bc-84290f602004 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:48.446492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28355d8a-ca29-4e4c-91bc-84290f602004 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:48.448268 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 705/1392] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:48.454214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c648d4-c06b-47e4-8efe-31cf7dc98807 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:48.454877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c648d4-c06b-47e4-8efe-31cf7dc98807 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:48.454877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c648d4-c06b-47e4-8efe-31cf7dc98807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:48.473384 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f9c648d4-c06b-47e4-8efe-31cf7dc98807 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:48.474645 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f9c648d4-c06b-47e4-8efe-31cf7dc98807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:48.483781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 688/1393] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:48.538170 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28355d8a-ca29-4e4c-91bc-84290f602004 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:48.555853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28355d8a-ca29-4e4c-91bc-84290f602004 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:48.563096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fc81f-7a96-4dea-9c0c-3cf76152d029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:48.564081 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fc81f-7a96-4dea-9c0c-3cf76152d029 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:48.564437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fc81f-7a96-4dea-9c0c-3cf76152d029 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:48.564811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fc81f-7a96-4dea-9c0c-3cf76152d029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:48.575511 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fc81f-7a96-4dea-9c0c-3cf76152d029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:48.577107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fc81f-7a96-4dea-9c0c-3cf76152d029 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:48.587046 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 706/1394] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:50.798569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8169e-68c3-40b0-b46e-f314db57eb11 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:50.799141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8169e-68c3-40b0-b46e-f314db57eb11 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:50.799141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8169e-68c3-40b0-b46e-f314db57eb11 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:50.800465 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 689/1395] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:50.805538 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb32a66-1f0a-479f-b472-3b2a052978c1 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:50.805950 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb32a66-1f0a-479f-b472-3b2a052978c1 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:50.806093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb32a66-1f0a-479f-b472-3b2a052978c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:50.824406 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-4fb32a66-1f0a-479f-b472-3b2a052978c1 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:50.825610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4fb32a66-1f0a-479f-b472-3b2a052978c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:50.834087 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 707/1396] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:50.878589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8169e-68c3-40b0-b46e-f314db57eb11 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:50.893535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8169e-68c3-40b0-b46e-f314db57eb11 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:50.898807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888a139-407e-4e43-9ac5-82eb2e2454e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:50.899430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a139-407e-4e43-9ac5-82eb2e2454e5 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:50.899708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a139-407e-4e43-9ac5-82eb2e2454e5 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:50.899980 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a139-407e-4e43-9ac5-82eb2e2454e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:50.908851 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888a139-407e-4e43-9ac5-82eb2e2454e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:50.910398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888a139-407e-4e43-9ac5-82eb2e2454e5 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:50.919598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 690/1397] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:51.004611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee2f53-e53d-4ab3-9049-5269779746b0 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:51.004848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee2f53-e53d-4ab3-9049-5269779746b0 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:51.005113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee2f53-e53d-4ab3-9049-5269779746b0 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:51.006497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 708/1398] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:51.011975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b5ebd-765e-46f2-bb9a-f911f6fda1b6 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:51.012262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b5ebd-765e-46f2-bb9a-f911f6fda1b6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:51.012537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b5ebd-765e-46f2-bb9a-f911f6fda1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:51.033147 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-127b5ebd-765e-46f2-bb9a-f911f6fda1b6 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:51.038285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-127b5ebd-765e-46f2-bb9a-f911f6fda1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:51.043213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 691/1399] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:51.098934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759c0a1-ff29-4498-8434-e6ba2b9ce89f None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:51.099222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759c0a1-ff29-4498-8434-e6ba2b9ce89f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:51.099495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759c0a1-ff29-4498-8434-e6ba2b9ce89f None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:51.100884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 709/1400] 10.222.0.44 () {54 vars in 962 bytes} [Mon Jun 27 14:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:51.106063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6a5bf-da4c-4bce-915d-46b351742b1b None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:51.106375 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6a5bf-da4c-4bce-915d-46b351742b1b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:51.107086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6a5bf-da4c-4bce-915d-46b351742b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:51.161627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-40e6a5bf-da4c-4bce-915d-46b351742b1b None None] MFA Rules not processed for user `6e93d0321eaa4936a55390155d5aab0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:51.162870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-40e6a5bf-da4c-4bce-915d-46b351742b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:51.229142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 692/1401] 10.222.0.44 () {58 vars in 1059 bytes} [Mon Jun 27 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:48:51.237308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759c0a1-ff29-4498-8434-e6ba2b9ce89f None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:51.248049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759c0a1-ff29-4498-8434-e6ba2b9ce89f None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:51.252396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bff4a3-8f51-4518-9420-1747e3ebc232 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e93d0321eaa4936a55390155d5aab0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:51.253076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bff4a3-8f51-4518-9420-1747e3ebc232 service glance] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:51.253358 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bff4a3-8f51-4518-9420-1747e3ebc232 service glance] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:51.253627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bff4a3-8f51-4518-9420-1747e3ebc232 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:51.263392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bff4a3-8f51-4518-9420-1747e3ebc232 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:51.264758 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bff4a3-8f51-4518-9420-1747e3ebc232 service glance] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:51.274563 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 710/1402] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:48:52.093590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999a706-c86e-48ee-af80-d237b6cd13a6 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:52.094276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999a706-c86e-48ee-af80-d237b6cd13a6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:52.094421 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999a706-c86e-48ee-af80-d237b6cd13a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:52.145626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-e999a706-c86e-48ee-af80-d237b6cd13a6 None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:52.146815 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-e999a706-c86e-48ee-af80-d237b6cd13a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:52.187949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:48:52.213152 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 693/1403] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Jun 27 14:48:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:52.257525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d172a16-d27d-4827-bb62-69edfd99d4a1 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:52.258027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d172a16-d27d-4827-bb62-69edfd99d4a1 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:52.258262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d172a16-d27d-4827-bb62-69edfd99d4a1 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:52.259792 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 711/1404] 10.222.0.44 () {54 vars in 942 bytes} [Mon Jun 27 14:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:52.266753 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460d657-4af0-4fb6-8fbd-dc17536415aa None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:52.270875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460d657-4af0-4fb6-8fbd-dc17536415aa None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:52.270875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460d657-4af0-4fb6-8fbd-dc17536415aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:52.316990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-3460d657-4af0-4fb6-8fbd-dc17536415aa None None] MFA Rules not processed for user `482c11dafd8541e28d50705f7651fd15`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:52.318191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-3460d657-4af0-4fb6-8fbd-dc17536415aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:52.389026 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 694/1405] 10.222.0.44 () {58 vars in 1039 bytes} [Mon Jun 27 14:48:52 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:52.398518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d172a16-d27d-4827-bb62-69edfd99d4a1 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:52.406151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=61 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:48:52.412440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d172a16-d27d-4827-bb62-69edfd99d4a1 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:52.417582 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fea83-f49f-4a9d-914b-e1617a44689b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:52.418219 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fea83-f49f-4a9d-914b-e1617a44689b service swift] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:52.418506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fea83-f49f-4a9d-914b-e1617a44689b service swift] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:52.418786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fea83-f49f-4a9d-914b-e1617a44689b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:52.427420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fea83-f49f-4a9d-914b-e1617a44689b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:52.429030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fea83-f49f-4a9d-914b-e1617a44689b service swift] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:52.437507 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 712/1406] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 14:48:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 14:48:53.121039 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3096b-f8ab-49f3-8167-257b013b3b19 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:53.121929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3096b-f8ab-49f3-8167-257b013b3b19 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:53.122356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3096b-f8ab-49f3-8167-257b013b3b19 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:53.123729 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 695/1407] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:48:53.128929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e6157-43ac-4dbd-a63e-2708d1ba3a9f None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:53.129407 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e6157-43ac-4dbd-a63e-2708d1ba3a9f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:53.129843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e6157-43ac-4dbd-a63e-2708d1ba3a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:53.148976 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-744e6157-43ac-4dbd-a63e-2708d1ba3a9f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:48:53.150481 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-744e6157-43ac-4dbd-a63e-2708d1ba3a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:48:53.165003 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 713/1408] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:48:53.202726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3096b-f8ab-49f3-8167-257b013b3b19 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:48:53.218351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3096b-f8ab-49f3-8167-257b013b3b19 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:48:53.225047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032336af-f4d8-469f-b11d-df33a95b3e42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:48:53.225769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032336af-f4d8-469f-b11d-df33a95b3e42 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:48:53.226051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032336af-f4d8-469f-b11d-df33a95b3e42 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:48:53.226323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032336af-f4d8-469f-b11d-df33a95b3e42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:48:53.234607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032336af-f4d8-469f-b11d-df33a95b3e42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:48:53.237711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032336af-f4d8-469f-b11d-df33a95b3e42 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:48:53.249924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 696/1409] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:48:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:03.143816 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=8 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:49:03.245491 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=59 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:49:16.153747 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c08510-6a64-45ea-afc4-940586ff3ac4 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:16.154285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c08510-6a64-45ea-afc4-940586ff3ac4 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:16.154285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c08510-6a64-45ea-afc4-940586ff3ac4 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:16.156141 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 714/1410] 10.222.0.44 () {54 vars in 918 bytes} [Mon Jun 27 14:49:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:16.161323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb3a96-bca7-4f57-a63c-f99285f46de5 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:16.161737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb3a96-bca7-4f57-a63c-f99285f46de5 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:16.161857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb3a96-bca7-4f57-a63c-f99285f46de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:16.180900 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-febb3a96-bca7-4f57-a63c-f99285f46de5 None None] MFA Rules not processed for user `f3ced893407a484e8ed0c4918438edf0`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:16.182088 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-febb3a96-bca7-4f57-a63c-f99285f46de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:16.190407 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 697/1411] 10.222.0.44 () {58 vars in 1015 bytes} [Mon Jun 27 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:49:16.204755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fb4f3-50b8-45e4-9c5f-a6101786c12e None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:16.205045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fb4f3-50b8-45e4-9c5f-a6101786c12e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:16.205324 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fb4f3-50b8-45e4-9c5f-a6101786c12e None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:16.206684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 715/1412] 10.222.0.44 () {54 vars in 918 bytes} [Mon Jun 27 14:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:16.211235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537931e4-fffb-474d-90ba-2b134064f33b None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:16.211529 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537931e4-fffb-474d-90ba-2b134064f33b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:16.211851 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537931e4-fffb-474d-90ba-2b134064f33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:16.229858 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-537931e4-fffb-474d-90ba-2b134064f33b None None] MFA Rules not processed for user `08529776af224c36ab560c13f5941e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:16.231040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-537931e4-fffb-474d-90ba-2b134064f33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:16.240555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 698/1413] 10.222.0.44 () {58 vars in 1015 bytes} [Mon Jun 27 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:18.745044 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400d4ed-aca3-41fc-aee6-deff258e1119 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:18.745561 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400d4ed-aca3-41fc-aee6-deff258e1119 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:18.745668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400d4ed-aca3-41fc-aee6-deff258e1119 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:18.747016 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 14:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:18.752934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d8d2d-8c32-481e-81c9-b3ac31561579 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:18.753373 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d8d2d-8c32-481e-81c9-b3ac31561579 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:18.753469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d8d2d-8c32-481e-81c9-b3ac31561579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:18.770714 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-6f9d8d2d-8c32-481e-81c9-b3ac31561579 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:18.771888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6f9d8d2d-8c32-481e-81c9-b3ac31561579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:18.779451 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:18.822745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400d4ed-aca3-41fc-aee6-deff258e1119 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:18.836945 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400d4ed-aca3-41fc-aee6-deff258e1119 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:18.842369 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e40cc7-4407-4aa2-942f-b0b536a48fcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:18.842998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e40cc7-4407-4aa2-942f-b0b536a48fcc service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:18.843280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e40cc7-4407-4aa2-942f-b0b536a48fcc service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:18.843562 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e40cc7-4407-4aa2-942f-b0b536a48fcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:18.851756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e40cc7-4407-4aa2-942f-b0b536a48fcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:18.853345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e40cc7-4407-4aa2-942f-b0b536a48fcc service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:18.863369 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 717/1416] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:19.756524 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273b893-c4f4-4c18-8d7d-ce3ad9d48d74 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:19.757111 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273b893-c4f4-4c18-8d7d-ce3ad9d48d74 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:19.757111 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273b893-c4f4-4c18-8d7d-ce3ad9d48d74 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:19.758458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 14:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:19.763418 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56336ea-7e8a-4117-9a5a-832b60fb9e6c None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:19.763861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56336ea-7e8a-4117-9a5a-832b60fb9e6c None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:19.763971 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56336ea-7e8a-4117-9a5a-832b60fb9e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:19.781950 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a56336ea-7e8a-4117-9a5a-832b60fb9e6c None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:19.783143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a56336ea-7e8a-4117-9a5a-832b60fb9e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:19.790714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:19.948014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273b893-c4f4-4c18-8d7d-ce3ad9d48d74 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:19.962742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273b893-c4f4-4c18-8d7d-ce3ad9d48d74 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:19.968003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ec317-1507-4d90-88f7-f0d528d88997 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:19.968736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ec317-1507-4d90-88f7-f0d528d88997 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:19.969020 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ec317-1507-4d90-88f7-f0d528d88997 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:19.969290 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ec317-1507-4d90-88f7-f0d528d88997 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:19.977272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ec317-1507-4d90-88f7-f0d528d88997 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:19.978816 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ec317-1507-4d90-88f7-f0d528d88997 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:19.987907 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 701/1419] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:20.871130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cf9ae-7d11-4ff8-8195-0f1e454cedc2 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:20.871705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cf9ae-7d11-4ff8-8195-0f1e454cedc2 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:20.871705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cf9ae-7d11-4ff8-8195-0f1e454cedc2 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:20.873078 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 14:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:20.878019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b899c9a-320c-4fb5-a338-1e8e32235fc5 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:20.878430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b899c9a-320c-4fb5-a338-1e8e32235fc5 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:20.878575 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b899c9a-320c-4fb5-a338-1e8e32235fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:20.896664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-2b899c9a-320c-4fb5-a338-1e8e32235fc5 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:20.897857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2b899c9a-320c-4fb5-a338-1e8e32235fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:20.905511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:21.056099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cf9ae-7d11-4ff8-8195-0f1e454cedc2 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:21.070153 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cf9ae-7d11-4ff8-8195-0f1e454cedc2 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:21.075699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040c64d-6fb9-4812-9040-741592c3ce1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:21.076326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040c64d-6fb9-4812-9040-741592c3ce1d service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:21.076605 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040c64d-6fb9-4812-9040-741592c3ce1d service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:21.076953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040c64d-6fb9-4812-9040-741592c3ce1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:21.085474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040c64d-6fb9-4812-9040-741592c3ce1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:21.087042 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040c64d-6fb9-4812-9040-741592c3ce1d service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:21.097298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 720/1422] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:21.951769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a31d8d-0d1e-41b6-ba3a-257244430116 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:21.952415 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a31d8d-0d1e-41b6-ba3a-257244430116 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:21.952415 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a31d8d-0d1e-41b6-ba3a-257244430116 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:21.953797 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 14:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:21.958762 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8dea7-20d9-4ce8-ac17-fe950d17e220 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:21.959201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8dea7-20d9-4ce8-ac17-fe950d17e220 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:21.959320 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8dea7-20d9-4ce8-ac17-fe950d17e220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:21.976863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d2c8dea7-20d9-4ce8-ac17-fe950d17e220 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:21.978047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d2c8dea7-20d9-4ce8-ac17-fe950d17e220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:21.986511 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 14:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:22.136047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a31d8d-0d1e-41b6-ba3a-257244430116 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:22.150331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a31d8d-0d1e-41b6-ba3a-257244430116 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:22.156146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78644f47-51f4-499b-9950-04659aea77f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:22.156809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78644f47-51f4-499b-9950-04659aea77f2 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:22.157090 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78644f47-51f4-499b-9950-04659aea77f2 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:22.157365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78644f47-51f4-499b-9950-04659aea77f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:22.165288 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78644f47-51f4-499b-9950-04659aea77f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:22.166851 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78644f47-51f4-499b-9950-04659aea77f2 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:22.176793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 704/1425] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:23.044535 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb07d3-ebbc-47dc-bdc9-36ca1a3435f0 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:23.045089 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb07d3-ebbc-47dc-bdc9-36ca1a3435f0 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:23.045203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb07d3-ebbc-47dc-bdc9-36ca1a3435f0 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:23.046560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 14:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:23.051531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d798f2f-338e-4452-a713-4cc7c3cb033b None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:23.051966 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d798f2f-338e-4452-a713-4cc7c3cb033b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:23.052077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d798f2f-338e-4452-a713-4cc7c3cb033b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:23.070450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-6d798f2f-338e-4452-a713-4cc7c3cb033b None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:23.071885 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6d798f2f-338e-4452-a713-4cc7c3cb033b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:23.080374 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 14:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:23.230042 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb07d3-ebbc-47dc-bdc9-36ca1a3435f0 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:23.245083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb07d3-ebbc-47dc-bdc9-36ca1a3435f0 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:23.251118 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f68fa3-3457-45ce-99fa-6cd2155b09dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:23.251772 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f68fa3-3457-45ce-99fa-6cd2155b09dc service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:23.252049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f68fa3-3457-45ce-99fa-6cd2155b09dc service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:23.252320 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f68fa3-3457-45ce-99fa-6cd2155b09dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:23.260386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f68fa3-3457-45ce-99fa-6cd2155b09dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:23.261977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f68fa3-3457-45ce-99fa-6cd2155b09dc service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:23.271214 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 723/1428] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:24.149846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6ffcc-ec7a-4472-83ae-fe1e1f164e78 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:24.150347 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6ffcc-ec7a-4472-83ae-fe1e1f164e78 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:24.150446 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6ffcc-ec7a-4472-83ae-fe1e1f164e78 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:24.151763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 14:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:24.157449 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396f0e2-34d1-4b66-8151-fba3d0a6a179 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:24.157867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396f0e2-34d1-4b66-8151-fba3d0a6a179 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:24.158027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396f0e2-34d1-4b66-8151-fba3d0a6a179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:24.176044 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a396f0e2-34d1-4b66-8151-fba3d0a6a179 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:24.177262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a396f0e2-34d1-4b66-8151-fba3d0a6a179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:24.184977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 14:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:24.336094 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6ffcc-ec7a-4472-83ae-fe1e1f164e78 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:24.350168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6ffcc-ec7a-4472-83ae-fe1e1f164e78 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:24.356462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416458be-88cb-4070-b902-bb9181169d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:24.357043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416458be-88cb-4070-b902-bb9181169d85 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:24.357334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416458be-88cb-4070-b902-bb9181169d85 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:24.357602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416458be-88cb-4070-b902-bb9181169d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:24.365814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416458be-88cb-4070-b902-bb9181169d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:24.367356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416458be-88cb-4070-b902-bb9181169d85 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:24.377109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 707/1431] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:25.275642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadc7d5-34c8-42cd-8196-fcf6b8d2374b None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:25.276196 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadc7d5-34c8-42cd-8196-fcf6b8d2374b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:25.276196 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadc7d5-34c8-42cd-8196-fcf6b8d2374b None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:25.277578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 14:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:25.282929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9695a-1a32-4157-bdf7-b11fa63ac69f None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:25.283387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9695a-1a32-4157-bdf7-b11fa63ac69f None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:25.283521 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9695a-1a32-4157-bdf7-b11fa63ac69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:25.301427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-00e9695a-1a32-4157-bdf7-b11fa63ac69f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:25.302607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-00e9695a-1a32-4157-bdf7-b11fa63ac69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:25.310217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:25.463098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadc7d5-34c8-42cd-8196-fcf6b8d2374b None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:25.478004 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadc7d5-34c8-42cd-8196-fcf6b8d2374b None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:25.483281 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0aa8d-e321-4586-9b37-897f5e75d776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:25.484153 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0aa8d-e321-4586-9b37-897f5e75d776 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:25.484533 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0aa8d-e321-4586-9b37-897f5e75d776 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:25.484839 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0aa8d-e321-4586-9b37-897f5e75d776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:25.492840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0aa8d-e321-4586-9b37-897f5e75d776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:25.494395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0aa8d-e321-4586-9b37-897f5e75d776 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:25.503606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 726/1434] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:26.381633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0f5e0-7a32-4e7e-892b-77f11cadb05e None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:26.382167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0f5e0-7a32-4e7e-892b-77f11cadb05e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:26.382167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0f5e0-7a32-4e7e-892b-77f11cadb05e None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:26.383476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 14:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:26.388595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9309a34-036d-49ef-8ddc-6bac78dd81b1 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:26.389034 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9309a34-036d-49ef-8ddc-6bac78dd81b1 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:26.389174 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9309a34-036d-49ef-8ddc-6bac78dd81b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:26.406780 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d9309a34-036d-49ef-8ddc-6bac78dd81b1 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:26.407970 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d9309a34-036d-49ef-8ddc-6bac78dd81b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:26.415618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:26.565550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0f5e0-7a32-4e7e-892b-77f11cadb05e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:26.579959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0f5e0-7a32-4e7e-892b-77f11cadb05e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:26.585284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9703e2-9e63-4ed2-ad6e-650c3518409b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:26.585907 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9703e2-9e63-4ed2-ad6e-650c3518409b service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:26.586189 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9703e2-9e63-4ed2-ad6e-650c3518409b service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:26.586465 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9703e2-9e63-4ed2-ad6e-650c3518409b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:26.595335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9703e2-9e63-4ed2-ad6e-650c3518409b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:26.596924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9703e2-9e63-4ed2-ad6e-650c3518409b service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:26.606103 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 710/1437] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:27.456834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f50dd-2d8c-4d66-a115-49a163fb8241 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:27.457441 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f50dd-2d8c-4d66-a115-49a163fb8241 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:27.457441 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f50dd-2d8c-4d66-a115-49a163fb8241 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:27.458735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 14:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:27.463556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d1c6b-ee19-4d19-8641-2bfe84b8a2b9 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:27.464011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d1c6b-ee19-4d19-8641-2bfe84b8a2b9 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:27.464118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d1c6b-ee19-4d19-8641-2bfe84b8a2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:27.482205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-796d1c6b-ee19-4d19-8641-2bfe84b8a2b9 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:27.483395 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-796d1c6b-ee19-4d19-8641-2bfe84b8a2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:27.491931 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 14:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:27.640916 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f50dd-2d8c-4d66-a115-49a163fb8241 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:27.655112 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f50dd-2d8c-4d66-a115-49a163fb8241 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:27.661188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ccea3-c2cd-4611-b9d4-afa1489b8d6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:27.661812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ccea3-c2cd-4611-b9d4-afa1489b8d6a service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:27.662099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ccea3-c2cd-4611-b9d4-afa1489b8d6a service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:27.662374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ccea3-c2cd-4611-b9d4-afa1489b8d6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:27.670267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ccea3-c2cd-4611-b9d4-afa1489b8d6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:27.671858 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ccea3-c2cd-4611-b9d4-afa1489b8d6a service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:27.681024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 729/1440] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:29.723494 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5223f-9bd5-4219-a192-da85629d6b95 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:29.724043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5223f-9bd5-4219-a192-da85629d6b95 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:29.724043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5223f-9bd5-4219-a192-da85629d6b95 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:29.725443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 14:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:29.730619 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6a141-9dac-43fd-8262-9319895cf80a None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:29.731033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6a141-9dac-43fd-8262-9319895cf80a None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:29.731155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6a141-9dac-43fd-8262-9319895cf80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:29.749810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a1c6a141-9dac-43fd-8262-9319895cf80a None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:29.751002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a1c6a141-9dac-43fd-8262-9319895cf80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:29.758681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 14:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:29.798334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5223f-9bd5-4219-a192-da85629d6b95 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:29.808926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5223f-9bd5-4219-a192-da85629d6b95 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:29.812609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8dddc1-7a15-47a9-a3dd-9eb80451643a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:29.813276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8dddc1-7a15-47a9-a3dd-9eb80451643a service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:29.813564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8dddc1-7a15-47a9-a3dd-9eb80451643a service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:29.813840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8dddc1-7a15-47a9-a3dd-9eb80451643a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:29.823106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8dddc1-7a15-47a9-a3dd-9eb80451643a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:29.824518 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8dddc1-7a15-47a9-a3dd-9eb80451643a service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:29.836216 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 713/1443] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:32.080553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e44224-a20f-4fe5-8ec3-befa4cb0a6e6 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:32.081115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e44224-a20f-4fe5-8ec3-befa4cb0a6e6 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:32.081115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e44224-a20f-4fe5-8ec3-befa4cb0a6e6 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:32.082416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 14:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:32.087997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7a381-c938-4268-8c39-549ecbbaa17a None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:32.088471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7a381-c938-4268-8c39-549ecbbaa17a None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:32.088572 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7a381-c938-4268-8c39-549ecbbaa17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:32.106957 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-0dd7a381-c938-4268-8c39-549ecbbaa17a None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:32.107549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0dd7a381-c938-4268-8c39-549ecbbaa17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:32.116078 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 14:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:32.154173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e44224-a20f-4fe5-8ec3-befa4cb0a6e6 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:32.165155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e44224-a20f-4fe5-8ec3-befa4cb0a6e6 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:32.168624 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de7d9c-b29f-4146-95ed-bf48c7442588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:32.169280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de7d9c-b29f-4146-95ed-bf48c7442588 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:32.169590 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de7d9c-b29f-4146-95ed-bf48c7442588 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:32.169864 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de7d9c-b29f-4146-95ed-bf48c7442588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:32.179197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de7d9c-b29f-4146-95ed-bf48c7442588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:32.180593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de7d9c-b29f-4146-95ed-bf48c7442588 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:32.190541 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 732/1446] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:34.586363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49647907-cbcc-4ce3-9c88-2638f27b8a09 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:34.586955 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49647907-cbcc-4ce3-9c88-2638f27b8a09 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:34.586955 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49647907-cbcc-4ce3-9c88-2638f27b8a09 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:34.588366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 14:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:49:34.593512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0a2c2-2543-4082-b777-a5f5513cf55f None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:34.593973 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0a2c2-2543-4082-b777-a5f5513cf55f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:34.594073 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0a2c2-2543-4082-b777-a5f5513cf55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:34.612134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-64b0a2c2-2543-4082-b777-a5f5513cf55f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:34.613367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-64b0a2c2-2543-4082-b777-a5f5513cf55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:34.621302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 14:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:34.659346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49647907-cbcc-4ce3-9c88-2638f27b8a09 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:34.669941 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49647907-cbcc-4ce3-9c88-2638f27b8a09 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:34.674060 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3910d-4ae0-4fe8-87f8-c7a600f2ccb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:34.674689 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3910d-4ae0-4fe8-87f8-c7a600f2ccb4 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:34.674972 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3910d-4ae0-4fe8-87f8-c7a600f2ccb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:34.675244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3910d-4ae0-4fe8-87f8-c7a600f2ccb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:34.683936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3910d-4ae0-4fe8-87f8-c7a600f2ccb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:34.685375 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3910d-4ae0-4fe8-87f8-c7a600f2ccb4 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:34.695404 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 716/1449] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:36.844217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3700618-db6e-4118-b109-18c66b4fef6a None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:36.844752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3700618-db6e-4118-b109-18c66b4fef6a None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:36.844878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3700618-db6e-4118-b109-18c66b4fef6a None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:36.846203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 14:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:36.851492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e16f8-0b67-4a85-ac0f-1059593d4ac6 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:36.851945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e16f8-0b67-4a85-ac0f-1059593d4ac6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:36.852051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e16f8-0b67-4a85-ac0f-1059593d4ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:36.869615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-723e16f8-0b67-4a85-ac0f-1059593d4ac6 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:36.870800 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-723e16f8-0b67-4a85-ac0f-1059593d4ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:36.879291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 14:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:36.918020 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3700618-db6e-4118-b109-18c66b4fef6a None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:36.929018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3700618-db6e-4118-b109-18c66b4fef6a None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:36.932506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756241c-7d72-45aa-8918-2e390f94431b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:36.933166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756241c-7d72-45aa-8918-2e390f94431b service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:36.935428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756241c-7d72-45aa-8918-2e390f94431b service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:36.935428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756241c-7d72-45aa-8918-2e390f94431b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:36.942924 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756241c-7d72-45aa-8918-2e390f94431b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:36.944336 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756241c-7d72-45aa-8918-2e390f94431b service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:36.954831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 735/1452] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:49:39.024404 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb262de-789b-4a52-8a6d-dea4344839a2 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:39.024966 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb262de-789b-4a52-8a6d-dea4344839a2 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:39.024966 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb262de-789b-4a52-8a6d-dea4344839a2 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:39.026321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 14:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:39.031488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8feea-8cfa-4387-9b21-eaa73e9a48ed None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:39.031893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8feea-8cfa-4387-9b21-eaa73e9a48ed None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:39.032043 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8feea-8cfa-4387-9b21-eaa73e9a48ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:39.049705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-63c8feea-8cfa-4387-9b21-eaa73e9a48ed None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:39.050879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-63c8feea-8cfa-4387-9b21-eaa73e9a48ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:39.058449 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 14:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:39.096260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb262de-789b-4a52-8a6d-dea4344839a2 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:39.107038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb262de-789b-4a52-8a6d-dea4344839a2 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:39.111252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80410a4-cebd-4659-8d36-edaf2f52d94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:39.111882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80410a4-cebd-4659-8d36-edaf2f52d94b service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:39.112167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80410a4-cebd-4659-8d36-edaf2f52d94b service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:39.112442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80410a4-cebd-4659-8d36-edaf2f52d94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:39.121408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80410a4-cebd-4659-8d36-edaf2f52d94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:39.122805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80410a4-cebd-4659-8d36-edaf2f52d94b service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:39.132885 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 719/1455] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:41.181603 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e593504-455c-4f58-bb4b-1b29bfcaae9d None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:41.182184 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e593504-455c-4f58-bb4b-1b29bfcaae9d None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:41.182184 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e593504-455c-4f58-bb4b-1b29bfcaae9d None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:41.183506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 14:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:41.188880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a292cf-798a-4506-8fc8-2bdcb5bd89dc None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:41.189294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a292cf-798a-4506-8fc8-2bdcb5bd89dc None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:41.189471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a292cf-798a-4506-8fc8-2bdcb5bd89dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:41.207482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-54a292cf-798a-4506-8fc8-2bdcb5bd89dc None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:41.208686 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-54a292cf-798a-4506-8fc8-2bdcb5bd89dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:41.216316 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 14:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:41.254126 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e593504-455c-4f58-bb4b-1b29bfcaae9d None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:41.265104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e593504-455c-4f58-bb4b-1b29bfcaae9d None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:41.268526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b948e7-b10d-4a4b-a9c1-6a780c2badd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:41.269188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b948e7-b10d-4a4b-a9c1-6a780c2badd8 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:41.269470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b948e7-b10d-4a4b-a9c1-6a780c2badd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:41.269740 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b948e7-b10d-4a4b-a9c1-6a780c2badd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:41.278370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b948e7-b10d-4a4b-a9c1-6a780c2badd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:41.279773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b948e7-b10d-4a4b-a9c1-6a780c2badd8 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:41.289473 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 738/1458] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:43.392825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984a525-50b9-4526-9b0c-a8df5885af58 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:43.393372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984a525-50b9-4526-9b0c-a8df5885af58 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:43.393372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984a525-50b9-4526-9b0c-a8df5885af58 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:43.394747 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 14:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:43.399954 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef129a4-3d28-41bf-8e92-670c6e65918e None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:43.400465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef129a4-3d28-41bf-8e92-670c6e65918e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:43.400671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef129a4-3d28-41bf-8e92-670c6e65918e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:43.406565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=70 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:49:43.418201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-8ef129a4-3d28-41bf-8e92-670c6e65918e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:43.419402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-8ef129a4-3d28-41bf-8e92-670c6e65918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:43.427627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 14:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:43.465429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984a525-50b9-4526-9b0c-a8df5885af58 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:43.470782 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=73 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:49:43.476308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984a525-50b9-4526-9b0c-a8df5885af58 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:43.479742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47822e-8282-4530-8141-dd9962cbb683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:43.482478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47822e-8282-4530-8141-dd9962cbb683 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:43.482478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47822e-8282-4530-8141-dd9962cbb683 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:43.482478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47822e-8282-4530-8141-dd9962cbb683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:43.490153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47822e-8282-4530-8141-dd9962cbb683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:43.491575 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47822e-8282-4530-8141-dd9962cbb683 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:43.501691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 722/1461] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:45.578838 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32194a41-c999-4b7d-bf7b-a71eaf1c1879 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:45.579383 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32194a41-c999-4b7d-bf7b-a71eaf1c1879 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:45.579383 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32194a41-c999-4b7d-bf7b-a71eaf1c1879 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:45.580794 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 14:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:45.586063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d5d26-07a8-4043-9cdf-82c6b5fdbf47 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:45.586469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d5d26-07a8-4043-9cdf-82c6b5fdbf47 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:45.586614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d5d26-07a8-4043-9cdf-82c6b5fdbf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:45.603859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-fc5d5d26-07a8-4043-9cdf-82c6b5fdbf47 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:45.605085 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-fc5d5d26-07a8-4043-9cdf-82c6b5fdbf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:45.613860 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 14:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:45.651641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32194a41-c999-4b7d-bf7b-a71eaf1c1879 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:45.662405 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32194a41-c999-4b7d-bf7b-a71eaf1c1879 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:45.665831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238949f-e56a-4d90-bf54-4da63961ea46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:45.666459 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238949f-e56a-4d90-bf54-4da63961ea46 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:45.666740 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238949f-e56a-4d90-bf54-4da63961ea46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:45.667012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238949f-e56a-4d90-bf54-4da63961ea46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:45.676452 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238949f-e56a-4d90-bf54-4da63961ea46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:45.677919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238949f-e56a-4d90-bf54-4da63961ea46 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:45.690109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 741/1464] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:47.736476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c494746-0583-471e-ace4-d9658f6126b1 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:47.737046 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c494746-0583-471e-ace4-d9658f6126b1 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:47.737046 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c494746-0583-471e-ace4-d9658f6126b1 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:47.738436 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 14:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:47.743752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508b10e-9e0f-486b-9647-de4e1ff09c85 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:47.744191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508b10e-9e0f-486b-9647-de4e1ff09c85 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:47.744322 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508b10e-9e0f-486b-9647-de4e1ff09c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:47.762441 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-6508b10e-9e0f-486b-9647-de4e1ff09c85 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:47.763638 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-6508b10e-9e0f-486b-9647-de4e1ff09c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:47.772186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:47.808895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c494746-0583-471e-ace4-d9658f6126b1 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:47.810655 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-5c494746-0583-471e-ace4-d9658f6126b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:47.825743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c494746-0583-471e-ace4-d9658f6126b1 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:47.830162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b749b37-91f1-4ba7-a02d-479cb1e1b560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:47.830824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b749b37-91f1-4ba7-a02d-479cb1e1b560 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:47.831110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b749b37-91f1-4ba7-a02d-479cb1e1b560 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:47.831384 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b749b37-91f1-4ba7-a02d-479cb1e1b560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:47.840208 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b749b37-91f1-4ba7-a02d-479cb1e1b560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:47.841648 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b749b37-91f1-4ba7-a02d-479cb1e1b560 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:47.851761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 725/1467] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:49.900790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eee63-5d07-485e-8e72-7ca0d04567b9 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:49.901373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eee63-5d07-485e-8e72-7ca0d04567b9 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:49.901373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eee63-5d07-485e-8e72-7ca0d04567b9 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:49.902711 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 14:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:49:49.908487 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a65d2-4d42-4f52-b2c6-7bbc6fbc9b59 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:49.908954 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a65d2-4d42-4f52-b2c6-7bbc6fbc9b59 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:49.909075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a65d2-4d42-4f52-b2c6-7bbc6fbc9b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:49.926939 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-821a65d2-4d42-4f52-b2c6-7bbc6fbc9b59 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:49:49.928117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-821a65d2-4d42-4f52-b2c6-7bbc6fbc9b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:49:49.935744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:49:49.972831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768eee63-5d07-485e-8e72-7ca0d04567b9 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:49:49.983885 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768eee63-5d07-485e-8e72-7ca0d04567b9 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:49:49.987466 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e49e2-f508-4d1f-a009-6b03a5970664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:49:49.988086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e49e2-f508-4d1f-a009-6b03a5970664 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:49:49.988364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e49e2-f508-4d1f-a009-6b03a5970664 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:49:49.988634 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e49e2-f508-4d1f-a009-6b03a5970664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:49:49.997331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e49e2-f508-4d1f-a009-6b03a5970664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:49:49.998831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e49e2-f508-4d1f-a009-6b03a5970664 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:49:50.008277 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 744/1470] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:49:59.921968 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=17 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:50:00.003864 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=17 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:50:10.038209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6bce3-e020-4aef-94de-fc2faf767524 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:10.038794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6bce3-e020-4aef-94de-fc2faf767524 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:10.038794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6bce3-e020-4aef-94de-fc2faf767524 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:10.040175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 727/1471] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:50:10.045578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a58dd-d0cd-4169-8f1d-9b1cb9447ebe None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:10.046082 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a58dd-d0cd-4169-8f1d-9b1cb9447ebe None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:10.046082 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a58dd-d0cd-4169-8f1d-9b1cb9447ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:10.063813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-847a58dd-d0cd-4169-8f1d-9b1cb9447ebe None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:50:10.065031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-847a58dd-d0cd-4169-8f1d-9b1cb9447ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:50:10.072878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 745/1472] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:50:10.120771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8684b-093a-4779-b847-39fe78c86d2c None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:10.121062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8684b-093a-4779-b847-39fe78c86d2c None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:10.121341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8684b-093a-4779-b847-39fe78c86d2c None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:10.122697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 728/1473] 10.222.0.44 () {54 vars in 962 bytes} [Mon Jun 27 14:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:50:10.127819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0159-8c4a-4e51-a7d2-bf027439f948 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:10.128107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0159-8c4a-4e51-a7d2-bf027439f948 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:10.128386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0159-8c4a-4e51-a7d2-bf027439f948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:10.146620 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1c0f0159-8c4a-4e51-a7d2-bf027439f948 None None] MFA Rules not processed for user `6e93d0321eaa4936a55390155d5aab0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:50:10.147795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1c0f0159-8c4a-4e51-a7d2-bf027439f948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:50:10.154955 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 746/1474] 10.222.0.44 () {58 vars in 1059 bytes} [Mon Jun 27 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:50:10.162114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8684b-093a-4779-b847-39fe78c86d2c None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:50:10.172517 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8684b-093a-4779-b847-39fe78c86d2c None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:50:10.175977 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101733a-2359-4bca-8106-8fd0b3aa3b8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e93d0321eaa4936a55390155d5aab0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:50:10.176596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101733a-2359-4bca-8106-8fd0b3aa3b8c service glance] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:10.176979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101733a-2359-4bca-8106-8fd0b3aa3b8c service glance] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:10.177254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101733a-2359-4bca-8106-8fd0b3aa3b8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:10.186474 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101733a-2359-4bca-8106-8fd0b3aa3b8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:50:10.187795 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101733a-2359-4bca-8106-8fd0b3aa3b8c service glance] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:50:10.197316 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 729/1475] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:50:12.313392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fe941-d176-4417-a0cf-37153a3cf823 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:12.313940 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fe941-d176-4417-a0cf-37153a3cf823 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:12.313940 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fe941-d176-4417-a0cf-37153a3cf823 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:12.315335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 747/1476] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:50:12.320928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96f420-3135-4e84-b670-7bad0f8e7fa6 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:12.321346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96f420-3135-4e84-b670-7bad0f8e7fa6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:12.321479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96f420-3135-4e84-b670-7bad0f8e7fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:12.339291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-cb96f420-3135-4e84-b670-7bad0f8e7fa6 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:50:12.340475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-cb96f420-3135-4e84-b670-7bad0f8e7fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:50:12.348734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 730/1477] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:50:12.372328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fe941-d176-4417-a0cf-37153a3cf823 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:50:12.384673 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fe941-d176-4417-a0cf-37153a3cf823 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:50:12.389152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6aca4-c950-449b-83e8-870455ccdc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:50:12.389790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6aca4-c950-449b-83e8-870455ccdc10 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:12.390071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6aca4-c950-449b-83e8-870455ccdc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:12.390342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6aca4-c950-449b-83e8-870455ccdc10 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:12.391072 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6aca4-c950-449b-83e8-870455ccdc10 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:50:12.392878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: WARNING py.warnings [None req-6dd6aca4-c950-449b-83e8-870455ccdc10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:50:12.392878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: warnings.warn(msg) Jun 27 14:50:12.392878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: Jun 27 14:50:12.394004 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6aca4-c950-449b-83e8-870455ccdc10 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:50:12.413488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 748/1478] 10.222.0.44 () {56 vars in 1108 bytes} [Mon Jun 27 14:50:12 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:50:14.456322 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe4d4f-b192-494f-9516-83b2367b07b2 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:14.456922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe4d4f-b192-494f-9516-83b2367b07b2 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:14.456922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe4d4f-b192-494f-9516-83b2367b07b2 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:14.458269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 731/1479] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:50:14.463461 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba04c6-423a-4797-b18c-cf74578d1e80 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:14.463866 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba04c6-423a-4797-b18c-cf74578d1e80 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:14.464026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba04c6-423a-4797-b18c-cf74578d1e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:14.482455 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d5ba04c6-423a-4797-b18c-cf74578d1e80 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:50:14.483671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d5ba04c6-423a-4797-b18c-cf74578d1e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:50:14.491431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 749/1480] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:50:14.534205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe4d4f-b192-494f-9516-83b2367b07b2 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:50:14.548500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe4d4f-b192-494f-9516-83b2367b07b2 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:50:14.553812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633861d5-05c0-4a56-b735-9d54f282aa04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:50:14.554436 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633861d5-05c0-4a56-b735-9d54f282aa04 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:14.554713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633861d5-05c0-4a56-b735-9d54f282aa04 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:14.554981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633861d5-05c0-4a56-b735-9d54f282aa04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:14.563843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633861d5-05c0-4a56-b735-9d54f282aa04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:50:14.565431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633861d5-05c0-4a56-b735-9d54f282aa04 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:50:14.575027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 732/1481] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:50:16.778732 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf65ade-3ec4-4b5f-93db-71864e47005f None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:16.779782 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf65ade-3ec4-4b5f-93db-71864e47005f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:16.779896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf65ade-3ec4-4b5f-93db-71864e47005f None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:16.781216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 750/1482] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:50:16.786308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c10f97-6072-49b6-89cb-8e6427d3c09a None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:16.786728 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c10f97-6072-49b6-89cb-8e6427d3c09a None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:16.786860 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c10f97-6072-49b6-89cb-8e6427d3c09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:16.805067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-c4c10f97-6072-49b6-89cb-8e6427d3c09a None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:50:16.806254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-c4c10f97-6072-49b6-89cb-8e6427d3c09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:50:16.814098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 733/1483] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:50:16.850739 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf65ade-3ec4-4b5f-93db-71864e47005f None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:50:16.862235 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf65ade-3ec4-4b5f-93db-71864e47005f None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:50:16.865735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d2583-d9e5-49a1-9e61-f459069c1228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:50:16.866415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d2583-d9e5-49a1-9e61-f459069c1228 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:16.866696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d2583-d9e5-49a1-9e61-f459069c1228 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:16.866972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d2583-d9e5-49a1-9e61-f459069c1228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:16.876386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d2583-d9e5-49a1-9e61-f459069c1228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:50:16.877827 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d2583-d9e5-49a1-9e61-f459069c1228 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:50:16.887090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 751/1484] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:50:18.974130 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8363c9-edf8-4705-a6f2-2eba88ffafee None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:18.974687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8363c9-edf8-4705-a6f2-2eba88ffafee None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:18.974687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8363c9-edf8-4705-a6f2-2eba88ffafee None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:18.976053 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 734/1485] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:50:18.981192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6892-9220-40bf-af61-3ebebb1dc7c4 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:18.981619 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6892-9220-40bf-af61-3ebebb1dc7c4 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:18.981753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6892-9220-40bf-af61-3ebebb1dc7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:19.000302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a4eb6892-9220-40bf-af61-3ebebb1dc7c4 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:50:19.001464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a4eb6892-9220-40bf-af61-3ebebb1dc7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:50:19.009235 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 752/1486] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:50:19.047762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8363c9-edf8-4705-a6f2-2eba88ffafee None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:50:19.058360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8363c9-edf8-4705-a6f2-2eba88ffafee None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:50:19.061944 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a02a50-66f1-4779-ba53-93a8299f6823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:50:19.062571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a02a50-66f1-4779-ba53-93a8299f6823 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:19.062855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a02a50-66f1-4779-ba53-93a8299f6823 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:19.063133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a02a50-66f1-4779-ba53-93a8299f6823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:19.072075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a02a50-66f1-4779-ba53-93a8299f6823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:50:19.073528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a02a50-66f1-4779-ba53-93a8299f6823 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:50:19.082907 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 735/1487] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:50:21.207904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a732963-a7e6-44c9-b78c-86930e0b2c02 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:21.208451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a732963-a7e6-44c9-b78c-86930e0b2c02 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:21.208451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a732963-a7e6-44c9-b78c-86930e0b2c02 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:21.209836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 753/1488] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:50:21.214996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731cd79-dbcd-400b-a297-563aef828557 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:21.215430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731cd79-dbcd-400b-a297-563aef828557 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:21.215539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731cd79-dbcd-400b-a297-563aef828557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:21.237295 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-e731cd79-dbcd-400b-a297-563aef828557 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:50:21.238478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-e731cd79-dbcd-400b-a297-563aef828557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:50:21.246160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 736/1489] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:50:21.287084 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a732963-a7e6-44c9-b78c-86930e0b2c02 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:50:21.298068 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a732963-a7e6-44c9-b78c-86930e0b2c02 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:50:21.301502 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045f474-be8f-43c6-b019-8958f3a48f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:50:21.302122 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045f474-be8f-43c6-b019-8958f3a48f0c service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:21.302401 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045f474-be8f-43c6-b019-8958f3a48f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:21.302672 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045f474-be8f-43c6-b019-8958f3a48f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:21.311354 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045f474-be8f-43c6-b019-8958f3a48f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:50:21.312787 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045f474-be8f-43c6-b019-8958f3a48f0c service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:50:21.322449 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 754/1490] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:50:23.744980 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff4c72-19e0-46da-b89a-3d3af3751349 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:23.745511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff4c72-19e0-46da-b89a-3d3af3751349 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:23.745511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff4c72-19e0-46da-b89a-3d3af3751349 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:23.746818 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 737/1491] 10.222.0.44 () {54 vars in 926 bytes} [Mon Jun 27 14:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:50:23.752496 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2d355-e82c-48fb-87ae-3178918a93df None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:23.752917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2d355-e82c-48fb-87ae-3178918a93df None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:23.753099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2d355-e82c-48fb-87ae-3178918a93df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:23.771161 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-b6c2d355-e82c-48fb-87ae-3178918a93df None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:50:23.772353 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b6c2d355-e82c-48fb-87ae-3178918a93df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:50:23.780044 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 755/1492] 10.222.0.44 () {58 vars in 1023 bytes} [Mon Jun 27 14:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:50:23.818493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff4c72-19e0-46da-b89a-3d3af3751349 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:50:23.830113 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff4c72-19e0-46da-b89a-3d3af3751349 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:50:23.833574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257110ee-5e8e-4a03-8c65-c1f2d61d3fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:50:23.834198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257110ee-5e8e-4a03-8c65-c1f2d61d3fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:50:23.834498 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257110ee-5e8e-4a03-8c65-c1f2d61d3fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:50:23.834764 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257110ee-5e8e-4a03-8c65-c1f2d61d3fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:50:23.843471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257110ee-5e8e-4a03-8c65-c1f2d61d3fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:50:23.844896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257110ee-5e8e-4a03-8c65-c1f2d61d3fa6 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:50:23.854358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 738/1493] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:50:33.766297 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=33 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:50:33.850251 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=33 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:51:59.634888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4cbe2-0591-490a-9b4d-2c7ed897c6e0 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:51:59.635493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4cbe2-0591-490a-9b4d-2c7ed897c6e0 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:51:59.635493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4cbe2-0591-490a-9b4d-2c7ed897c6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:51:59.653479 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-8bd4cbe2-0591-490a-9b4d-2c7ed897c6e0 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:51:59.654662 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-8bd4cbe2-0591-490a-9b4d-2c7ed897c6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:51:59.662410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 756/1494] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:51:59.670169 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8825b09-3242-4fca-9bdc-8d8838c69f4d None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:51:59.670666 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8825b09-3242-4fca-9bdc-8d8838c69f4d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:51:59.670773 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8825b09-3242-4fca-9bdc-8d8838c69f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:51:59.688763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b8825b09-3242-4fca-9bdc-8d8838c69f4d None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:51:59.699944 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b8825b09-3242-4fca-9bdc-8d8838c69f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:51:59.699944 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 739/1495] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:51:59.703071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4cbe2-0591-490a-9b4d-2c7ed897c6e0 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:51:59.712493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4cbe2-0591-490a-9b4d-2c7ed897c6e0 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:51:59.717064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c95d3-2c14-4cad-acc1-c0f47989b189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:51:59.717705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c95d3-2c14-4cad-acc1-c0f47989b189 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:51:59.717987 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c95d3-2c14-4cad-acc1-c0f47989b189 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:51:59.718262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c95d3-2c14-4cad-acc1-c0f47989b189 admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:51:59.718993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c95d3-2c14-4cad-acc1-c0f47989b189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:51:59.719288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c95d3-2c14-4cad-acc1-c0f47989b189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:51:59.720289 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: WARNING py.warnings [None req-f73c95d3-2c14-4cad-acc1-c0f47989b189 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:51:59.720289 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: warnings.warn(msg) Jun 27 14:51:59.720289 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: Jun 27 14:51:59.721207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c95d3-2c14-4cad-acc1-c0f47989b189 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:51:59.732832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 757/1496] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:51:59.741004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8825b09-3242-4fca-9bdc-8d8838c69f4d None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:51:59.750630 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8825b09-3242-4fca-9bdc-8d8838c69f4d None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:51:59.755346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56e3a3-1ec3-428a-80ee-ef6bc436d268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:51:59.755980 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56e3a3-1ec3-428a-80ee-ef6bc436d268 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:51:59.756261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56e3a3-1ec3-428a-80ee-ef6bc436d268 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:51:59.756529 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56e3a3-1ec3-428a-80ee-ef6bc436d268 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:51:59.757279 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56e3a3-1ec3-428a-80ee-ef6bc436d268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:51:59.759011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: WARNING py.warnings [None req-8d56e3a3-1ec3-428a-80ee-ef6bc436d268 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:51:59.759011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: warnings.warn(msg) Jun 27 14:51:59.759011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: Jun 27 14:51:59.760188 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56e3a3-1ec3-428a-80ee-ef6bc436d268 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:51:59.856395 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 740/1497] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:51:59 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:51:59.860753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c95d3-2c14-4cad-acc1-c0f47989b189 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:51:59.871712 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c95d3-2c14-4cad-acc1-c0f47989b189 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:51:59.927241 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071837e6-289a-4316-af49-9142ec72a546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:51:59.927897 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071837e6-289a-4316-af49-9142ec72a546 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:51:59.928179 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071837e6-289a-4316-af49-9142ec72a546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:51:59.928453 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071837e6-289a-4316-af49-9142ec72a546 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:51:59.929181 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071837e6-289a-4316-af49-9142ec72a546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:51:59.930173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: WARNING py.warnings [None req-071837e6-289a-4316-af49-9142ec72a546 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:51:59.930173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: warnings.warn(msg) Jun 27 14:51:59.930173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: Jun 27 14:51:59.931377 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071837e6-289a-4316-af49-9142ec72a546 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:51:59.998440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 758/1498] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:51:59 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:52:00.002594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56e3a3-1ec3-428a-80ee-ef6bc436d268 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:52:00.012626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56e3a3-1ec3-428a-80ee-ef6bc436d268 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:52:00.017164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16754fec-ff21-4871-803f-5724d0bcc57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:52:00.017851 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16754fec-ff21-4871-803f-5724d0bcc57b admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:52:00.018130 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16754fec-ff21-4871-803f-5724d0bcc57b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:52:00.018401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16754fec-ff21-4871-803f-5724d0bcc57b admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:52:00.019125 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16754fec-ff21-4871-803f-5724d0bcc57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:52:00.020121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: WARNING py.warnings [None req-16754fec-ff21-4871-803f-5724d0bcc57b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:52:00.020121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: warnings.warn(msg) Jun 27 14:52:00.020121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: Jun 27 14:52:00.021160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16754fec-ff21-4871-803f-5724d0bcc57b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:52:00.034038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 741/1499] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:52:00.037850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071837e6-289a-4316-af49-9142ec72a546 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:52:00.048523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071837e6-289a-4316-af49-9142ec72a546 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:52:00.053133 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ed2d2-d463-4a08-ab68-e95b26f89a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:52:00.053783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ed2d2-d463-4a08-ab68-e95b26f89a58 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:52:00.054068 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ed2d2-d463-4a08-ab68-e95b26f89a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:52:00.054342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ed2d2-d463-4a08-ab68-e95b26f89a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:52:00.055064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ed2d2-d463-4a08-ab68-e95b26f89a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:52:00.056064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: WARNING py.warnings [None req-864ed2d2-d463-4a08-ab68-e95b26f89a58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:52:00.056064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: warnings.warn(msg) Jun 27 14:52:00.056064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: Jun 27 14:52:00.056969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ed2d2-d463-4a08-ab68-e95b26f89a58 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:52:00.071394 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 759/1500] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:52:00.075447 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16754fec-ff21-4871-803f-5724d0bcc57b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:52:00.085387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16754fec-ff21-4871-803f-5724d0bcc57b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:52:00.090080 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f531b25-a23f-4121-b82b-0f460ce05df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:52:00.091006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f531b25-a23f-4121-b82b-0f460ce05df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:52:00.091289 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f531b25-a23f-4121-b82b-0f460ce05df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:52:00.091562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f531b25-a23f-4121-b82b-0f460ce05df6 admin admin] PATH_INFO: `/v3/projects/1c91520142cd43d49ab65ad9c31c5f07/users/7c31dd68172b41569909b165e2fc10c5/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:52:00.107242 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f531b25-a23f-4121-b82b-0f460ce05df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c91520142cd43d49ab65ad9c31c5f07, user_id=7c31dd68172b41569909b165e2fc10c5, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:52:00.108098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: WARNING py.warnings [None req-1f531b25-a23f-4121-b82b-0f460ce05df6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:52:00.108098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: warnings.warn(msg) Jun 27 14:52:00.108098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: Jun 27 14:52:00.110039 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f531b25-a23f-4121-b82b-0f460ce05df6 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:52:00.163211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 742/1501] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:52:00 2022] PUT /identity/v3/projects/1c91520142cd43d49ab65ad9c31c5f07/users/7c31dd68172b41569909b165e2fc10c5/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:52:00.175096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36f502-1863-4d0f-8b53-898b59c28de9 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:52:00.175383 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36f502-1863-4d0f-8b53-898b59c28de9 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:52:00.175661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36f502-1863-4d0f-8b53-898b59c28de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:52:00.201896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-cf36f502-1863-4d0f-8b53-898b59c28de9 None None] MFA Rules not processed for user `7c31dd68172b41569909b165e2fc10c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:52:00.203023 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-cf36f502-1863-4d0f-8b53-898b59c28de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:52:00.265984 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 760/1502] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:52:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:52:00.280018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1203a2-5407-4e64-8066-d1cd8f65e686 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:52:00.280306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1203a2-5407-4e64-8066-d1cd8f65e686 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:52:00.280694 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1203a2-5407-4e64-8066-d1cd8f65e686 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:52:00.282177 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 743/1503] 10.222.0.44 () {54 vars in 963 bytes} [Mon Jun 27 14:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:52:00.286934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6351ec-2b25-48f4-b8f7-a905ba435024 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:52:00.290478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6351ec-2b25-48f4-b8f7-a905ba435024 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:52:00.290478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6351ec-2b25-48f4-b8f7-a905ba435024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:52:00.305697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-df6351ec-2b25-48f4-b8f7-a905ba435024 None None] MFA Rules not processed for user `015326e75ae14b778e4478627d07c17f`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:52:00.306925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-df6351ec-2b25-48f4-b8f7-a905ba435024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:52:00.351337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:52:00.359326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 761/1504] 10.222.0.44 () {58 vars in 1060 bytes} [Mon Jun 27 14:52:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:52:00.367012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1203a2-5407-4e64-8066-d1cd8f65e686 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:52:00.377585 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1203a2-5407-4e64-8066-d1cd8f65e686 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:52:00.381340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92119de7-350c-4004-a499-25edffdd0aeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:52:00.381964 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119de7-350c-4004-a499-25edffdd0aeb service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:52:00.382242 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119de7-350c-4004-a499-25edffdd0aeb service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:52:00.382513 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119de7-350c-4004-a499-25edffdd0aeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:52:00.390618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92119de7-350c-4004-a499-25edffdd0aeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:52:00.392042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92119de7-350c-4004-a499-25edffdd0aeb service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:52:00.400618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 744/1505] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:52:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:52:00.443027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ceb9e-9199-43fc-b113-eb14cf0ae8d6 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:52:00.443317 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ceb9e-9199-43fc-b113-eb14cf0ae8d6 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:52:00.443600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ceb9e-9199-43fc-b113-eb14cf0ae8d6 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:52:00.445202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 762/1506] 10.222.0.44 () {52 vars in 829 bytes} [Mon Jun 27 14:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:52:00.448767 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92119de7-350c-4004-a499-25edffdd0aeb service cinder] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:52:00.509472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92119de7-350c-4004-a499-25edffdd0aeb service cinder] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:52:00.513879 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6caee5-50dd-4497-8478-25d05e36d5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:52:00.514727 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6caee5-50dd-4497-8478-25d05e36d5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:52:00.515039 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6caee5-50dd-4497-8478-25d05e36d5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:52:00.515311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6caee5-50dd-4497-8478-25d05e36d5ce admin admin] PATH_INFO: `/v3/users/7c31dd68172b41569909b165e2fc10c5` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:52:00.516534 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6caee5-50dd-4497-8478-25d05e36d5ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c31dd68172b41569909b165e2fc10c5)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:52:00.517574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: WARNING py.warnings [None req-fc6caee5-50dd-4497-8478-25d05e36d5ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:52:00.517574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: warnings.warn(msg) Jun 27 14:52:00.517574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: Jun 27 14:52:00.518762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6caee5-50dd-4497-8478-25d05e36d5ce admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:52:00.701850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-fc6caee5-50dd-4497-8478-25d05e36d5ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c31dd68172b41569909b165e2fc10c5'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:52:00.720256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-fc6caee5-50dd-4497-8478-25d05e36d5ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c31dd68172b41569909b165e2fc10c5'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:52:00.797666 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-fc6caee5-50dd-4497-8478-25d05e36d5ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c31dd68172b41569909b165e2fc10c5'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:52:00.798311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-fc6caee5-50dd-4497-8478-25d05e36d5ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c31dd68172b41569909b165e2fc10c5'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:52:00.807531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:52:00.811956 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-fc6caee5-50dd-4497-8478-25d05e36d5ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c31dd68172b41569909b165e2fc10c5'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:52:00.817928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 745/1507] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:52:00 2022] DELETE /identity/v3/users/7c31dd68172b41569909b165e2fc10c5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:52:00.822509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2ccff-aae9-48d1-a568-a97b5b290beb None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:52:00.822972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2ccff-aae9-48d1-a568-a97b5b290beb None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:52:00.823077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2ccff-aae9-48d1-a568-a97b5b290beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:52:00.840694 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d5c2ccff-aae9-48d1-a568-a97b5b290beb None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:52:00.842769 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d5c2ccff-aae9-48d1-a568-a97b5b290beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:52:00.900327 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 763/1508] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:52:00.910038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6caee5-50dd-4497-8478-25d05e36d5ce admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:52:00.912715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-fc6caee5-50dd-4497-8478-25d05e36d5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:52:00.970613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6caee5-50dd-4497-8478-25d05e36d5ce admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:52:00.974132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d924b7-1dc5-42f7-8a9d-ae484fc15e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:52:00.974767 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d924b7-1dc5-42f7-8a9d-ae484fc15e61 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:52:00.975047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d924b7-1dc5-42f7-8a9d-ae484fc15e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:52:00.975318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d924b7-1dc5-42f7-8a9d-ae484fc15e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:52:00.984171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d924b7-1dc5-42f7-8a9d-ae484fc15e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:52:00.985603 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d924b7-1dc5-42f7-8a9d-ae484fc15e61 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:52:00.994808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 746/1509] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:52:01.668564 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2ccff-aae9-48d1-a568-a97b5b290beb None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:52:01.670657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d5c2ccff-aae9-48d1-a568-a97b5b290beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:52:01.683972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2ccff-aae9-48d1-a568-a97b5b290beb None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:52:01.694684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40fdf4-8be7-4935-bdfe-9204a9683338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:52:01.694684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40fdf4-8be7-4935-bdfe-9204a9683338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:52:01.694684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40fdf4-8be7-4935-bdfe-9204a9683338 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:52:01.694684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40fdf4-8be7-4935-bdfe-9204a9683338 admin admin] PATH_INFO: `/v3/projects/1c91520142cd43d49ab65ad9c31c5f07` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:52:01.695483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40fdf4-8be7-4935-bdfe-9204a9683338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c91520142cd43d49ab65ad9c31c5f07)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:52:01.695626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: WARNING py.warnings [None req-fd40fdf4-8be7-4935-bdfe-9204a9683338 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:52:01.695626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: warnings.warn(msg) Jun 27 14:52:01.695626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: Jun 27 14:52:01.696894 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40fdf4-8be7-4935-bdfe-9204a9683338 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:52:01.824795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fd40fdf4-8be7-4935-bdfe-9204a9683338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c91520142cd43d49ab65ad9c31c5f07', 'request_id': 'req-fd40fdf4-8be7-4935-bdfe-9204a9683338'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:52:01.838006 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fd40fdf4-8be7-4935-bdfe-9204a9683338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c91520142cd43d49ab65ad9c31c5f07', 'request_id': 'req-fd40fdf4-8be7-4935-bdfe-9204a9683338'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:52:01.888818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fd40fdf4-8be7-4935-bdfe-9204a9683338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c91520142cd43d49ab65ad9c31c5f07', 'request_id': 'req-fd40fdf4-8be7-4935-bdfe-9204a9683338'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:52:01.899936 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fd40fdf4-8be7-4935-bdfe-9204a9683338 admin admin] The token cache is being invalidate because project 1c91520142cd43d49ab65ad9c31c5f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:52:01.900217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fd40fdf4-8be7-4935-bdfe-9204a9683338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:52:01.901024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fd40fdf4-8be7-4935-bdfe-9204a9683338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:52:01.902647 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 764/1510] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:52:01 2022] DELETE /identity/v3/projects/1c91520142cd43d49ab65ad9c31c5f07 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:52:10.990687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=29 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:52:11.896752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:53:38.356924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe7c1d-41a4-47f0-85c5-324d2cb60f16 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:38.357493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe7c1d-41a4-47f0-85c5-324d2cb60f16 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:38.357493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe7c1d-41a4-47f0-85c5-324d2cb60f16 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:38.358940 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 14:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:53:38.364322 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37217fb0-10f0-48e3-aeb5-7f741b498950 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:38.364817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37217fb0-10f0-48e3-aeb5-7f741b498950 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:38.364921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37217fb0-10f0-48e3-aeb5-7f741b498950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:38.383097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-37217fb0-10f0-48e3-aeb5-7f741b498950 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:53:38.384282 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-37217fb0-10f0-48e3-aeb5-7f741b498950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:53:38.447046 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 14:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:53:38.602514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe7c1d-41a4-47f0-85c5-324d2cb60f16 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:53:38.604258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-fdbe7c1d-41a4-47f0-85c5-324d2cb60f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:53:38.677272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe7c1d-41a4-47f0-85c5-324d2cb60f16 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:53:38.682503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d5459-c27a-40a7-9e63-c831509d71d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:53:38.683137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d5459-c27a-40a7-9e63-c831509d71d1 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:38.683416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d5459-c27a-40a7-9e63-c831509d71d1 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:38.683687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d5459-c27a-40a7-9e63-c831509d71d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:38.691598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d5459-c27a-40a7-9e63-c831509d71d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:53:38.693455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d5459-c27a-40a7-9e63-c831509d71d1 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:53:38.702653 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 748/1513] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:53:39.525657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece229c-56e4-4165-8ceb-965ae62bd03a None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:39.526187 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece229c-56e4-4165-8ceb-965ae62bd03a None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:39.526292 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece229c-56e4-4165-8ceb-965ae62bd03a None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:39.527623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 14:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:53:39.533993 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425af5d2-1b0f-4c51-9516-b8c32838e80a None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:39.534450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425af5d2-1b0f-4c51-9516-b8c32838e80a None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:39.534565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425af5d2-1b0f-4c51-9516-b8c32838e80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:39.552131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-425af5d2-1b0f-4c51-9516-b8c32838e80a None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:53:39.553337 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-425af5d2-1b0f-4c51-9516-b8c32838e80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:53:39.561148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 14:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:53:39.714287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece229c-56e4-4165-8ceb-965ae62bd03a None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:53:39.728899 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece229c-56e4-4165-8ceb-965ae62bd03a None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:53:39.734443 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cc6c2-d5f8-455a-9281-962fd6c58b79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:53:39.735069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cc6c2-d5f8-455a-9281-962fd6c58b79 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:39.735351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cc6c2-d5f8-455a-9281-962fd6c58b79 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:39.735623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cc6c2-d5f8-455a-9281-962fd6c58b79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:39.743796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03cc6c2-d5f8-455a-9281-962fd6c58b79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:53:39.745543 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03cc6c2-d5f8-455a-9281-962fd6c58b79 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:53:39.755948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 767/1516] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:53:40.720583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e73f-1e8b-4c27-bc01-c3bf2c3c64dc None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:40.721192 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e73f-1e8b-4c27-bc01-c3bf2c3c64dc None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:40.721192 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e73f-1e8b-4c27-bc01-c3bf2c3c64dc None None] PATH_INFO: `/v3` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:40.722500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 750/1517] 10.222.0.50 () {54 vars in 925 bytes} [Mon Jun 27 14:53:40 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:53:40.744480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66fe98-03b2-4f7d-9311-adbe8ac0d16c None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:40.744982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66fe98-03b2-4f7d-9311-adbe8ac0d16c None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:40.745090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66fe98-03b2-4f7d-9311-adbe8ac0d16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:40.880000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-3e66fe98-03b2-4f7d-9311-adbe8ac0d16c None None] MFA Rules not processed for user `f3ced893407a484e8ed0c4918438edf0`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:53:40.881261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-3e66fe98-03b2-4f7d-9311-adbe8ac0d16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:53:40.942270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 768/1518] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Jun 27 14:53:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:53:49.547094 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=37 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:53:50.468138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2510c1c-618e-49cf-80f4-dd6064db9582 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:50.468425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2510c1c-618e-49cf-80f4-dd6064db9582 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:50.468736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2510c1c-618e-49cf-80f4-dd6064db9582 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:50.470108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 751/1519] 10.222.0.44 () {54 vars in 960 bytes} [Mon Jun 27 14:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:53:50.475124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71253d-7203-4eba-b049-ba250ef73a85 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:50.475612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71253d-7203-4eba-b049-ba250ef73a85 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:50.475744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71253d-7203-4eba-b049-ba250ef73a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:50.494291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-8d71253d-7203-4eba-b049-ba250ef73a85 None None] MFA Rules not processed for user `f3ced893407a484e8ed0c4918438edf0`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:53:50.495482 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-8d71253d-7203-4eba-b049-ba250ef73a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:53:50.503910 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 769/1520] 10.222.0.44 () {58 vars in 1057 bytes} [Mon Jun 27 14:53:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:53:50.511278 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2510c1c-618e-49cf-80f4-dd6064db9582 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:53:50.524525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2510c1c-618e-49cf-80f4-dd6064db9582 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:53:50.530037 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859503c-8646-415a-ba4f-4006c7cf613e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:53:50.530662 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859503c-8646-415a-ba4f-4006c7cf613e service placement] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:50.530942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859503c-8646-415a-ba4f-4006c7cf613e service placement] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:50.531213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859503c-8646-415a-ba4f-4006c7cf613e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:50.539341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859503c-8646-415a-ba4f-4006c7cf613e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:53:50.540951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859503c-8646-415a-ba4f-4006c7cf613e service placement] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:53:50.551118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 752/1521] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:53:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:53:51.021472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4c08d-a6bd-4e38-b167-31456f1dd648 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:51.021759 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4c08d-a6bd-4e38-b167-31456f1dd648 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:51.022063 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4c08d-a6bd-4e38-b167-31456f1dd648 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:51.023429 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 14:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:53:51.028387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05a24d-d90f-402b-a909-646cd1207c59 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:51.037828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05a24d-d90f-402b-a909-646cd1207c59 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:51.037828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05a24d-d90f-402b-a909-646cd1207c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:51.047942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-bb05a24d-d90f-402b-a909-646cd1207c59 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:53:51.049168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-bb05a24d-d90f-402b-a909-646cd1207c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:53:51.056951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 14:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:53:51.209169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4c08d-a6bd-4e38-b167-31456f1dd648 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:53:51.224427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4c08d-a6bd-4e38-b167-31456f1dd648 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:53:51.229802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac0a21-a301-431b-80ed-c5c7eec2ff07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:53:51.230435 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac0a21-a301-431b-80ed-c5c7eec2ff07 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:51.230713 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac0a21-a301-431b-80ed-c5c7eec2ff07 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:51.230984 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac0a21-a301-431b-80ed-c5c7eec2ff07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:51.240129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac0a21-a301-431b-80ed-c5c7eec2ff07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:53:51.241738 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac0a21-a301-431b-80ed-c5c7eec2ff07 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:53:51.251935 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 771/1524] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:53:52.102874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889ebd8-447c-45d6-af06-6e5e2bcdd0c8 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:52.103440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889ebd8-447c-45d6-af06-6e5e2bcdd0c8 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:52.103543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889ebd8-447c-45d6-af06-6e5e2bcdd0c8 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:52.104959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 14:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:53:52.111145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49414cfa-c587-439a-96c8-7c27e5c3bafa None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:52.111617 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49414cfa-c587-439a-96c8-7c27e5c3bafa None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:52.111724 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49414cfa-c587-439a-96c8-7c27e5c3bafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:52.129224 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-49414cfa-c587-439a-96c8-7c27e5c3bafa None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:53:52.130404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-49414cfa-c587-439a-96c8-7c27e5c3bafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:53:52.138040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 14:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:53:52.294191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889ebd8-447c-45d6-af06-6e5e2bcdd0c8 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:53:52.308786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889ebd8-447c-45d6-af06-6e5e2bcdd0c8 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:53:52.314430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb8f1a-d61e-404d-8688-cc511898d205 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:53:52.315062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb8f1a-d61e-404d-8688-cc511898d205 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:52.315346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb8f1a-d61e-404d-8688-cc511898d205 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:52.315621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb8f1a-d61e-404d-8688-cc511898d205 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:52.324015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb8f1a-d61e-404d-8688-cc511898d205 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:53:52.325607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb8f1a-d61e-404d-8688-cc511898d205 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:53:52.335678 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 755/1527] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:53:56.383418 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd74339-c3c1-437d-8432-89b42cc2767d None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:56.383983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd74339-c3c1-437d-8432-89b42cc2767d None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:56.383983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd74339-c3c1-437d-8432-89b42cc2767d None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:56.385250 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 14:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:53:56.390933 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b20a8-1088-42f3-b748-05cd67521fc9 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:56.391395 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b20a8-1088-42f3-b748-05cd67521fc9 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:56.391508 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b20a8-1088-42f3-b748-05cd67521fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:56.409949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-2c1b20a8-1088-42f3-b748-05cd67521fc9 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:53:56.411137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2c1b20a8-1088-42f3-b748-05cd67521fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:53:56.418781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:53:56.455947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd74339-c3c1-437d-8432-89b42cc2767d None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:53:56.457681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1fd74339-c3c1-437d-8432-89b42cc2767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:53:56.513718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd74339-c3c1-437d-8432-89b42cc2767d None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:53:56.517224 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308e398-e58e-438d-8931-7665793b165d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:53:56.517858 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308e398-e58e-438d-8931-7665793b165d service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:56.518140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308e398-e58e-438d-8931-7665793b165d service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:56.518411 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308e398-e58e-438d-8931-7665793b165d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:56.527454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308e398-e58e-438d-8931-7665793b165d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:53:56.529445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308e398-e58e-438d-8931-7665793b165d service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:53:56.534580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:53:56.539323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 774/1530] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:53:58.567459 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3436fca-e6fd-4690-9ba6-8fd68aed0564 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:58.568331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3436fca-e6fd-4690-9ba6-8fd68aed0564 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:58.568331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3436fca-e6fd-4690-9ba6-8fd68aed0564 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:58.569657 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 14:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:53:58.574826 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a86e2-a167-484c-a389-48355d02a3ab None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:58.575282 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a86e2-a167-484c-a389-48355d02a3ab None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:58.575401 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a86e2-a167-484c-a389-48355d02a3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:58.594583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-c99a86e2-a167-484c-a389-48355d02a3ab None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:53:58.595763 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-c99a86e2-a167-484c-a389-48355d02a3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:53:58.603490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:53:58.640432 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3436fca-e6fd-4690-9ba6-8fd68aed0564 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:53:58.651008 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3436fca-e6fd-4690-9ba6-8fd68aed0564 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:53:58.654467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7385c-af1e-4ba5-a6ed-fa00cb588add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:53:58.655092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7385c-af1e-4ba5-a6ed-fa00cb588add service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:53:58.655369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7385c-af1e-4ba5-a6ed-fa00cb588add service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:53:58.655641 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7385c-af1e-4ba5-a6ed-fa00cb588add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:53:58.664421 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7385c-af1e-4ba5-a6ed-fa00cb588add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:53:58.665869 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7385c-af1e-4ba5-a6ed-fa00cb588add service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:53:58.675025 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 758/1533] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:54:02.313573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688e6b0-2f6b-446e-91c6-02f8d3ca2b69 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:54:02.314113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688e6b0-2f6b-446e-91c6-02f8d3ca2b69 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:54:02.314113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688e6b0-2f6b-446e-91c6-02f8d3ca2b69 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:54:02.315469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 14:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:54:02.320869 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3be968-539f-4f06-997d-47fc244aaf35 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:54:02.321290 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3be968-539f-4f06-997d-47fc244aaf35 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:54:02.321406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3be968-539f-4f06-997d-47fc244aaf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:54:02.339713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-7b3be968-539f-4f06-997d-47fc244aaf35 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:54:02.340932 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7b3be968-539f-4f06-997d-47fc244aaf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:54:02.349523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 14:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:54:02.649655 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688e6b0-2f6b-446e-91c6-02f8d3ca2b69 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:54:02.651328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e688e6b0-2f6b-446e-91c6-02f8d3ca2b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:54:02.710641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688e6b0-2f6b-446e-91c6-02f8d3ca2b69 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:54:02.716890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fcba5-6628-44f8-a296-8b130c11276f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:54:02.716890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fcba5-6628-44f8-a296-8b130c11276f service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:54:02.716890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fcba5-6628-44f8-a296-8b130c11276f service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:54:02.716890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fcba5-6628-44f8-a296-8b130c11276f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:54:02.724355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fcba5-6628-44f8-a296-8b130c11276f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:54:02.725797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fcba5-6628-44f8-a296-8b130c11276f service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:54:02.736103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 777/1536] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:54:04.782226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc841b5-d5c3-493c-8aa5-a4167dcd641d None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:54:04.782906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc841b5-d5c3-493c-8aa5-a4167dcd641d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:54:04.782906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc841b5-d5c3-493c-8aa5-a4167dcd641d None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:54:04.784157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 14:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:54:04.789222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128ec9c-6501-429c-8155-44d978b63974 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:54:04.789655 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128ec9c-6501-429c-8155-44d978b63974 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:54:04.789777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128ec9c-6501-429c-8155-44d978b63974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:54:04.808149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-5128ec9c-6501-429c-8155-44d978b63974 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:54:04.809364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-5128ec9c-6501-429c-8155-44d978b63974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:54:04.817315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 14:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:54:05.117972 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc841b5-d5c3-493c-8aa5-a4167dcd641d None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:54:05.119673 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-cdc841b5-d5c3-493c-8aa5-a4167dcd641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:54:05.132484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc841b5-d5c3-493c-8aa5-a4167dcd641d None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:54:05.135902 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61941e-5230-4140-924e-799f2c5026eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:54:05.136525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61941e-5230-4140-924e-799f2c5026eb service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:54:05.136843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61941e-5230-4140-924e-799f2c5026eb service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:54:05.137113 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61941e-5230-4140-924e-799f2c5026eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:54:05.146447 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61941e-5230-4140-924e-799f2c5026eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:54:05.147841 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61941e-5230-4140-924e-799f2c5026eb service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:54:05.157789 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 761/1539] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:54:14.803530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=32 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:54:15.152957 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=33 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:35.242601 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a6d4b-64c0-465b-ad17-c5972d0a7828 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.243225 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a6d4b-64c0-465b-ad17-c5972d0a7828 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.243225 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a6d4b-64c0-465b-ad17-c5972d0a7828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.273943 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-de2a6d4b-64c0-465b-ad17-c5972d0a7828 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.275200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-de2a6d4b-64c0-465b-ad17-c5972d0a7828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.284061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 779/1540] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.293465 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba47da3-abe0-4012-a0a5-2e92f72cdac2 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.294661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba47da3-abe0-4012-a0a5-2e92f72cdac2 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.295206 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba47da3-abe0-4012-a0a5-2e92f72cdac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.328900 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-7ba47da3-abe0-4012-a0a5-2e92f72cdac2 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.330647 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7ba47da3-abe0-4012-a0a5-2e92f72cdac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.343975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 762/1541] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.348480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a6d4b-64c0-465b-ad17-c5972d0a7828 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:35.362658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a6d4b-64c0-465b-ad17-c5972d0a7828 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:35.373018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5431b-f957-4290-a14f-e91ed9c938fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:35.373879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5431b-f957-4290-a14f-e91ed9c938fa admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.374168 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5431b-f957-4290-a14f-e91ed9c938fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.374446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5431b-f957-4290-a14f-e91ed9c938fa admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.375185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5431b-f957-4290-a14f-e91ed9c938fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:55:35.375506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5431b-f957-4290-a14f-e91ed9c938fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:35.377116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5431b-f957-4290-a14f-e91ed9c938fa admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:35.396495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 780/1542] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:55:35.405453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba47da3-abe0-4012-a0a5-2e92f72cdac2 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:35.415800 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba47da3-abe0-4012-a0a5-2e92f72cdac2 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:35.425823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0feea-f0b5-4de2-a3bf-9161b21a3feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:35.427019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0feea-f0b5-4de2-a3bf-9161b21a3feb admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.427539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0feea-f0b5-4de2-a3bf-9161b21a3feb admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.428083 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0feea-f0b5-4de2-a3bf-9161b21a3feb admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.429131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0feea-f0b5-4de2-a3bf-9161b21a3feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:35.431260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0feea-f0b5-4de2-a3bf-9161b21a3feb admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:35.488781 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b4b87-de19-4e6d-8f64-591e9483982e None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.489106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b4b87-de19-4e6d-8f64-591e9483982e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.489347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b4b87-de19-4e6d-8f64-591e9483982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.521204 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-fa9b4b87-de19-4e6d-8f64-591e9483982e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.522389 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-fa9b4b87-de19-4e6d-8f64-591e9483982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.534676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 763/1544] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:35.535384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 781/1544] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.540409 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b4b87-de19-4e6d-8f64-591e9483982e None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:35.547775 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88637e8e-577e-4dd4-a7b4-8a6214be701e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.548475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88637e8e-577e-4dd4-a7b4-8a6214be701e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.549018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88637e8e-577e-4dd4-a7b4-8a6214be701e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.553768 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b4b87-de19-4e6d-8f64-591e9483982e None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:35.575311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-88637e8e-577e-4dd4-a7b4-8a6214be701e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.579401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-88637e8e-577e-4dd4-a7b4-8a6214be701e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.633208 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1643a70-ee9f-4625-beab-98d2f3bf3baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:35.633975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1643a70-ee9f-4625-beab-98d2f3bf3baf admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.634264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1643a70-ee9f-4625-beab-98d2f3bf3baf admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.634696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1643a70-ee9f-4625-beab-98d2f3bf3baf admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.635679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1643a70-ee9f-4625-beab-98d2f3bf3baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:35.637719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1643a70-ee9f-4625-beab-98d2f3bf3baf admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:35.658925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 764/1545] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.661546 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1331c16-db56-4601-b294-00667c8bd99f None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.661546 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1331c16-db56-4601-b294-00667c8bd99f None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.661546 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1331c16-db56-4601-b294-00667c8bd99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.678224 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f1331c16-db56-4601-b294-00667c8bd99f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.679432 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f1331c16-db56-4601-b294-00667c8bd99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.687351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 765/1546] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.690283 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca5f61-50b0-45d5-ad69-d7df0b173133 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.690283 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca5f61-50b0-45d5-ad69-d7df0b173133 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.690283 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca5f61-50b0-45d5-ad69-d7df0b173133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.706774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-01ca5f61-50b0-45d5-ad69-d7df0b173133 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.707920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-01ca5f61-50b0-45d5-ad69-d7df0b173133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.715563 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 766/1547] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.716026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 782/1548] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:35.716890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d169e1-3e55-46d5-a5cc-bee230632230 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.717143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d169e1-3e55-46d5-a5cc-bee230632230 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.717290 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9046bd-d495-4505-af6a-ecb35f7e0df3 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.717410 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d169e1-3e55-46d5-a5cc-bee230632230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.719257 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9046bd-d495-4505-af6a-ecb35f7e0df3 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.719257 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9046bd-d495-4505-af6a-ecb35f7e0df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.739342 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-47d169e1-3e55-46d5-a5cc-bee230632230 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.740517 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-47d169e1-3e55-46d5-a5cc-bee230632230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.741190 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-2e9046bd-d495-4505-af6a-ecb35f7e0df3 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.742343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2e9046bd-d495-4505-af6a-ecb35f7e0df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.748724 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 767/1549] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.750148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c75f1-3a26-48ad-86d3-da3195bf206d None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.750497 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c75f1-3a26-48ad-86d3-da3195bf206d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.750785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c75f1-3a26-48ad-86d3-da3195bf206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.757258 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 783/1550] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.758530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea698d-699f-466c-a39d-b7593f5a5e94 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.758882 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea698d-699f-466c-a39d-b7593f5a5e94 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.759082 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea698d-699f-466c-a39d-b7593f5a5e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.774118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-4c4c75f1-3a26-48ad-86d3-da3195bf206d None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.775286 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-4c4c75f1-3a26-48ad-86d3-da3195bf206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.777002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1dea698d-699f-466c-a39d-b7593f5a5e94 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.778165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1dea698d-699f-466c-a39d-b7593f5a5e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.784409 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 768/1551] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.791659 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c75f1-3a26-48ad-86d3-da3195bf206d None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:35.794083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 784/1552] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.795295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd261f25-aaad-4444-9200-0c7408ce8c14 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.795576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd261f25-aaad-4444-9200-0c7408ce8c14 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.795849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd261f25-aaad-4444-9200-0c7408ce8c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.800217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c75f1-3a26-48ad-86d3-da3195bf206d None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:35.805924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b4aa-1f06-4532-8b19-571fc1310f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:35.806576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b4aa-1f06-4532-8b19-571fc1310f1d admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.806855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b4aa-1f06-4532-8b19-571fc1310f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.807122 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b4aa-1f06-4532-8b19-571fc1310f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.807878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13b4aa-1f06-4532-8b19-571fc1310f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:55:35.808184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13b4aa-1f06-4532-8b19-571fc1310f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:35.809225 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: WARNING py.warnings [None req-2f13b4aa-1f06-4532-8b19-571fc1310f1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:55:35.809225 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: warnings.warn(msg) Jun 27 14:55:35.809225 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: Jun 27 14:55:35.810107 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13b4aa-1f06-4532-8b19-571fc1310f1d admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:35.813741 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-fd261f25-aaad-4444-9200-0c7408ce8c14 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.814969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-fd261f25-aaad-4444-9200-0c7408ce8c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.829789 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 769/1553] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:55:35.829789 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b4aa-1f06-4532-8b19-571fc1310f1d admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:35.830060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 785/1554] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.830060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54248b0-45cc-4aa6-af64-2828008cb5ee None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.830060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54248b0-45cc-4aa6-af64-2828008cb5ee None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.830060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54248b0-45cc-4aa6-af64-2828008cb5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.836911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b4aa-1f06-4532-8b19-571fc1310f1d admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:35.841421 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a56451-9abd-4d8d-91a2-7003917dd103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:35.842623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a56451-9abd-4d8d-91a2-7003917dd103 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.842908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a56451-9abd-4d8d-91a2-7003917dd103 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.843185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a56451-9abd-4d8d-91a2-7003917dd103 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.843909 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a56451-9abd-4d8d-91a2-7003917dd103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:35.845520 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a56451-9abd-4d8d-91a2-7003917dd103 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:35.847179 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a54248b0-45cc-4aa6-af64-2828008cb5ee None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.848361 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a54248b0-45cc-4aa6-af64-2828008cb5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.855930 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 770/1555] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:35.856318 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 786/1556] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.857247 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664b349-b946-4900-b037-1664702226bc None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.857576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664b349-b946-4900-b037-1664702226bc None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.857853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664b349-b946-4900-b037-1664702226bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.860213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a96d61-8462-4abf-9a2b-532edbd29dea None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.860545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a96d61-8462-4abf-9a2b-532edbd29dea None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.860866 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a96d61-8462-4abf-9a2b-532edbd29dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.874661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b664b349-b946-4900-b037-1664702226bc None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.875863 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b664b349-b946-4900-b037-1664702226bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.878335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a0a96d61-8462-4abf-9a2b-532edbd29dea None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.879475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a0a96d61-8462-4abf-9a2b-532edbd29dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.884087 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 771/1557] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.885163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9234a-108f-4468-bbaa-c19c28bf006f None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.885454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9234a-108f-4468-bbaa-c19c28bf006f None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.885835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9234a-108f-4468-bbaa-c19c28bf006f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.891719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 787/1558] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.892975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf380f-07f9-4e15-8fa9-d086e57e5fb5 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.893396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf380f-07f9-4e15-8fa9-d086e57e5fb5 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.893676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf380f-07f9-4e15-8fa9-d086e57e5fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.904050 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-2db9234a-108f-4468-bbaa-c19c28bf006f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.905886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2db9234a-108f-4468-bbaa-c19c28bf006f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.911950 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-b7bf380f-07f9-4e15-8fa9-d086e57e5fb5 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:35.913120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b7bf380f-07f9-4e15-8fa9-d086e57e5fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:35.913663 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 772/1559] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.914435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9234a-108f-4468-bbaa-c19c28bf006f None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:35.923281 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 788/1560] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:35.924030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf380f-07f9-4e15-8fa9-d086e57e5fb5 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:35.927674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9234a-108f-4468-bbaa-c19c28bf006f None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:35.932272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d3d0f-bc1f-4f90-9570-20f3da7d1fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:35.933057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3d0f-bc1f-4f90-9570-20f3da7d1fbb admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.933204 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf380f-07f9-4e15-8fa9-d086e57e5fb5 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:35.933334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3d0f-bc1f-4f90-9570-20f3da7d1fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.933603 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3d0f-bc1f-4f90-9570-20f3da7d1fbb admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.934347 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d3d0f-bc1f-4f90-9570-20f3da7d1fbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:55:35.934647 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d3d0f-bc1f-4f90-9570-20f3da7d1fbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:35.936394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d3d0f-bc1f-4f90-9570-20f3da7d1fbb admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:35.937879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db599d6-9207-41ae-950f-eaca6f3a977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:35.938512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db599d6-9207-41ae-950f-eaca6f3a977a admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.938802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db599d6-9207-41ae-950f-eaca6f3a977a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.939076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db599d6-9207-41ae-950f-eaca6f3a977a admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.939764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db599d6-9207-41ae-950f-eaca6f3a977a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:35.940833 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: WARNING py.warnings [None req-9db599d6-9207-41ae-950f-eaca6f3a977a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:55:35.940833 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: warnings.warn(msg) Jun 27 14:55:35.940833 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: Jun 27 14:55:35.942260 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db599d6-9207-41ae-950f-eaca6f3a977a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:35.948336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 773/1561] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:55:35.949309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d3d0f-bc1f-4f90-9570-20f3da7d1fbb admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:35.959732 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d3d0f-bc1f-4f90-9570-20f3da7d1fbb admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:35.964309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f2fc7-408d-45e7-b4f6-e8fb7c8415b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:35.964992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f2fc7-408d-45e7-b4f6-e8fb7c8415b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.965276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f2fc7-408d-45e7-b4f6-e8fb7c8415b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.965553 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f2fc7-408d-45e7-b4f6-e8fb7c8415b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.966291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f2fc7-408d-45e7-b4f6-e8fb7c8415b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:35.968812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f2fc7-408d-45e7-b4f6-e8fb7c8415b1 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:35.979063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 774/1562] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:35.979973 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f2fc7-408d-45e7-b4f6-e8fb7c8415b1 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:35.989346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f2fc7-408d-45e7-b4f6-e8fb7c8415b1 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:35.993800 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2c8d1-f1f8-4874-ad83-867f4be061f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:35.994431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2c8d1-f1f8-4874-ad83-867f4be061f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:35.994713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2c8d1-f1f8-4874-ad83-867f4be061f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:35.994986 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2c8d1-f1f8-4874-ad83-867f4be061f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:35.995681 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2c8d1-f1f8-4874-ad83-867f4be061f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:55:35.995982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2c8d1-f1f8-4874-ad83-867f4be061f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:35.997530 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2c8d1-f1f8-4874-ad83-867f4be061f9 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:36.009141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 775/1563] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:55:36.010020 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2c8d1-f1f8-4874-ad83-867f4be061f9 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:36.020352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2c8d1-f1f8-4874-ad83-867f4be061f9 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:36.028198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbbddb-9fb7-4435-95ed-97fb2d583e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:36.028198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbbddb-9fb7-4435-95ed-97fb2d583e8e admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:36.028198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbbddb-9fb7-4435-95ed-97fb2d583e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:36.028198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbbddb-9fb7-4435-95ed-97fb2d583e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:36.028601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbbddb-9fb7-4435-95ed-97fb2d583e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:55:36.028601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbbddb-9fb7-4435-95ed-97fb2d583e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:36.028817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbbddb-9fb7-4435-95ed-97fb2d583e8e admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:36.040545 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 776/1564] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:55:36.041358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbbddb-9fb7-4435-95ed-97fb2d583e8e admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:36.051256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbbddb-9fb7-4435-95ed-97fb2d583e8e admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:36.056368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 789/1565] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:35 2022] POST /identity/v3/projects => generated 393 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:36.056493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238ac2d-0c77-4373-aab2-bd34cc5cd06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:36.056603 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db599d6-9207-41ae-950f-eaca6f3a977a admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:36.056733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238ac2d-0c77-4373-aab2-bd34cc5cd06b admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:36.056733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238ac2d-0c77-4373-aab2-bd34cc5cd06b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:36.056929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238ac2d-0c77-4373-aab2-bd34cc5cd06b admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:36.057641 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238ac2d-0c77-4373-aab2-bd34cc5cd06b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:55:36.057950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238ac2d-0c77-4373-aab2-bd34cc5cd06b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:36.059754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238ac2d-0c77-4373-aab2-bd34cc5cd06b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:36.079699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 777/1566] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:55:36.079699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238ac2d-0c77-4373-aab2-bd34cc5cd06b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:36.082126 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:36.086603 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238ac2d-0c77-4373-aab2-bd34cc5cd06b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:36.125885 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db599d6-9207-41ae-950f-eaca6f3a977a admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:36.130702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed55ef8-07d9-48e3-a552-72cd040da075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:36.131408 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed55ef8-07d9-48e3-a552-72cd040da075 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:36.131714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed55ef8-07d9-48e3-a552-72cd040da075 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:36.131994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed55ef8-07d9-48e3-a552-72cd040da075 admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:36.132751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed55ef8-07d9-48e3-a552-72cd040da075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:55:36.133060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed55ef8-07d9-48e3-a552-72cd040da075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:36.134660 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed55ef8-07d9-48e3-a552-72cd040da075 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:36.137262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:36.143990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8128c-cc33-4790-b320-567332fce19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:36.144725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8128c-cc33-4790-b320-567332fce19e admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:36.145010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8128c-cc33-4790-b320-567332fce19e admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:36.145281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8128c-cc33-4790-b320-567332fce19e admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:36.145997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8128c-cc33-4790-b320-567332fce19e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:55:36.146300 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8128c-cc33-4790-b320-567332fce19e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:36.147873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8128c-cc33-4790-b320-567332fce19e admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:36.148376 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 790/1567] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:55:36.149373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed55ef8-07d9-48e3-a552-72cd040da075 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:36.160965 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 778/1568] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:55:36.160965 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8128c-cc33-4790-b320-567332fce19e admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:36.172413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed55ef8-07d9-48e3-a552-72cd040da075 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:36.172413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb77d8-b9dd-4a8c-a97e-fb7d441371be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:36.172413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb77d8-b9dd-4a8c-a97e-fb7d441371be admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:36.172413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb77d8-b9dd-4a8c-a97e-fb7d441371be admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:36.173114 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb77d8-b9dd-4a8c-a97e-fb7d441371be admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:36.173114 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb77d8-b9dd-4a8c-a97e-fb7d441371be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:36.173278 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8128c-cc33-4790-b320-567332fce19e admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:36.173376 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb77d8-b9dd-4a8c-a97e-fb7d441371be admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:36.176605 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc355b-8d25-4225-9977-c0814dd3a0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:36.177565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc355b-8d25-4225-9977-c0814dd3a0b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:36.177862 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc355b-8d25-4225-9977-c0814dd3a0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:36.178115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc355b-8d25-4225-9977-c0814dd3a0b1 admin admin] PATH_INFO: `/v3/projects/3d96ee908883411d9838f850ee7dd66b/users/d93abd4361d240919ec85cf4b92347fb/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:36.193755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc355b-8d25-4225-9977-c0814dd3a0b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d96ee908883411d9838f850ee7dd66b, user_id=d93abd4361d240919ec85cf4b92347fb, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:36.196480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc355b-8d25-4225-9977-c0814dd3a0b1 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:36.258401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 779/1569] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:36 2022] PUT /identity/v3/projects/3d96ee908883411d9838f850ee7dd66b/users/d93abd4361d240919ec85cf4b92347fb/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:36.259180 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc355b-8d25-4225-9977-c0814dd3a0b1 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:36.288615 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 791/1570] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:36 2022] POST /identity/v3/projects => generated 405 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:36.288615 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb77d8-b9dd-4a8c-a97e-fb7d441371be admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:36.322704 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc355b-8d25-4225-9977-c0814dd3a0b1 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:36.348179 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb77d8-b9dd-4a8c-a97e-fb7d441371be admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:36.353257 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0552f-90a7-46cb-a3a0-a3a2523208d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:36.354002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0552f-90a7-46cb-a3a0-a3a2523208d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:36.354284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0552f-90a7-46cb-a3a0-a3a2523208d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:36.354554 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0552f-90a7-46cb-a3a0-a3a2523208d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:36.355239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0552f-90a7-46cb-a3a0-a3a2523208d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:36.357221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0552f-90a7-46cb-a3a0-a3a2523208d3 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:36.443273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 792/1571] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:36 2022] POST /identity/v3/projects => generated 405 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:36.444085 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0552f-90a7-46cb-a3a0-a3a2523208d3 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:36.461281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96f746-00c4-4e2c-a6fa-0c0d791b5b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:36.462220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96f746-00c4-4e2c-a6fa-0c0d791b5b3c admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:36.462500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96f746-00c4-4e2c-a6fa-0c0d791b5b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:36.462779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96f746-00c4-4e2c-a6fa-0c0d791b5b3c admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:36.463465 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96f746-00c4-4e2c-a6fa-0c0d791b5b3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:36.465381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96f746-00c4-4e2c-a6fa-0c0d791b5b3c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:36.506546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0552f-90a7-46cb-a3a0-a3a2523208d3 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:36.511214 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a85e5-bacf-415d-aa37-771527e074f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:36.511868 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a85e5-bacf-415d-aa37-771527e074f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:36.512147 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a85e5-bacf-415d-aa37-771527e074f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:36.512417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a85e5-bacf-415d-aa37-771527e074f0 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:36.513180 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a85e5-bacf-415d-aa37-771527e074f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:36.518127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a85e5-bacf-415d-aa37-771527e074f0 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:36.573757 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 780/1572] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:36 2022] POST /identity/v3/projects => generated 361 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:36.574492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96f746-00c4-4e2c-a6fa-0c0d791b5b3c admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:36.582734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:36.601202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 793/1573] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:36 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:36.602497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a85e5-bacf-415d-aa37-771527e074f0 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:36.613744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a85e5-bacf-415d-aa37-771527e074f0 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:36.638778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96f746-00c4-4e2c-a6fa-0c0d791b5b3c admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:36.643427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7267807-609e-4dad-a2eb-4a07b2a6cea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:36.644084 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267807-609e-4dad-a2eb-4a07b2a6cea3 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:36.644372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267807-609e-4dad-a2eb-4a07b2a6cea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:36.644772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267807-609e-4dad-a2eb-4a07b2a6cea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:36.645472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7267807-609e-4dad-a2eb-4a07b2a6cea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:36.647423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7267807-609e-4dad-a2eb-4a07b2a6cea3 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:36.660799 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:36.673537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89187403-71a2-4560-b574-555afd9ed7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:36.674190 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89187403-71a2-4560-b574-555afd9ed7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:36.674479 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89187403-71a2-4560-b574-555afd9ed7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:36.674757 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89187403-71a2-4560-b574-555afd9ed7a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:36.675449 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89187403-71a2-4560-b574-555afd9ed7a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:36.677383 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89187403-71a2-4560-b574-555afd9ed7a6 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:36.739658 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 781/1574] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:36 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:36.740465 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7267807-609e-4dad-a2eb-4a07b2a6cea3 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:36.798002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 794/1575] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:36 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:36.799423 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63531068-2ae7-4c90-8dc0-12f1f0310260 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:36.799714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63531068-2ae7-4c90-8dc0-12f1f0310260 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:36.799992 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63531068-2ae7-4c90-8dc0-12f1f0310260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:36.801626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7267807-609e-4dad-a2eb-4a07b2a6cea3 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:36.817559 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-63531068-2ae7-4c90-8dc0-12f1f0310260 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:36.818765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-63531068-2ae7-4c90-8dc0-12f1f0310260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:36.859712 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28ebad-c40a-428c-8812-7d881d88508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:36.860671 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28ebad-c40a-428c-8812-7d881d88508f admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:36.860988 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28ebad-c40a-428c-8812-7d881d88508f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:36.861262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28ebad-c40a-428c-8812-7d881d88508f admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:36.861945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28ebad-c40a-428c-8812-7d881d88508f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:36.863849 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28ebad-c40a-428c-8812-7d881d88508f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:36.878996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 795/1576] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:36.879919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63531068-2ae7-4c90-8dc0-12f1f0310260 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:36.889435 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63531068-2ae7-4c90-8dc0-12f1f0310260 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:36.893992 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e8b2c-8d81-45a6-9c1f-a85863fe0ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:36.894646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e8b2c-8d81-45a6-9c1f-a85863fe0ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:36.894928 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e8b2c-8d81-45a6-9c1f-a85863fe0ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:36.895221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e8b2c-8d81-45a6-9c1f-a85863fe0ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:36.895923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e8b2c-8d81-45a6-9c1f-a85863fe0ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:36.897847 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e8b2c-8d81-45a6-9c1f-a85863fe0ae6 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:36.965751 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 782/1577] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:36 2022] POST /identity/v3/projects => generated 379 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:36.965751 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28ebad-c40a-428c-8812-7d881d88508f admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:36.991291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:36.999120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 796/1578] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:36 2022] POST /identity/v3/users => generated 303 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:36.999120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e8b2c-8d81-45a6-9c1f-a85863fe0ae6 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.007388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e8b2c-8d81-45a6-9c1f-a85863fe0ae6 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.024381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28ebad-c40a-428c-8812-7d881d88508f admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.029069 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51662e00-6f5f-402e-aec0-076e74d3bf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.030244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51662e00-6f5f-402e-aec0-076e74d3bf2b admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.030526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51662e00-6f5f-402e-aec0-076e74d3bf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.030794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51662e00-6f5f-402e-aec0-076e74d3bf2b admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.031479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51662e00-6f5f-402e-aec0-076e74d3bf2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.032486 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: WARNING py.warnings [None req-51662e00-6f5f-402e-aec0-076e74d3bf2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:55:37.032486 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: warnings.warn(msg) Jun 27 14:55:37.032486 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: Jun 27 14:55:37.033710 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51662e00-6f5f-402e-aec0-076e74d3bf2b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.063467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380403cd-466a-40ba-b857-8358f0b832a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.064131 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380403cd-466a-40ba-b857-8358f0b832a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.064411 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380403cd-466a-40ba-b857-8358f0b832a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.064714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380403cd-466a-40ba-b857-8358f0b832a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.065401 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380403cd-466a-40ba-b857-8358f0b832a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.067604 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380403cd-466a-40ba-b857-8358f0b832a4 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.128506 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 783/1579] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:36 2022] POST /identity/v3/users => generated 303 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:37.129310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51662e00-6f5f-402e-aec0-076e74d3bf2b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.139663 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51662e00-6f5f-402e-aec0-076e74d3bf2b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.144154 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c1dfb-f021-443c-868b-c4039d7f7ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.144814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c1dfb-f021-443c-868b-c4039d7f7ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.145098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c1dfb-f021-443c-868b-c4039d7f7ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.145370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c1dfb-f021-443c-868b-c4039d7f7ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.146085 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c1dfb-f021-443c-868b-c4039d7f7ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.147686 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c1dfb-f021-443c-868b-c4039d7f7ae6 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.157305 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 797/1580] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:36 2022] POST /identity/v3/users => generated 281 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:37.157305 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380403cd-466a-40ba-b857-8358f0b832a4 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.160243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 784/1581] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:37.160243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c1dfb-f021-443c-868b-c4039d7f7ae6 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.167395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380403cd-466a-40ba-b857-8358f0b832a4 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.169075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c1dfb-f021-443c-868b-c4039d7f7ae6 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.171855 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b29819-6e1f-4829-a22d-ec18a5c436d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.172503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b29819-6e1f-4829-a22d-ec18a5c436d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.172819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b29819-6e1f-4829-a22d-ec18a5c436d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.173092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b29819-6e1f-4829-a22d-ec18a5c436d2 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.173771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b29819-6e1f-4829-a22d-ec18a5c436d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.173883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9a34c-f60f-464a-9d8c-7f29fc5858eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.174463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9a34c-f60f-464a-9d8c-7f29fc5858eb admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.174747 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9a34c-f60f-464a-9d8c-7f29fc5858eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.175019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9a34c-f60f-464a-9d8c-7f29fc5858eb admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.175659 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b29819-6e1f-4829-a22d-ec18a5c436d2 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.175764 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9a34c-f60f-464a-9d8c-7f29fc5858eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.177625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9a34c-f60f-464a-9d8c-7f29fc5858eb admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.245472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 798/1582] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:37 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:37.246281 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b29819-6e1f-4829-a22d-ec18a5c436d2 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.269500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 785/1583] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:37 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:37.271943 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9a34c-f60f-464a-9d8c-7f29fc5858eb admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.276579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:37.284053 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9a34c-f60f-464a-9d8c-7f29fc5858eb admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.288899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c84dce-8b15-4d5a-9bd5-8024de96c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.289669 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c84dce-8b15-4d5a-9bd5-8024de96c305 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.289954 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c84dce-8b15-4d5a-9bd5-8024de96c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.290224 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c84dce-8b15-4d5a-9bd5-8024de96c305 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.290924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c84dce-8b15-4d5a-9bd5-8024de96c305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.292956 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c84dce-8b15-4d5a-9bd5-8024de96c305 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.301691 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b29819-6e1f-4829-a22d-ec18a5c436d2 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.305442 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314180a-baf7-4775-be17-5656d637f289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.306111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314180a-baf7-4775-be17-5656d637f289 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.306391 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314180a-baf7-4775-be17-5656d637f289 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.306664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314180a-baf7-4775-be17-5656d637f289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.315715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314180a-baf7-4775-be17-5656d637f289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.317407 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314180a-baf7-4775-be17-5656d637f289 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.327938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 799/1584] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:37.328918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314180a-baf7-4775-be17-5656d637f289 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.337779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314180a-baf7-4775-be17-5656d637f289 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.343060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302e7bc-7d24-4a47-8fb4-53970f59e355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.343756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302e7bc-7d24-4a47-8fb4-53970f59e355 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.344046 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302e7bc-7d24-4a47-8fb4-53970f59e355 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.344324 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302e7bc-7d24-4a47-8fb4-53970f59e355 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.345081 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302e7bc-7d24-4a47-8fb4-53970f59e355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.346671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302e7bc-7d24-4a47-8fb4-53970f59e355 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.356753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 800/1585] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:37.359465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302e7bc-7d24-4a47-8fb4-53970f59e355 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.367399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302e7bc-7d24-4a47-8fb4-53970f59e355 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.371926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b983e86-6b47-4d49-8f1f-97552e9bb464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.372632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b983e86-6b47-4d49-8f1f-97552e9bb464 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.372939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b983e86-6b47-4d49-8f1f-97552e9bb464 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.373634 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b983e86-6b47-4d49-8f1f-97552e9bb464 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.374410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b983e86-6b47-4d49-8f1f-97552e9bb464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.377101 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b983e86-6b47-4d49-8f1f-97552e9bb464 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.388377 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 801/1586] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:37.388377 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b983e86-6b47-4d49-8f1f-97552e9bb464 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.399594 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b983e86-6b47-4d49-8f1f-97552e9bb464 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.405859 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c934957-d245-4933-9789-98a284b3a212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.406513 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c934957-d245-4933-9789-98a284b3a212 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.406795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c934957-d245-4933-9789-98a284b3a212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.407066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c934957-d245-4933-9789-98a284b3a212 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.407881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c934957-d245-4933-9789-98a284b3a212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.409669 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c934957-d245-4933-9789-98a284b3a212 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.414672 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 786/1587] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:37 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:37.414672 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c84dce-8b15-4d5a-9bd5-8024de96c305 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.426336 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 802/1588] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:37.426336 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c934957-d245-4933-9789-98a284b3a212 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.426594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c84dce-8b15-4d5a-9bd5-8024de96c305 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.431003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9215fa-f779-4e6a-882e-b8bb2857b790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.431666 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9215fa-f779-4e6a-882e-b8bb2857b790 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.431950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9215fa-f779-4e6a-882e-b8bb2857b790 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.432228 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9215fa-f779-4e6a-882e-b8bb2857b790 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.433017 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9215fa-f779-4e6a-882e-b8bb2857b790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.434276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c934957-d245-4933-9789-98a284b3a212 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.434656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9215fa-f779-4e6a-882e-b8bb2857b790 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.440611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f9d38-add2-4238-836d-6e2b8bb7085e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.444501 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f9d38-add2-4238-836d-6e2b8bb7085e admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.444501 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f9d38-add2-4238-836d-6e2b8bb7085e admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.444501 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f9d38-add2-4238-836d-6e2b8bb7085e admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.444501 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f9d38-add2-4238-836d-6e2b8bb7085e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.444865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f9d38-add2-4238-836d-6e2b8bb7085e admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.448396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 787/1589] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:37.449465 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9215fa-f779-4e6a-882e-b8bb2857b790 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.456980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 803/1590] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:37.457688 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f9d38-add2-4238-836d-6e2b8bb7085e admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.462892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9215fa-f779-4e6a-882e-b8bb2857b790 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.468027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a12f8-24d1-4e76-ba45-098562ef3ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.469543 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f9d38-add2-4238-836d-6e2b8bb7085e admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.469652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a12f8-24d1-4e76-ba45-098562ef3ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.469652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a12f8-24d1-4e76-ba45-098562ef3ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.469652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a12f8-24d1-4e76-ba45-098562ef3ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.470696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a12f8-24d1-4e76-ba45-098562ef3ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.472470 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a12f8-24d1-4e76-ba45-098562ef3ff9 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.472986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a49498-5151-4556-9229-d0cbf53b0f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.473671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a49498-5151-4556-9229-d0cbf53b0f58 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.473959 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a49498-5151-4556-9229-d0cbf53b0f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.474240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a49498-5151-4556-9229-d0cbf53b0f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.474975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a49498-5151-4556-9229-d0cbf53b0f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.476550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a49498-5151-4556-9229-d0cbf53b0f58 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.485792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 788/1591] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:37.486729 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a12f8-24d1-4e76-ba45-098562ef3ff9 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.495052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 804/1592] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:37.495994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a49498-5151-4556-9229-d0cbf53b0f58 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.498967 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a12f8-24d1-4e76-ba45-098562ef3ff9 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.504227 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481f053-214b-4c1e-832b-b03ccab82a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.504834 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481f053-214b-4c1e-832b-b03ccab82a63 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.505132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481f053-214b-4c1e-832b-b03ccab82a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.505576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481f053-214b-4c1e-832b-b03ccab82a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.506322 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481f053-214b-4c1e-832b-b03ccab82a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.507425 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a49498-5151-4556-9229-d0cbf53b0f58 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.508063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481f053-214b-4c1e-832b-b03ccab82a63 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.512823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbac962-73db-4994-92b8-4ac02870c1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.513512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbac962-73db-4994-92b8-4ac02870c1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.514652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbac962-73db-4994-92b8-4ac02870c1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.514937 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbac962-73db-4994-92b8-4ac02870c1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.516171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbac962-73db-4994-92b8-4ac02870c1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.518601 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbac962-73db-4994-92b8-4ac02870c1b9 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.520366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 789/1593] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:37.521086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481f053-214b-4c1e-832b-b03ccab82a63 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.532354 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481f053-214b-4c1e-832b-b03ccab82a63 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.536440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 805/1594] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:37.536440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbac962-73db-4994-92b8-4ac02870c1b9 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.540548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190056e-ccde-41bf-93e4-71fb2f7d65a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.542072 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190056e-ccde-41bf-93e4-71fb2f7d65a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.542441 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190056e-ccde-41bf-93e4-71fb2f7d65a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.542819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190056e-ccde-41bf-93e4-71fb2f7d65a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.543690 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190056e-ccde-41bf-93e4-71fb2f7d65a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.546203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190056e-ccde-41bf-93e4-71fb2f7d65a7 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.549926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbac962-73db-4994-92b8-4ac02870c1b9 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.555022 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee17f4f-4f84-4051-b4d4-f046ab69a3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.555983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee17f4f-4f84-4051-b4d4-f046ab69a3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.556348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee17f4f-4f84-4051-b4d4-f046ab69a3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.556626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee17f4f-4f84-4051-b4d4-f046ab69a3b6 admin admin] PATH_INFO: `/v3/projects/c73553ee127a469b9cad0eda54e8c4a2/users/27b0e2428571450ea1d5edfd1c3b0f80/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.561327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 790/1595] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:37.561327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190056e-ccde-41bf-93e4-71fb2f7d65a7 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.571536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190056e-ccde-41bf-93e4-71fb2f7d65a7 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.576931 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b7767-846c-4ab3-af5d-26ae57f01c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.577493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee17f4f-4f84-4051-b4d4-f046ab69a3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73553ee127a469b9cad0eda54e8c4a2, user_id=27b0e2428571450ea1d5edfd1c3b0f80, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.577659 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b7767-846c-4ab3-af5d-26ae57f01c05 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.577947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b7767-846c-4ab3-af5d-26ae57f01c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.578254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b7767-846c-4ab3-af5d-26ae57f01c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.578613 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: WARNING py.warnings [None req-9ee17f4f-4f84-4051-b4d4-f046ab69a3b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:55:37.578613 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: warnings.warn(msg) Jun 27 14:55:37.578613 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: Jun 27 14:55:37.578997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b7767-846c-4ab3-af5d-26ae57f01c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.580609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee17f4f-4f84-4051-b4d4-f046ab69a3b6 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.580727 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b7767-846c-4ab3-af5d-26ae57f01c05 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.594626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 791/1596] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:37.595739 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b7767-846c-4ab3-af5d-26ae57f01c05 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.608992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b7767-846c-4ab3-af5d-26ae57f01c05 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.616197 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833f39c-e102-43c7-83dd-6624e99ceb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.617293 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833f39c-e102-43c7-83dd-6624e99ceb7b admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.622351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833f39c-e102-43c7-83dd-6624e99ceb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.622351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833f39c-e102-43c7-83dd-6624e99ceb7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.622351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833f39c-e102-43c7-83dd-6624e99ceb7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.622351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833f39c-e102-43c7-83dd-6624e99ceb7b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.631304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 792/1597] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:37.632699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833f39c-e102-43c7-83dd-6624e99ceb7b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.644121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833f39c-e102-43c7-83dd-6624e99ceb7b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.650038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39aadb1-e3dc-4b6f-85b1-85045a1a4c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.653182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39aadb1-e3dc-4b6f-85b1-85045a1a4c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.653182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39aadb1-e3dc-4b6f-85b1-85045a1a4c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.653182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39aadb1-e3dc-4b6f-85b1-85045a1a4c84 admin admin] PATH_INFO: `/v3/projects/56b0583073b741bf9768b4eb820babda/users/cb521cf7c38d47518c844ccbdfe4d921/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.676890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39aadb1-e3dc-4b6f-85b1-85045a1a4c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b0583073b741bf9768b4eb820babda, user_id=cb521cf7c38d47518c844ccbdfe4d921, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.683060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 806/1598] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:37 2022] PUT /identity/v3/projects/c73553ee127a469b9cad0eda54e8c4a2/users/27b0e2428571450ea1d5edfd1c3b0f80/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:37.683060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee17f4f-4f84-4051-b4d4-f046ab69a3b6 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.683270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39aadb1-e3dc-4b6f-85b1-85045a1a4c84 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.761701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee17f4f-4f84-4051-b4d4-f046ab69a3b6 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.768206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c3c22-f956-4899-9bf5-5c71803f2916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.769712 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c3c22-f956-4899-9bf5-5c71803f2916 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.770200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c3c22-f956-4899-9bf5-5c71803f2916 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.770672 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c3c22-f956-4899-9bf5-5c71803f2916 admin admin] PATH_INFO: `/v3/projects/4de3ea0da91d45e9b27b943d69f394c7/users/6d860e5068ff4a8791ad67ff346023db/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.783630 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 793/1599] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:37 2022] PUT /identity/v3/projects/56b0583073b741bf9768b4eb820babda/users/cb521cf7c38d47518c844ccbdfe4d921/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:37.785183 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39aadb1-e3dc-4b6f-85b1-85045a1a4c84 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.794042 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c3c22-f956-4899-9bf5-5c71803f2916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de3ea0da91d45e9b27b943d69f394c7, user_id=6d860e5068ff4a8791ad67ff346023db, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.797602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c3c22-f956-4899-9bf5-5c71803f2916 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.834412 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:37.861730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39aadb1-e3dc-4b6f-85b1-85045a1a4c84 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.866909 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c99bf-36e8-4212-a85a-d2e1da4efaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.867576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c99bf-36e8-4212-a85a-d2e1da4efaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.867855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c99bf-36e8-4212-a85a-d2e1da4efaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.868129 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c99bf-36e8-4212-a85a-d2e1da4efaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.868892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c99bf-36e8-4212-a85a-d2e1da4efaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.870497 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c99bf-36e8-4212-a85a-d2e1da4efaf1 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.887629 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 794/1600] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:37.887629 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c99bf-36e8-4212-a85a-d2e1da4efaf1 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.896712 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c99bf-36e8-4212-a85a-d2e1da4efaf1 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:37.903412 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8746b4-9e03-412d-865e-cdd29f34eacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:37.909397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8746b4-9e03-412d-865e-cdd29f34eacc admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:37.909397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8746b4-9e03-412d-865e-cdd29f34eacc admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:37.909397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8746b4-9e03-412d-865e-cdd29f34eacc admin admin] PATH_INFO: `/v3/projects/86fa878f8d5e4b57aa97263b81b152a0/users/5e9a9389f32f45d3900ef3a068a56335/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:37.909653 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 807/1601] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:37 2022] PUT /identity/v3/projects/4de3ea0da91d45e9b27b943d69f394c7/users/6d860e5068ff4a8791ad67ff346023db/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:37.909653 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c3c22-f956-4899-9bf5-5c71803f2916 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:37.931018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8746b4-9e03-412d-865e-cdd29f34eacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fa878f8d5e4b57aa97263b81b152a0, user_id=5e9a9389f32f45d3900ef3a068a56335, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:37.940903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8746b4-9e03-412d-865e-cdd29f34eacc admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:37.949156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:37.996887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c3c22-f956-4899-9bf5-5c71803f2916 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:38.002777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92139db2-3089-4e5b-a881-10abecee97ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:38.005328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92139db2-3089-4e5b-a881-10abecee97ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.005813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92139db2-3089-4e5b-a881-10abecee97ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.006286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92139db2-3089-4e5b-a881-10abecee97ee admin admin] PATH_INFO: `/v3/projects/6030b10a90fb421c88323d0d7927064d/users/d1df7de131984f54b46cff571d0d3383/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.024421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92139db2-3089-4e5b-a881-10abecee97ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6030b10a90fb421c88323d0d7927064d, user_id=d1df7de131984f54b46cff571d0d3383, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:38.036682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92139db2-3089-4e5b-a881-10abecee97ee admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:38.037185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 795/1602] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:37 2022] PUT /identity/v3/projects/86fa878f8d5e4b57aa97263b81b152a0/users/5e9a9389f32f45d3900ef3a068a56335/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:38.038220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8746b4-9e03-412d-865e-cdd29f34eacc admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:38.110929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8746b4-9e03-412d-865e-cdd29f34eacc admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:38.115756 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ed916-5295-4f46-830f-1171dbf9599b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:38.116670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ed916-5295-4f46-830f-1171dbf9599b admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.116955 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ed916-5295-4f46-830f-1171dbf9599b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.117226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ed916-5295-4f46-830f-1171dbf9599b admin admin] PATH_INFO: `/v3/projects/93e1b27eb6724262b7a128c8412642d6/users/29e7fc2290a641bcb6f1f96501f98d69/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.132954 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ed916-5295-4f46-830f-1171dbf9599b admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e1b27eb6724262b7a128c8412642d6, user_id=29e7fc2290a641bcb6f1f96501f98d69, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:38.136040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ed916-5295-4f46-830f-1171dbf9599b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:38.138123 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 808/1603] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:37 2022] PUT /identity/v3/projects/6030b10a90fb421c88323d0d7927064d/users/d1df7de131984f54b46cff571d0d3383/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:38.140155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f5ad9-e58d-4e25-93dd-0245995856ae None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.140680 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f5ad9-e58d-4e25-93dd-0245995856ae None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.141175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f5ad9-e58d-4e25-93dd-0245995856ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.161506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-ae3f5ad9-e58d-4e25-93dd-0245995856ae None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:38.164911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-ae3f5ad9-e58d-4e25-93dd-0245995856ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:38.223766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 796/1604] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:38 2022] PUT /identity/v3/projects/93e1b27eb6724262b7a128c8412642d6/users/29e7fc2290a641bcb6f1f96501f98d69/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:38.223766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea451434-c266-4c81-82c2-42425260b768 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.223766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea451434-c266-4c81-82c2-42425260b768 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.223766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea451434-c266-4c81-82c2-42425260b768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.241446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 809/1605] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:38.241857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f5ad9-e58d-4e25-93dd-0245995856ae None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:38.252715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-ea451434-c266-4c81-82c2-42425260b768 None None] MFA Rules not processed for user `cb521cf7c38d47518c844ccbdfe4d921`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:38.254207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ea451434-c266-4c81-82c2-42425260b768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:38.255471 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f5ad9-e58d-4e25-93dd-0245995856ae None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:38.329426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857ecdf-95d5-414d-87f8-2cb8c6f5279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:38.330621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857ecdf-95d5-414d-87f8-2cb8c6f5279a admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.331039 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857ecdf-95d5-414d-87f8-2cb8c6f5279a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.331412 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857ecdf-95d5-414d-87f8-2cb8c6f5279a admin admin] PATH_INFO: `/v3/projects/27b7c4f8156b409785b5555712cdc934/users/340af9c8b53a483d9fc311b36736ca01/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.333078 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 797/1606] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:38.334347 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229cbf3-c553-4e9f-9fd7-990e064552c1 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.334646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229cbf3-c553-4e9f-9fd7-990e064552c1 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.334920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229cbf3-c553-4e9f-9fd7-990e064552c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.350853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857ecdf-95d5-414d-87f8-2cb8c6f5279a admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b7c4f8156b409785b5555712cdc934, user_id=340af9c8b53a483d9fc311b36736ca01, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:38.353976 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857ecdf-95d5-414d-87f8-2cb8c6f5279a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:38.363572 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-2229cbf3-c553-4e9f-9fd7-990e064552c1 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:38.364824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2229cbf3-c553-4e9f-9fd7-990e064552c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:38.372746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 798/1607] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:38.375368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d25eb4-8cd7-4df1-a7f0-bd870c19ef0d None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.375659 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d25eb4-8cd7-4df1-a7f0-bd870c19ef0d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.376031 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d25eb4-8cd7-4df1-a7f0-bd870c19ef0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.403241 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-78d25eb4-8cd7-4df1-a7f0-bd870c19ef0d None None] MFA Rules not processed for user `5e9a9389f32f45d3900ef3a068a56335`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:38.404516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-78d25eb4-8cd7-4df1-a7f0-bd870c19ef0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:38.412166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 810/1608] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:38 2022] PUT /identity/v3/projects/27b7c4f8156b409785b5555712cdc934/users/340af9c8b53a483d9fc311b36736ca01/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:38.412325 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:38.412426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda91a86-aa88-43d6-86b2-8b6925486baf None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.412426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda91a86-aa88-43d6-86b2-8b6925486baf None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.412426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda91a86-aa88-43d6-86b2-8b6925486baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.443850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-eda91a86-aa88-43d6-86b2-8b6925486baf None None] MFA Rules not processed for user `d1df7de131984f54b46cff571d0d3383`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:38.445094 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-eda91a86-aa88-43d6-86b2-8b6925486baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:38.474813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:38.500067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 799/1609] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:38.501607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb3887-2e6a-4486-b2af-d1364537a7b9 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.501997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb3887-2e6a-4486-b2af-d1364537a7b9 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.502407 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb3887-2e6a-4486-b2af-d1364537a7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.523402 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-49cb3887-2e6a-4486-b2af-d1364537a7b9 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:38.524855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-49cb3887-2e6a-4486-b2af-d1364537a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:38.529309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 811/1610] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:38.531404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda91a86-aa88-43d6-86b2-8b6925486baf None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:38.534006 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-eda91a86-aa88-43d6-86b2-8b6925486baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:38.585937 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 800/1611] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:38.586859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb3887-2e6a-4486-b2af-d1364537a7b9 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:38.593505 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda91a86-aa88-43d6-86b2-8b6925486baf None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:38.597312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6575b80-032b-49e0-8841-bed82cb6e7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:38.598047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6575b80-032b-49e0-8841-bed82cb6e7ab service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.598329 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6575b80-032b-49e0-8841-bed82cb6e7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.598606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6575b80-032b-49e0-8841-bed82cb6e7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.604010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb3887-2e6a-4486-b2af-d1364537a7b9 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:38.609159 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e4240-27fb-4440-ab97-5b904089212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:38.609754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6575b80-032b-49e0-8841-bed82cb6e7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:38.610500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e4240-27fb-4440-ab97-5b904089212b admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.610500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e4240-27fb-4440-ab97-5b904089212b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.610500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e4240-27fb-4440-ab97-5b904089212b admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.611103 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e4240-27fb-4440-ab97-5b904089212b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:38.611201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6575b80-032b-49e0-8841-bed82cb6e7ab service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:38.613070 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e4240-27fb-4440-ab97-5b904089212b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:38.621074 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 812/1612] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:38.622083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6575b80-032b-49e0-8841-bed82cb6e7ab service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:38.630326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6575b80-032b-49e0-8841-bed82cb6e7ab service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:38.634655 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a93a91-b63d-4e1a-bc4e-9a44316cff03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:38.635300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a93a91-b63d-4e1a-bc4e-9a44316cff03 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.635636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a93a91-b63d-4e1a-bc4e-9a44316cff03 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.635908 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a93a91-b63d-4e1a-bc4e-9a44316cff03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.646664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a93a91-b63d-4e1a-bc4e-9a44316cff03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:38.648067 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a93a91-b63d-4e1a-bc4e-9a44316cff03 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:38.658142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 813/1613] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:38.659354 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59078a-302b-4d27-8784-935f46d4a387 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.659632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59078a-302b-4d27-8784-935f46d4a387 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.659902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59078a-302b-4d27-8784-935f46d4a387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.676355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-7a59078a-302b-4d27-8784-935f46d4a387 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:38.677577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7a59078a-302b-4d27-8784-935f46d4a387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:38.685199 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 814/1614] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:38.686900 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59078a-302b-4d27-8784-935f46d4a387 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:38.696253 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59078a-302b-4d27-8784-935f46d4a387 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:38.700750 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a2f41-ddeb-4be8-91bb-b7d00403b9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:38.702098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a2f41-ddeb-4be8-91bb-b7d00403b9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.702387 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a2f41-ddeb-4be8-91bb-b7d00403b9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.702652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a2f41-ddeb-4be8-91bb-b7d00403b9b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.703334 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a2f41-ddeb-4be8-91bb-b7d00403b9b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:38.705236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a2f41-ddeb-4be8-91bb-b7d00403b9b4 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:38.750784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 801/1615] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:38 2022] POST /identity/v3/projects => generated 405 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:38.750784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e4240-27fb-4440-ab97-5b904089212b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:38.805182 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 815/1616] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:38 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:38.805182 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a2f41-ddeb-4be8-91bb-b7d00403b9b4 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:38.862326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e4240-27fb-4440-ab97-5b904089212b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:38.881076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a2f41-ddeb-4be8-91bb-b7d00403b9b4 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:38.884954 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9591afc-0d26-49a6-8710-1af948d936bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:38.885733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9591afc-0d26-49a6-8710-1af948d936bd service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.885869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9591afc-0d26-49a6-8710-1af948d936bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.886137 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9591afc-0d26-49a6-8710-1af948d936bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.913578 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:38.963184 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:38.964547 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4169818-9400-40ac-8ae2-ac30a9e6395c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:38.965528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4169818-9400-40ac-8ae2-ac30a9e6395c admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:38.966059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4169818-9400-40ac-8ae2-ac30a9e6395c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:38.966548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4169818-9400-40ac-8ae2-ac30a9e6395c admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:38.967830 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4169818-9400-40ac-8ae2-ac30a9e6395c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:38.970290 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4169818-9400-40ac-8ae2-ac30a9e6395c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:38.989300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9591afc-0d26-49a6-8710-1af948d936bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:38.990876 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9591afc-0d26-49a6-8710-1af948d936bd service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:39.004946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 816/1617] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:39.005526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9591afc-0d26-49a6-8710-1af948d936bd service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:39.015192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9591afc-0d26-49a6-8710-1af948d936bd service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:39.022471 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb743bc-e160-405b-9559-9c5df8dc4395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:39.023416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb743bc-e160-405b-9559-9c5df8dc4395 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:39.023702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb743bc-e160-405b-9559-9c5df8dc4395 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:39.024144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb743bc-e160-405b-9559-9c5df8dc4395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:39.034751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb743bc-e160-405b-9559-9c5df8dc4395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:39.037049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb743bc-e160-405b-9559-9c5df8dc4395 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:39.050623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 817/1618] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:39.051588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb743bc-e160-405b-9559-9c5df8dc4395 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:39.062052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb743bc-e160-405b-9559-9c5df8dc4395 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:39.068013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d948d08-502d-456e-9c07-f66571d80507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:39.073517 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d948d08-502d-456e-9c07-f66571d80507 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:39.073836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d948d08-502d-456e-9c07-f66571d80507 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:39.075620 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d948d08-502d-456e-9c07-f66571d80507 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:39.086351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d948d08-502d-456e-9c07-f66571d80507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:39.087534 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 802/1619] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:38 2022] POST /identity/v3/projects => generated 381 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:39.088322 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4169818-9400-40ac-8ae2-ac30a9e6395c admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:39.091231 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d948d08-502d-456e-9c07-f66571d80507 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:39.195370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4169818-9400-40ac-8ae2-ac30a9e6395c admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:39.202163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352613ec-b436-48af-94d8-842f62bd553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:39.203238 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352613ec-b436-48af-94d8-842f62bd553f admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:39.203573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352613ec-b436-48af-94d8-842f62bd553f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:39.203926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352613ec-b436-48af-94d8-842f62bd553f admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:39.204796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352613ec-b436-48af-94d8-842f62bd553f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:39.208445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352613ec-b436-48af-94d8-842f62bd553f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:39.220112 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 818/1620] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:39 2022] POST /identity/v3/users => generated 309 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:39.220963 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d948d08-502d-456e-9c07-f66571d80507 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:39.235908 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d948d08-502d-456e-9c07-f66571d80507 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:39.241233 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fba167-8315-4443-9bcc-08b45655e82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:39.244630 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fba167-8315-4443-9bcc-08b45655e82f admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:39.244630 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fba167-8315-4443-9bcc-08b45655e82f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:39.244630 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fba167-8315-4443-9bcc-08b45655e82f admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:39.244630 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fba167-8315-4443-9bcc-08b45655e82f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:39.245283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fba167-8315-4443-9bcc-08b45655e82f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:39.327044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 803/1621] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:39 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:39.328500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352613ec-b436-48af-94d8-842f62bd553f admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:39.329741 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 819/1622] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:39 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:39.330658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fba167-8315-4443-9bcc-08b45655e82f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:39.340630 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352613ec-b436-48af-94d8-842f62bd553f admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:39.341134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fba167-8315-4443-9bcc-08b45655e82f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:39.346615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511e7f4-dbb5-47af-a708-9ed26333f1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:39.346834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89272b93-2429-4cd8-b495-19fb3cb3ee45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:39.347280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511e7f4-dbb5-47af-a708-9ed26333f1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:39.347471 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89272b93-2429-4cd8-b495-19fb3cb3ee45 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:39.347574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511e7f4-dbb5-47af-a708-9ed26333f1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:39.347729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89272b93-2429-4cd8-b495-19fb3cb3ee45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:39.347828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511e7f4-dbb5-47af-a708-9ed26333f1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:39.348007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89272b93-2429-4cd8-b495-19fb3cb3ee45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:39.349189 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511e7f4-dbb5-47af-a708-9ed26333f1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:39.349311 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89272b93-2429-4cd8-b495-19fb3cb3ee45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:39.350332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511e7f4-dbb5-47af-a708-9ed26333f1c1 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:39.350702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89272b93-2429-4cd8-b495-19fb3cb3ee45 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:39.364743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 820/1623] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:39.364928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 804/1624] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:39.365041 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89272b93-2429-4cd8-b495-19fb3cb3ee45 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:39.367172 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511e7f4-dbb5-47af-a708-9ed26333f1c1 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:39.377635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511e7f4-dbb5-47af-a708-9ed26333f1c1 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:39.382738 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f545d-2294-4603-85c6-0343399c16a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:39.383698 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f545d-2294-4603-85c6-0343399c16a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:39.383983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f545d-2294-4603-85c6-0343399c16a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:39.384258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f545d-2294-4603-85c6-0343399c16a9 admin admin] PATH_INFO: `/v3/projects/7cfebdb55a4947f99199f20df76a74ba/users/2bf48b805df149889186bcda6aff3e7a/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:39.384693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89272b93-2429-4cd8-b495-19fb3cb3ee45 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:39.391745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81842748-26d9-4913-b015-04c1af9dca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:39.392396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81842748-26d9-4913-b015-04c1af9dca50 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:39.392671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81842748-26d9-4913-b015-04c1af9dca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:39.393103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81842748-26d9-4913-b015-04c1af9dca50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:39.394173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81842748-26d9-4913-b015-04c1af9dca50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:39.396230 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81842748-26d9-4913-b015-04c1af9dca50 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:39.402460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f545d-2294-4603-85c6-0343399c16a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfebdb55a4947f99199f20df76a74ba, user_id=2bf48b805df149889186bcda6aff3e7a, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:39.407013 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f545d-2294-4603-85c6-0343399c16a9 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:39.419151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 821/1625] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:39.419151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81842748-26d9-4913-b015-04c1af9dca50 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:39.428045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81842748-26d9-4913-b015-04c1af9dca50 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:39.433059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b18cfb-bf58-49da-bfcb-4a02d4662375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:39.434031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b18cfb-bf58-49da-bfcb-4a02d4662375 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:39.434732 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b18cfb-bf58-49da-bfcb-4a02d4662375 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:39.435336 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b18cfb-bf58-49da-bfcb-4a02d4662375 admin admin] PATH_INFO: `/v3/projects/c16b16d8ae7545f38f9ab40bfe1c814d/users/9e5cc9164288461eb0f613aab569f91e/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:39.458025 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b18cfb-bf58-49da-bfcb-4a02d4662375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16b16d8ae7545f38f9ab40bfe1c814d, user_id=9e5cc9164288461eb0f613aab569f91e, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:39.462559 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b18cfb-bf58-49da-bfcb-4a02d4662375 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:39.508719 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 805/1626] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:39 2022] PUT /identity/v3/projects/7cfebdb55a4947f99199f20df76a74ba/users/2bf48b805df149889186bcda6aff3e7a/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:55:39.510245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f545d-2294-4603-85c6-0343399c16a9 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:39.592189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 822/1627] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:39 2022] PUT /identity/v3/projects/c16b16d8ae7545f38f9ab40bfe1c814d/users/9e5cc9164288461eb0f613aab569f91e/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:39.600589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b18cfb-bf58-49da-bfcb-4a02d4662375 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:39.603623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f545d-2294-4603-85c6-0343399c16a9 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:39.627983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:39.704956 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e2528-7673-484b-8e8e-4df7bdcd07d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:39.706036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e2528-7673-484b-8e8e-4df7bdcd07d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:39.706339 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e2528-7673-484b-8e8e-4df7bdcd07d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:39.706603 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e2528-7673-484b-8e8e-4df7bdcd07d3 admin admin] PATH_INFO: `/v3/projects/96df6dcdd19643459b13f77bf3c81932/users/8cdc8d80cc89429fb5c996c26d695345/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:39.714412 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b18cfb-bf58-49da-bfcb-4a02d4662375 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:39.720912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83941555-9a36-4012-8551-4af3e6203602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:39.722086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83941555-9a36-4012-8551-4af3e6203602 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:39.722642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83941555-9a36-4012-8551-4af3e6203602 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:39.723136 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83941555-9a36-4012-8551-4af3e6203602 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:39.724051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83941555-9a36-4012-8551-4af3e6203602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:39.725843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83941555-9a36-4012-8551-4af3e6203602 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:39.734790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e2528-7673-484b-8e8e-4df7bdcd07d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96df6dcdd19643459b13f77bf3c81932, user_id=8cdc8d80cc89429fb5c996c26d695345, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:39.741092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e2528-7673-484b-8e8e-4df7bdcd07d3 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:39.750036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 823/1628] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:39.755525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83941555-9a36-4012-8551-4af3e6203602 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:39.766897 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83941555-9a36-4012-8551-4af3e6203602 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:39.781360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e0c1d-c615-4727-91d1-595925a60c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:39.782179 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e0c1d-c615-4727-91d1-595925a60c1f admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:39.782564 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e0c1d-c615-4727-91d1-595925a60c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:39.783418 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e0c1d-c615-4727-91d1-595925a60c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:39.785382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e0c1d-c615-4727-91d1-595925a60c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:39.787139 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e0c1d-c615-4727-91d1-595925a60c1f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:39.803352 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 824/1629] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:39.804464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e0c1d-c615-4727-91d1-595925a60c1f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:39.829525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e0c1d-c615-4727-91d1-595925a60c1f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:39.839122 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17473251-0fc2-4ab7-a5b7-a6d117147baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:39.840577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17473251-0fc2-4ab7-a5b7-a6d117147baa admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:39.840909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17473251-0fc2-4ab7-a5b7-a6d117147baa admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:39.841186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17473251-0fc2-4ab7-a5b7-a6d117147baa admin admin] PATH_INFO: `/v3/projects/7cfebdb55a4947f99199f20df76a74ba/users/2bf48b805df149889186bcda6aff3e7a/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:39.844464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17473251-0fc2-4ab7-a5b7-a6d117147baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfebdb55a4947f99199f20df76a74ba, user_id=2bf48b805df149889186bcda6aff3e7a, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:39.848490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17473251-0fc2-4ab7-a5b7-a6d117147baa admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:39.862057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 806/1630] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:39 2022] PUT /identity/v3/projects/96df6dcdd19643459b13f77bf3c81932/users/8cdc8d80cc89429fb5c996c26d695345/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:39.867049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e2528-7673-484b-8e8e-4df7bdcd07d3 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:39.869017 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 825/1631] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:39 2022] PUT /identity/v3/projects/7cfebdb55a4947f99199f20df76a74ba/users/2bf48b805df149889186bcda6aff3e7a/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:39.871414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17473251-0fc2-4ab7-a5b7-a6d117147baa admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:39.911895 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:40.016449 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e2528-7673-484b-8e8e-4df7bdcd07d3 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:40.023539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e2af3-2cbc-4082-9d48-84bebbd2d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:40.024552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17473251-0fc2-4ab7-a5b7-a6d117147baa admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:40.024992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e2af3-2cbc-4082-9d48-84bebbd2d47a admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:40.025334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e2af3-2cbc-4082-9d48-84bebbd2d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:40.025895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e2af3-2cbc-4082-9d48-84bebbd2d47a admin admin] PATH_INFO: `/v3/projects/c16b16d8ae7545f38f9ab40bfe1c814d/users/9e5cc9164288461eb0f613aab569f91e/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:40.030533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e2af3-2cbc-4082-9d48-84bebbd2d47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16b16d8ae7545f38f9ab40bfe1c814d, user_id=9e5cc9164288461eb0f613aab569f91e, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:40.034819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121bbac-1f04-455d-abe3-13471fd0c48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:40.034819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121bbac-1f04-455d-abe3-13471fd0c48f admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:40.034819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121bbac-1f04-455d-abe3-13471fd0c48f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:40.034819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121bbac-1f04-455d-abe3-13471fd0c48f admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:40.035790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121bbac-1f04-455d-abe3-13471fd0c48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:40.040032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121bbac-1f04-455d-abe3-13471fd0c48f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:40.042600 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e2af3-2cbc-4082-9d48-84bebbd2d47a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:40.055438 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 807/1632] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:39 2022] PUT /identity/v3/projects/c16b16d8ae7545f38f9ab40bfe1c814d/users/9e5cc9164288461eb0f613aab569f91e/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:40.056787 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 826/1633] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:40.057780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce02530-f815-4269-a5cb-6a0b15058f14 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:40.058091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce02530-f815-4269-a5cb-6a0b15058f14 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:40.058326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce02530-f815-4269-a5cb-6a0b15058f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:40.094930 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-9ce02530-f815-4269-a5cb-6a0b15058f14 None None] MFA Rules not processed for user `2bf48b805df149889186bcda6aff3e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:40.096178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-9ce02530-f815-4269-a5cb-6a0b15058f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:40.099446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fc549-f3ed-46ac-a22d-1cb353a6e24a None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:40.099446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fc549-f3ed-46ac-a22d-1cb353a6e24a None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:40.099446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fc549-f3ed-46ac-a22d-1cb353a6e24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:40.201809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d14fc549-f3ed-46ac-a22d-1cb353a6e24a None None] MFA Rules not processed for user `9e5cc9164288461eb0f613aab569f91e`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:40.201809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d14fc549-f3ed-46ac-a22d-1cb353a6e24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:40.255083 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 808/1634] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:40.258823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce02530-f815-4269-a5cb-6a0b15058f14 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:40.328195 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:40.343917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 827/1635] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:40.345755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fc549-f3ed-46ac-a22d-1cb353a6e24a None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:40.397558 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce02530-f815-4269-a5cb-6a0b15058f14 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:40.402798 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca31f3-e47f-4a1b-a99a-b92549cafaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:40.403704 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca31f3-e47f-4a1b-a99a-b92549cafaa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:40.403986 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca31f3-e47f-4a1b-a99a-b92549cafaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:40.408789 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca31f3-e47f-4a1b-a99a-b92549cafaa3 admin admin] PATH_INFO: `/v3/projects/96df6dcdd19643459b13f77bf3c81932/users/8cdc8d80cc89429fb5c996c26d695345/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:40.408789 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca31f3-e47f-4a1b-a99a-b92549cafaa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96df6dcdd19643459b13f77bf3c81932, user_id=8cdc8d80cc89429fb5c996c26d695345, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:40.412222 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca31f3-e47f-4a1b-a99a-b92549cafaa3 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:40.427953 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 809/1636] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:40 2022] PUT /identity/v3/projects/96df6dcdd19643459b13f77bf3c81932/users/8cdc8d80cc89429fb5c996c26d695345/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:40.429469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca31f3-e47f-4a1b-a99a-b92549cafaa3 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:40.443708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fc549-f3ed-46ac-a22d-1cb353a6e24a None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:40.517055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284819c-529d-4909-bd2d-1a2cbcd47a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:40.517300 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca31f3-e47f-4a1b-a99a-b92549cafaa3 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:40.517805 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284819c-529d-4909-bd2d-1a2cbcd47a23 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:40.517995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284819c-529d-4909-bd2d-1a2cbcd47a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:40.518284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284819c-529d-4909-bd2d-1a2cbcd47a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:40.523260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7497fa3-3b28-4bef-a279-4d7248be54d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:40.525037 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7497fa3-3b28-4bef-a279-4d7248be54d0 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:40.525427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7497fa3-3b28-4bef-a279-4d7248be54d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:40.525825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7497fa3-3b28-4bef-a279-4d7248be54d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:40.613808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284819c-529d-4909-bd2d-1a2cbcd47a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:40.616277 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284819c-529d-4909-bd2d-1a2cbcd47a23 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:40.634794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7497fa3-3b28-4bef-a279-4d7248be54d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:40.636533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7497fa3-3b28-4bef-a279-4d7248be54d0 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:40.652861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 828/1637] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:40 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:40.654056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 810/1638] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:40 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:40.655757 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211a168-7ac4-4b72-bd29-8f46400202ee None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:40.657990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211a168-7ac4-4b72-bd29-8f46400202ee None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:40.658569 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211a168-7ac4-4b72-bd29-8f46400202ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:40.696690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-7211a168-7ac4-4b72-bd29-8f46400202ee None None] MFA Rules not processed for user `8cdc8d80cc89429fb5c996c26d695345`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:40.697855 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7211a168-7ac4-4b72-bd29-8f46400202ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:40.837955 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:40.854266 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 829/1639] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:40.870574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7497fa3-3b28-4bef-a279-4d7248be54d0 service cinder] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:40.880871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7497fa3-3b28-4bef-a279-4d7248be54d0 service cinder] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:40.893105 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37107c-1989-4dff-8228-5613cc72ded5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:40.898425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37107c-1989-4dff-8228-5613cc72ded5 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:40.898792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37107c-1989-4dff-8228-5613cc72ded5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:40.899161 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37107c-1989-4dff-8228-5613cc72ded5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:40.922880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37107c-1989-4dff-8228-5613cc72ded5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:40.922880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37107c-1989-4dff-8228-5613cc72ded5 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:40.957799 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 811/1640] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:41.006676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211a168-7ac4-4b72-bd29-8f46400202ee None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:41.171490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211a168-7ac4-4b72-bd29-8f46400202ee None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:41.193348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80959b4b-4d31-4c8f-87dc-06f2022ad461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:41.194283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80959b4b-4d31-4c8f-87dc-06f2022ad461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:41.194572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80959b4b-4d31-4c8f-87dc-06f2022ad461 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:41.194857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80959b4b-4d31-4c8f-87dc-06f2022ad461 admin admin] PATH_INFO: `/v3/users/cb521cf7c38d47518c844ccbdfe4d921` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:41.198992 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80959b4b-4d31-4c8f-87dc-06f2022ad461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb521cf7c38d47518c844ccbdfe4d921)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:41.200071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: WARNING py.warnings [None req-80959b4b-4d31-4c8f-87dc-06f2022ad461 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:55:41.200071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: warnings.warn(msg) Jun 27 14:55:41.200071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: Jun 27 14:55:41.202144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80959b4b-4d31-4c8f-87dc-06f2022ad461 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:41.433523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:41.452787 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-80959b4b-4d31-4c8f-87dc-06f2022ad461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb521cf7c38d47518c844ccbdfe4d921'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:41.478008 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-80959b4b-4d31-4c8f-87dc-06f2022ad461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb521cf7c38d47518c844ccbdfe4d921'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:41.585567 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-80959b4b-4d31-4c8f-87dc-06f2022ad461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb521cf7c38d47518c844ccbdfe4d921'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:41.592900 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-80959b4b-4d31-4c8f-87dc-06f2022ad461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb521cf7c38d47518c844ccbdfe4d921'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:41.645897 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-80959b4b-4d31-4c8f-87dc-06f2022ad461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb521cf7c38d47518c844ccbdfe4d921'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:41.666070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 830/1641] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:55:41 2022] DELETE /identity/v3/users/cb521cf7c38d47518c844ccbdfe4d921 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:41.668356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596826a-779e-46da-8f7a-026635b6ebca None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:41.668857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596826a-779e-46da-8f7a-026635b6ebca None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:41.669049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596826a-779e-46da-8f7a-026635b6ebca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:41.709611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-0596826a-779e-46da-8f7a-026635b6ebca None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:41.715788 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0596826a-779e-46da-8f7a-026635b6ebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:41.819668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:41.846158 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 812/1642] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:41.861503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80959b4b-4d31-4c8f-87dc-06f2022ad461 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:41.863090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-80959b4b-4d31-4c8f-87dc-06f2022ad461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:41.933140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80959b4b-4d31-4c8f-87dc-06f2022ad461 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:41.936942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a544f8-f5a6-468c-9ada-e1ed60b8ce4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:41.937682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a544f8-f5a6-468c-9ada-e1ed60b8ce4d service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:41.938096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a544f8-f5a6-468c-9ada-e1ed60b8ce4d service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:41.938378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a544f8-f5a6-468c-9ada-e1ed60b8ce4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:41.949056 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a544f8-f5a6-468c-9ada-e1ed60b8ce4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:41.950524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a544f8-f5a6-468c-9ada-e1ed60b8ce4d service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:41.969423 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 831/1643] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:42.088580 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596826a-779e-46da-8f7a-026635b6ebca None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:42.090507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0596826a-779e-46da-8f7a-026635b6ebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:42.120778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596826a-779e-46da-8f7a-026635b6ebca None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:42.131937 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7179f-35b2-4766-8d62-1cb88dcd3435 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:42.132775 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7179f-35b2-4766-8d62-1cb88dcd3435 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:42.132775 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7179f-35b2-4766-8d62-1cb88dcd3435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:42.147797 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10323b-4159-4468-a205-42c64202f153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:42.153762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10323b-4159-4468-a205-42c64202f153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:42.156285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10323b-4159-4468-a205-42c64202f153 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:42.158416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10323b-4159-4468-a205-42c64202f153 admin admin] PATH_INFO: `/v3/users/5e9a9389f32f45d3900ef3a068a56335` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:42.171483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10323b-4159-4468-a205-42c64202f153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e9a9389f32f45d3900ef3a068a56335)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:42.176366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10323b-4159-4468-a205-42c64202f153 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:42.225727 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-b1a7179f-35b2-4766-8d62-1cb88dcd3435 None None] MFA Rules not processed for user `6d860e5068ff4a8791ad67ff346023db`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:42.228604 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b1a7179f-35b2-4766-8d62-1cb88dcd3435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:42.617744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 832/1644] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:42.617744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7179f-35b2-4766-8d62-1cb88dcd3435 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:42.617744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b1a7179f-35b2-4766-8d62-1cb88dcd3435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:42.617744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7179f-35b2-4766-8d62-1cb88dcd3435 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:42.620534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ed190-3d52-4341-9f9e-8ffeefa67d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:42.620534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ed190-3d52-4341-9f9e-8ffeefa67d64 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:42.620534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ed190-3d52-4341-9f9e-8ffeefa67d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:42.620534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ed190-3d52-4341-9f9e-8ffeefa67d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:42.621512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ed190-3d52-4341-9f9e-8ffeefa67d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:42.621512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ed190-3d52-4341-9f9e-8ffeefa67d64 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:42.652326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4b10323b-4159-4468-a205-42c64202f153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9a9389f32f45d3900ef3a068a56335'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:42.652326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4b10323b-4159-4468-a205-42c64202f153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9a9389f32f45d3900ef3a068a56335'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:42.654701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 833/1645] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:42 2022] POST /identity/v3/projects => generated 403 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:42.654701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ed190-3d52-4341-9f9e-8ffeefa67d64 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:42.654701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-665ed190-3d52-4341-9f9e-8ffeefa67d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:42.735053 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4b10323b-4159-4468-a205-42c64202f153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9a9389f32f45d3900ef3a068a56335'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:42.736965 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4b10323b-4159-4468-a205-42c64202f153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9a9389f32f45d3900ef3a068a56335'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:42.747194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4b10323b-4159-4468-a205-42c64202f153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9a9389f32f45d3900ef3a068a56335'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:42.747940 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ed190-3d52-4341-9f9e-8ffeefa67d64 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:42.754581 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403ca7c-0ef7-4b92-9a6b-85ef54953524 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cdc8d80cc89429fb5c996c26d695345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96df6dcdd19643459b13f77bf3c81932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:42.755331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403ca7c-0ef7-4b92-9a6b-85ef54953524 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:42.755681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403ca7c-0ef7-4b92-9a6b-85ef54953524 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:42.755969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403ca7c-0ef7-4b92-9a6b-85ef54953524 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:42.756627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 813/1646] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:55:42 2022] DELETE /identity/v3/users/5e9a9389f32f45d3900ef3a068a56335 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:42.757591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10323b-4159-4468-a205-42c64202f153 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:42.759040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-4b10323b-4159-4468-a205-42c64202f153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:42.759875 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403ca7c-0ef7-4b92-9a6b-85ef54953524 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:55:42.760217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403ca7c-0ef7-4b92-9a6b-85ef54953524 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:42.762118 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403ca7c-0ef7-4b92-9a6b-85ef54953524 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:42.782848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 834/1647] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:55:42.782848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960d8d1-92ea-433e-95c9-c60fa5f4a94a None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:42.782848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960d8d1-92ea-433e-95c9-c60fa5f4a94a None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:42.782848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960d8d1-92ea-433e-95c9-c60fa5f4a94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:42.811990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1960d8d1-92ea-433e-95c9-c60fa5f4a94a None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:42.814193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1960d8d1-92ea-433e-95c9-c60fa5f4a94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:42.858861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10323b-4159-4468-a205-42c64202f153 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:42.881660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae37714-1ebf-48a0-accc-fd46bd7f7139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:42.882564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae37714-1ebf-48a0-accc-fd46bd7f7139 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:42.882930 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae37714-1ebf-48a0-accc-fd46bd7f7139 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:42.894653 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae37714-1ebf-48a0-accc-fd46bd7f7139 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:42.897493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae37714-1ebf-48a0-accc-fd46bd7f7139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:42.901345 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae37714-1ebf-48a0-accc-fd46bd7f7139 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:42.934256 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 835/1648] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:42.935335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960d8d1-92ea-433e-95c9-c60fa5f4a94a None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:42.937032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1960d8d1-92ea-433e-95c9-c60fa5f4a94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:43.026241 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 814/1649] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:42 2022] POST /identity/v3/users => generated 308 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:43.034692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae37714-1ebf-48a0-accc-fd46bd7f7139 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:43.036809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-9ae37714-1ebf-48a0-accc-fd46bd7f7139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:43.051370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae37714-1ebf-48a0-accc-fd46bd7f7139 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:43.067892 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960d8d1-92ea-433e-95c9-c60fa5f4a94a None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:43.068669 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:43.069513 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:43.069792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:43.070065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] PATH_INFO: `/v3/projects/56b0583073b741bf9768b4eb820babda` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:43.073161 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b0583073b741bf9768b4eb820babda)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:43.074194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: WARNING py.warnings [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 14:55:43.074194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: warnings.warn(msg) Jun 27 14:55:43.074194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: Jun 27 14:55:43.075380 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:43.081733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933817f9-5c52-4e65-9fa8-c26e43664129 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cdc8d80cc89429fb5c996c26d695345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96df6dcdd19643459b13f77bf3c81932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:43.083346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933817f9-5c52-4e65-9fa8-c26e43664129 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:43.083346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933817f9-5c52-4e65-9fa8-c26e43664129 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:43.088151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933817f9-5c52-4e65-9fa8-c26e43664129 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:43.089088 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933817f9-5c52-4e65-9fa8-c26e43664129 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:43.096622 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933817f9-5c52-4e65-9fa8-c26e43664129 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:43.146181 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:43.205572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 836/1650] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:42 2022] POST /identity/v3/projects => generated 355 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:43.207144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933817f9-5c52-4e65-9fa8-c26e43664129 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:43.209784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-933817f9-5c52-4e65-9fa8-c26e43664129 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:43.280018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b0583073b741bf9768b4eb820babda', 'request_id': 'req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:43.332287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933817f9-5c52-4e65-9fa8-c26e43664129 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:43.349358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b0583073b741bf9768b4eb820babda', 'request_id': 'req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:43.358332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:43.381428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b0583073b741bf9768b4eb820babda', 'request_id': 'req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:43.409522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] The token cache is being invalidate because project 56b0583073b741bf9768b4eb820babda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:55:43.409897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:43.410488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:43.412524 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 815/1651] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:55:43 2022] DELETE /identity/v3/projects/56b0583073b741bf9768b4eb820babda => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:43.413359 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:43.419903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:43.422739 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f37521-a25b-44fe-93d4-306a88340b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:43.423831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f37521-a25b-44fe-93d4-306a88340b46 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:43.423831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f37521-a25b-44fe-93d4-306a88340b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:43.424037 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f37521-a25b-44fe-93d4-306a88340b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:43.430631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-71f37521-a25b-44fe-93d4-306a88340b46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:43.557319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f37521-a25b-44fe-93d4-306a88340b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:43.559251 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f37521-a25b-44fe-93d4-306a88340b46 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:43.575214 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 837/1652] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:43.576590 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f37521-a25b-44fe-93d4-306a88340b46 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:43.580105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-71f37521-a25b-44fe-93d4-306a88340b46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:43.674823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f37521-a25b-44fe-93d4-306a88340b46 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:43.690612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363ff7b-df46-4f07-a55e-a5927d65f0c8 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cdc8d80cc89429fb5c996c26d695345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96df6dcdd19643459b13f77bf3c81932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:43.693404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363ff7b-df46-4f07-a55e-a5927d65f0c8 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:43.694721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363ff7b-df46-4f07-a55e-a5927d65f0c8 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:43.695239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363ff7b-df46-4f07-a55e-a5927d65f0c8 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:43.697343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363ff7b-df46-4f07-a55e-a5927d65f0c8 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:55:43.698376 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363ff7b-df46-4f07-a55e-a5927d65f0c8 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:43.705988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363ff7b-df46-4f07-a55e-a5927d65f0c8 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:43.736284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 838/1653] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:55:43.740005 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363ff7b-df46-4f07-a55e-a5927d65f0c8 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:43.745627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b363ff7b-df46-4f07-a55e-a5927d65f0c8 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:43.780984 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363ff7b-df46-4f07-a55e-a5927d65f0c8 tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:43.793931 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6fecc-b599-43c5-b6da-6b540f6c6e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:43.795364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6fecc-b599-43c5-b6da-6b540f6c6e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:43.797000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6fecc-b599-43c5-b6da-6b540f6c6e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:43.797397 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6fecc-b599-43c5-b6da-6b540f6c6e14 admin admin] PATH_INFO: `/v3/users/9e5cc9164288461eb0f613aab569f91e` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:43.802060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6fecc-b599-43c5-b6da-6b540f6c6e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5cc9164288461eb0f613aab569f91e)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:43.804885 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6fecc-b599-43c5-b6da-6b540f6c6e14 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:43.839107 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc423f-32eb-41f9-9756-c3be1c6f9e92 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:43.844883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45aae76-4508-4f48-8eb6-efbebef44b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:43.845581 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45aae76-4508-4f48-8eb6-efbebef44b65 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:43.846026 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45aae76-4508-4f48-8eb6-efbebef44b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:43.846303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45aae76-4508-4f48-8eb6-efbebef44b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:43.847107 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45aae76-4508-4f48-8eb6-efbebef44b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:43.848912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45aae76-4508-4f48-8eb6-efbebef44b65 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:43.863373 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 816/1654] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:43.863373 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45aae76-4508-4f48-8eb6-efbebef44b65 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:43.875457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45aae76-4508-4f48-8eb6-efbebef44b65 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:43.880481 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84b49c-7667-489c-b27b-d0dea8679d6b tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cdc8d80cc89429fb5c996c26d695345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96df6dcdd19643459b13f77bf3c81932', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:43.881391 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84b49c-7667-489c-b27b-d0dea8679d6b tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:43.881679 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84b49c-7667-489c-b27b-d0dea8679d6b tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:43.881959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84b49c-7667-489c-b27b-d0dea8679d6b tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] PATH_INFO: `/v3/projects/cdc7e2e432ae4c80acf46265041d3fef` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:43.883236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84b49c-7667-489c-b27b-d0dea8679d6b tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cdc7e2e432ae4c80acf46265041d3fef)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:43.885492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84b49c-7667-489c-b27b-d0dea8679d6b tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:44.071043 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-36e6fecc-b599-43c5-b6da-6b540f6c6e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5cc9164288461eb0f613aab569f91e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:44.076398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1d84b49c-7667-489c-b27b-d0dea8679d6b tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc7e2e432ae4c80acf46265041d3fef', 'request_id': 'req-1d84b49c-7667-489c-b27b-d0dea8679d6b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:44.100962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-36e6fecc-b599-43c5-b6da-6b540f6c6e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5cc9164288461eb0f613aab569f91e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:44.152081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1d84b49c-7667-489c-b27b-d0dea8679d6b tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc7e2e432ae4c80acf46265041d3fef', 'request_id': 'req-1d84b49c-7667-489c-b27b-d0dea8679d6b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:44.166172 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1d84b49c-7667-489c-b27b-d0dea8679d6b tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc7e2e432ae4c80acf46265041d3fef', 'request_id': 'req-1d84b49c-7667-489c-b27b-d0dea8679d6b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:44.202926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1d84b49c-7667-489c-b27b-d0dea8679d6b tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] The token cache is being invalidate because project cdc7e2e432ae4c80acf46265041d3fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:55:44.203227 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1d84b49c-7667-489c-b27b-d0dea8679d6b tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:44.204049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1d84b49c-7667-489c-b27b-d0dea8679d6b tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:44.210558 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 817/1655] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:55:43 2022] DELETE /identity/v3/projects/cdc7e2e432ae4c80acf46265041d3fef => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:44.210558 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84b49c-7667-489c-b27b-d0dea8679d6b tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:44.225411 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-1d84b49c-7667-489c-b27b-d0dea8679d6b tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:44.261134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-36e6fecc-b599-43c5-b6da-6b540f6c6e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5cc9164288461eb0f613aab569f91e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:44.261815 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-36e6fecc-b599-43c5-b6da-6b540f6c6e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5cc9164288461eb0f613aab569f91e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:44.274261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-36e6fecc-b599-43c5-b6da-6b540f6c6e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5cc9164288461eb0f613aab569f91e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:44.299285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 839/1656] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:55:43 2022] DELETE /identity/v3/users/9e5cc9164288461eb0f613aab569f91e => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:44.419254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84b49c-7667-489c-b27b-d0dea8679d6b tempest-VolumeQuotaClassesTest-1604436723 tempest-VolumeQuotaClassesTest-1604436723-project-admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:44.519539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd8c0c-c352-4fab-b1e1-607225151498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:44.520771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd8c0c-c352-4fab-b1e1-607225151498 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:44.521402 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd8c0c-c352-4fab-b1e1-607225151498 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:44.521897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd8c0c-c352-4fab-b1e1-607225151498 admin admin] PATH_INFO: `/v3/projects/1f1d07f25f4c48fb98386b10c65040b8/users/63ac57e741cf4d1aa9d61ccac8860f52/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:44.541340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd8c0c-c352-4fab-b1e1-607225151498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1d07f25f4c48fb98386b10c65040b8, user_id=63ac57e741cf4d1aa9d61ccac8860f52, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:44.545219 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd8c0c-c352-4fab-b1e1-607225151498 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:44.639932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6fecc-b599-43c5-b6da-6b540f6c6e14 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:44.642312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-36e6fecc-b599-43c5-b6da-6b540f6c6e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:44.659239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6fecc-b599-43c5-b6da-6b540f6c6e14 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:44.665288 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 818/1657] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:44 2022] PUT /identity/v3/projects/1f1d07f25f4c48fb98386b10c65040b8/users/63ac57e741cf4d1aa9d61ccac8860f52/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:44.669205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd8c0c-c352-4fab-b1e1-607225151498 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:44.684123 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-d5bd8c0c-c352-4fab-b1e1-607225151498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:44.769426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589697b0-53cd-46d7-a648-d9eb93145e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:44.771596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589697b0-53cd-46d7-a648-d9eb93145e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:44.772091 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589697b0-53cd-46d7-a648-d9eb93145e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:44.773022 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589697b0-53cd-46d7-a648-d9eb93145e19 admin admin] PATH_INFO: `/v3/projects/86fa878f8d5e4b57aa97263b81b152a0` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:44.776183 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589697b0-53cd-46d7-a648-d9eb93145e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86fa878f8d5e4b57aa97263b81b152a0)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:44.779884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589697b0-53cd-46d7-a648-d9eb93145e19 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:44.808710 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd8c0c-c352-4fab-b1e1-607225151498 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:44.827127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c2e0a-bb6e-4cff-b833-cde6b8301c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:44.827783 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c2e0a-bb6e-4cff-b833-cde6b8301c55 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:44.828076 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c2e0a-bb6e-4cff-b833-cde6b8301c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:44.828352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c2e0a-bb6e-4cff-b833-cde6b8301c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:44.829174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c2e0a-bb6e-4cff-b833-cde6b8301c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:44.830755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c2e0a-bb6e-4cff-b833-cde6b8301c55 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:44.845538 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 819/1658] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:55:44.846491 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c2e0a-bb6e-4cff-b833-cde6b8301c55 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:44.856440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c2e0a-bb6e-4cff-b833-cde6b8301c55 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:44.862147 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16620fdf-5d17-4814-a875-c2d957e16153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:44.863056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16620fdf-5d17-4814-a875-c2d957e16153 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:44.863335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16620fdf-5d17-4814-a875-c2d957e16153 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:44.863610 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16620fdf-5d17-4814-a875-c2d957e16153 admin admin] PATH_INFO: `/v3/projects/1f1d07f25f4c48fb98386b10c65040b8/users/63ac57e741cf4d1aa9d61ccac8860f52/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:44.866685 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16620fdf-5d17-4814-a875-c2d957e16153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1d07f25f4c48fb98386b10c65040b8, user_id=63ac57e741cf4d1aa9d61ccac8860f52, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:44.869376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16620fdf-5d17-4814-a875-c2d957e16153 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:44.884511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 820/1659] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:44 2022] PUT /identity/v3/projects/1f1d07f25f4c48fb98386b10c65040b8/users/63ac57e741cf4d1aa9d61ccac8860f52/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:44.919557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:44.994770 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-589697b0-53cd-46d7-a648-d9eb93145e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86fa878f8d5e4b57aa97263b81b152a0', 'request_id': 'req-589697b0-53cd-46d7-a648-d9eb93145e19'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:45.009871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:45.040575 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-589697b0-53cd-46d7-a648-d9eb93145e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86fa878f8d5e4b57aa97263b81b152a0', 'request_id': 'req-589697b0-53cd-46d7-a648-d9eb93145e19'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:45.128519 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-589697b0-53cd-46d7-a648-d9eb93145e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86fa878f8d5e4b57aa97263b81b152a0', 'request_id': 'req-589697b0-53cd-46d7-a648-d9eb93145e19'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:45.155247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-589697b0-53cd-46d7-a648-d9eb93145e19 admin admin] The token cache is being invalidate because project 86fa878f8d5e4b57aa97263b81b152a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:55:45.155551 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-589697b0-53cd-46d7-a648-d9eb93145e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:45.157546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-589697b0-53cd-46d7-a648-d9eb93145e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:45.166456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 840/1660] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:55:44 2022] DELETE /identity/v3/projects/86fa878f8d5e4b57aa97263b81b152a0 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:55:45.167758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16620fdf-5d17-4814-a875-c2d957e16153 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:45.169593 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-16620fdf-5d17-4814-a875-c2d957e16153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:45.303974 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16620fdf-5d17-4814-a875-c2d957e16153 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:45.343063 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589697b0-53cd-46d7-a648-d9eb93145e19 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:45.346119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-589697b0-53cd-46d7-a648-d9eb93145e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:45.506341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10d866-fa4d-4461-9725-77aa14f6fab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:45.509228 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10d866-fa4d-4461-9725-77aa14f6fab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:45.509228 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10d866-fa4d-4461-9725-77aa14f6fab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:45.509228 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10d866-fa4d-4461-9725-77aa14f6fab4 admin admin] PATH_INFO: `/v3/users/2bf48b805df149889186bcda6aff3e7a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:45.509516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10d866-fa4d-4461-9725-77aa14f6fab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf48b805df149889186bcda6aff3e7a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:45.511342 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10d866-fa4d-4461-9725-77aa14f6fab4 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:45.548923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589697b0-53cd-46d7-a648-d9eb93145e19 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:45.556082 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a0423-9b86-4a37-b86e-65e9e5b82d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:45.558493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a0423-9b86-4a37-b86e-65e9e5b82d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:45.558493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a0423-9b86-4a37-b86e-65e9e5b82d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:45.558493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a0423-9b86-4a37-b86e-65e9e5b82d7a admin admin] PATH_INFO: `/v3/users/d1df7de131984f54b46cff571d0d3383` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:45.566990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a0423-9b86-4a37-b86e-65e9e5b82d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1df7de131984f54b46cff571d0d3383)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:45.573173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a0423-9b86-4a37-b86e-65e9e5b82d7a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:45.783930 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4e10d866-fa4d-4461-9725-77aa14f6fab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf48b805df149889186bcda6aff3e7a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:45.803962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fc1a0423-9b86-4a37-b86e-65e9e5b82d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1df7de131984f54b46cff571d0d3383'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:45.812094 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4e10d866-fa4d-4461-9725-77aa14f6fab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf48b805df149889186bcda6aff3e7a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:45.836490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fc1a0423-9b86-4a37-b86e-65e9e5b82d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1df7de131984f54b46cff571d0d3383'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:45.916293 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4e10d866-fa4d-4461-9725-77aa14f6fab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf48b805df149889186bcda6aff3e7a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:45.917020 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4e10d866-fa4d-4461-9725-77aa14f6fab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf48b805df149889186bcda6aff3e7a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:45.926817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4e10d866-fa4d-4461-9725-77aa14f6fab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf48b805df149889186bcda6aff3e7a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:45.941703 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 821/1661] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:55:45 2022] DELETE /identity/v3/users/2bf48b805df149889186bcda6aff3e7a => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:46.001915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fc1a0423-9b86-4a37-b86e-65e9e5b82d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1df7de131984f54b46cff571d0d3383'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:46.002572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fc1a0423-9b86-4a37-b86e-65e9e5b82d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1df7de131984f54b46cff571d0d3383'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:46.012632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fc1a0423-9b86-4a37-b86e-65e9e5b82d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1df7de131984f54b46cff571d0d3383'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:46.029341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 841/1662] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:55:45 2022] DELETE /identity/v3/users/d1df7de131984f54b46cff571d0d3383 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:46.031863 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875ca64-0258-4cba-b3ac-ea3e9c5d4779 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:46.032261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875ca64-0258-4cba-b3ac-ea3e9c5d4779 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:46.032654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875ca64-0258-4cba-b3ac-ea3e9c5d4779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:46.072325 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-c875ca64-0258-4cba-b3ac-ea3e9c5d4779 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:46.073939 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-c875ca64-0258-4cba-b3ac-ea3e9c5d4779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:46.177587 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 822/1663] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:46.208203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a0423-9b86-4a37-b86e-65e9e5b82d7a admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:46.210115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-fc1a0423-9b86-4a37-b86e-65e9e5b82d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:46.340336 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:46.353159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a0423-9b86-4a37-b86e-65e9e5b82d7a admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:46.371627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e69c49-8eb7-4817-9cf1-2ca26288196b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:46.373048 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69c49-8eb7-4817-9cf1-2ca26288196b service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:46.373611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69c49-8eb7-4817-9cf1-2ca26288196b service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:46.378532 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69c49-8eb7-4817-9cf1-2ca26288196b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:46.379134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875ca64-0258-4cba-b3ac-ea3e9c5d4779 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:46.380683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-c875ca64-0258-4cba-b3ac-ea3e9c5d4779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:46.401372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e69c49-8eb7-4817-9cf1-2ca26288196b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:46.402904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e69c49-8eb7-4817-9cf1-2ca26288196b service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:46.407305 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875ca64-0258-4cba-b3ac-ea3e9c5d4779 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:46.423492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 842/1664] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:46.430436 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00365715-ea6f-4f0c-b648-4a1d6128678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:46.433406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00365715-ea6f-4f0c-b648-4a1d6128678a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:46.434873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00365715-ea6f-4f0c-b648-4a1d6128678a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:46.435217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00365715-ea6f-4f0c-b648-4a1d6128678a admin admin] PATH_INFO: `/v3/projects/c16b16d8ae7545f38f9ab40bfe1c814d` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:46.437470 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00365715-ea6f-4f0c-b648-4a1d6128678a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16b16d8ae7545f38f9ab40bfe1c814d)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:46.439765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00365715-ea6f-4f0c-b648-4a1d6128678a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:46.673383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-00365715-ea6f-4f0c-b648-4a1d6128678a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16b16d8ae7545f38f9ab40bfe1c814d', 'request_id': 'req-00365715-ea6f-4f0c-b648-4a1d6128678a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:46.778688 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-00365715-ea6f-4f0c-b648-4a1d6128678a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16b16d8ae7545f38f9ab40bfe1c814d', 'request_id': 'req-00365715-ea6f-4f0c-b648-4a1d6128678a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:46.786840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-00365715-ea6f-4f0c-b648-4a1d6128678a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16b16d8ae7545f38f9ab40bfe1c814d', 'request_id': 'req-00365715-ea6f-4f0c-b648-4a1d6128678a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:46.864746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-00365715-ea6f-4f0c-b648-4a1d6128678a admin admin] The token cache is being invalidate because project c16b16d8ae7545f38f9ab40bfe1c814d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:55:46.865690 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-00365715-ea6f-4f0c-b648-4a1d6128678a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:46.874809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-00365715-ea6f-4f0c-b648-4a1d6128678a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:46.880610 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 823/1665] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:55:46 2022] DELETE /identity/v3/projects/c16b16d8ae7545f38f9ab40bfe1c814d => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:55:46.885952 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4d032-f7b7-4e07-b078-f6bed2066a26 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:46.886844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4d032-f7b7-4e07-b078-f6bed2066a26 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:46.887511 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4d032-f7b7-4e07-b078-f6bed2066a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:46.942690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-2ef4d032-f7b7-4e07-b078-f6bed2066a26 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:46.953980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2ef4d032-f7b7-4e07-b078-f6bed2066a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:47.037265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:47.187438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 843/1666] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:47.195269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c4f56-df4f-4764-92e4-7895d7333b5c None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:47.195822 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c4f56-df4f-4764-92e4-7895d7333b5c None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:47.196295 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c4f56-df4f-4764-92e4-7895d7333b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:47.249457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-5e1c4f56-df4f-4764-92e4-7895d7333b5c None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:47.252519 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-5e1c4f56-df4f-4764-92e4-7895d7333b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:47.259461 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:47.288519 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 824/1667] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:47.289606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4d032-f7b7-4e07-b078-f6bed2066a26 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:47.304080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4d032-f7b7-4e07-b078-f6bed2066a26 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:47.344486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bbbc9-9b37-4745-bab1-21d95e201bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:47.346027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bbbc9-9b37-4745-bab1-21d95e201bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:47.348164 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bbbc9-9b37-4745-bab1-21d95e201bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:47.348615 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bbbc9-9b37-4745-bab1-21d95e201bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:47.350132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bbbc9-9b37-4745-bab1-21d95e201bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:55:47.351418 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bbbc9-9b37-4745-bab1-21d95e201bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:47.354773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bbbc9-9b37-4745-bab1-21d95e201bf2 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:47.384171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 844/1668] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:55:47.386242 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c4f56-df4f-4764-92e4-7895d7333b5c None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:47.397674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c4f56-df4f-4764-92e4-7895d7333b5c None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:47.422825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d942ee9-68e5-42e1-b1bc-4780f6d7cb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:47.423629 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d942ee9-68e5-42e1-b1bc-4780f6d7cb0f admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:47.424122 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d942ee9-68e5-42e1-b1bc-4780f6d7cb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:47.424591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d942ee9-68e5-42e1-b1bc-4780f6d7cb0f admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:47.425553 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d942ee9-68e5-42e1-b1bc-4780f6d7cb0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:47.428296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d942ee9-68e5-42e1-b1bc-4780f6d7cb0f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:47.572069 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 825/1669] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:47 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:47.575870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bbbc9-9b37-4745-bab1-21d95e201bf2 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:47.587108 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bbbc9-9b37-4745-bab1-21d95e201bf2 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:47.622167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d942ee9-68e5-42e1-b1bc-4780f6d7cb0f admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:47.625002 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2d942ee9-68e5-42e1-b1bc-4780f6d7cb0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:47.678098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a8378-bbbd-43a0-868e-47171df0aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:47.678963 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a8378-bbbd-43a0-868e-47171df0aad8 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:47.680330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a8378-bbbd-43a0-868e-47171df0aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:47.680330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a8378-bbbd-43a0-868e-47171df0aad8 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:47.680330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a8378-bbbd-43a0-868e-47171df0aad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:47.682185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a8378-bbbd-43a0-868e-47171df0aad8 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:47.721406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:47.766857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d942ee9-68e5-42e1-b1bc-4780f6d7cb0f admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:47.773280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759aa271-3831-43dd-9bd4-602ea4540050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:47.773474 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aa271-3831-43dd-9bd4-602ea4540050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:47.774236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aa271-3831-43dd-9bd4-602ea4540050 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:47.774236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aa271-3831-43dd-9bd4-602ea4540050 admin admin] PATH_INFO: `/v3/projects/7cfebdb55a4947f99199f20df76a74ba` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:47.775211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759aa271-3831-43dd-9bd4-602ea4540050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cfebdb55a4947f99199f20df76a74ba)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:47.778210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759aa271-3831-43dd-9bd4-602ea4540050 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:47.828999 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 845/1670] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:47 2022] POST /identity/v3/users => generated 287 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:47.830259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a8378-bbbd-43a0-868e-47171df0aad8 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:47.844582 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a8378-bbbd-43a0-868e-47171df0aad8 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:47.850456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db9d5c-23c3-4b07-aa07-4f5eb46143f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:47.852066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db9d5c-23c3-4b07-aa07-4f5eb46143f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:47.853155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db9d5c-23c3-4b07-aa07-4f5eb46143f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:47.853587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db9d5c-23c3-4b07-aa07-4f5eb46143f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:47.854724 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db9d5c-23c3-4b07-aa07-4f5eb46143f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:47.856576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db9d5c-23c3-4b07-aa07-4f5eb46143f7 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:47.876566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 846/1671] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:47.880748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db9d5c-23c3-4b07-aa07-4f5eb46143f7 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:47.893724 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db9d5c-23c3-4b07-aa07-4f5eb46143f7 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:47.919070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1b4aa-654c-43de-9b35-d852be3da06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:47.921598 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1b4aa-654c-43de-9b35-d852be3da06e admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:47.922060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1b4aa-654c-43de-9b35-d852be3da06e admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:47.923881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1b4aa-654c-43de-9b35-d852be3da06e admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:47.924824 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1b4aa-654c-43de-9b35-d852be3da06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:47.927363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1b4aa-654c-43de-9b35-d852be3da06e admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:47.934715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-759aa271-3831-43dd-9bd4-602ea4540050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cfebdb55a4947f99199f20df76a74ba', 'request_id': 'req-759aa271-3831-43dd-9bd4-602ea4540050'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:47.957334 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 847/1672] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:47.958515 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1b4aa-654c-43de-9b35-d852be3da06e admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:47.971891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1b4aa-654c-43de-9b35-d852be3da06e admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:48.014624 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-759aa271-3831-43dd-9bd4-602ea4540050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cfebdb55a4947f99199f20df76a74ba', 'request_id': 'req-759aa271-3831-43dd-9bd4-602ea4540050'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:48.029042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-759aa271-3831-43dd-9bd4-602ea4540050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cfebdb55a4947f99199f20df76a74ba', 'request_id': 'req-759aa271-3831-43dd-9bd4-602ea4540050'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:48.049249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-759aa271-3831-43dd-9bd4-602ea4540050 admin admin] The token cache is being invalidate because project 7cfebdb55a4947f99199f20df76a74ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:55:48.050932 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-759aa271-3831-43dd-9bd4-602ea4540050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:48.053928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-759aa271-3831-43dd-9bd4-602ea4540050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:48.057014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 826/1673] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:55:47 2022] DELETE /identity/v3/projects/7cfebdb55a4947f99199f20df76a74ba => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:55:48.065707 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f12df-48a8-4d32-9749-cf953d602f58 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:48.067109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f12df-48a8-4d32-9749-cf953d602f58 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:48.068871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f12df-48a8-4d32-9749-cf953d602f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:48.131620 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-9d2f12df-48a8-4d32-9749-cf953d602f58 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:48.135328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-9d2f12df-48a8-4d32-9749-cf953d602f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:48.142781 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44957950-8b75-4707-a59f-b5fdbff0e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:48.143696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44957950-8b75-4707-a59f-b5fdbff0e684 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:48.143980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44957950-8b75-4707-a59f-b5fdbff0e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:48.144258 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44957950-8b75-4707-a59f-b5fdbff0e684 admin admin] PATH_INFO: `/v3/projects/d9159b1023604de185a0a2400d24e2af/users/5cab57c09c334f3bb23f86d9ebfe1346/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:48.169349 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 827/1674] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:48.177984 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c521d-9e4e-457a-816c-e3a78d1c7e2e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:48.178453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c521d-9e4e-457a-816c-e3a78d1c7e2e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:48.178868 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c521d-9e4e-457a-816c-e3a78d1c7e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:48.183932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44957950-8b75-4707-a59f-b5fdbff0e684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9159b1023604de185a0a2400d24e2af, user_id=5cab57c09c334f3bb23f86d9ebfe1346, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:48.191146 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44957950-8b75-4707-a59f-b5fdbff0e684 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:48.209047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-cc3c521d-9e4e-457a-816c-e3a78d1c7e2e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:48.210526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-cc3c521d-9e4e-457a-816c-e3a78d1c7e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:48.222592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 828/1675] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:48.227772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c521d-9e4e-457a-816c-e3a78d1c7e2e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:48.239655 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c521d-9e4e-457a-816c-e3a78d1c7e2e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:48.259722 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95013d59-4a24-41e9-8f0e-41f58af247fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:48.260450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95013d59-4a24-41e9-8f0e-41f58af247fd admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:48.260761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95013d59-4a24-41e9-8f0e-41f58af247fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:48.261290 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95013d59-4a24-41e9-8f0e-41f58af247fd admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:48.262032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95013d59-4a24-41e9-8f0e-41f58af247fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:55:48.262517 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95013d59-4a24-41e9-8f0e-41f58af247fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:48.266974 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95013d59-4a24-41e9-8f0e-41f58af247fd admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:48.289205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 829/1676] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:55:48.293432 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95013d59-4a24-41e9-8f0e-41f58af247fd admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:48.315632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 848/1677] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:47 2022] PUT /identity/v3/projects/d9159b1023604de185a0a2400d24e2af/users/5cab57c09c334f3bb23f86d9ebfe1346/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:48.318596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf7ab0-6e98-4414-9e86-a71ef3e3fab0 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:48.319036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf7ab0-6e98-4414-9e86-a71ef3e3fab0 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:48.320343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf7ab0-6e98-4414-9e86-a71ef3e3fab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:48.336741 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95013d59-4a24-41e9-8f0e-41f58af247fd admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:48.409796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1acf7ab0-6e98-4414-9e86-a71ef3e3fab0 None None] MFA Rules not processed for user `5cab57c09c334f3bb23f86d9ebfe1346`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:48.412249 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1acf7ab0-6e98-4414-9e86-a71ef3e3fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:48.520412 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3b514-f740-4b99-bf8f-1660fa3e22b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:48.526480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b514-f740-4b99-bf8f-1660fa3e22b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:48.526480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b514-f740-4b99-bf8f-1660fa3e22b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:48.526480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b514-f740-4b99-bf8f-1660fa3e22b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:48.526480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3b514-f740-4b99-bf8f-1660fa3e22b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:48.530427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3b514-f740-4b99-bf8f-1660fa3e22b6 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:48.582755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 849/1678] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:48.585438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf7ab0-6e98-4414-9e86-a71ef3e3fab0 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:48.586914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1acf7ab0-6e98-4414-9e86-a71ef3e3fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:48.606135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf7ab0-6e98-4414-9e86-a71ef3e3fab0 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:48.616569 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93823d7-ba40-4853-85f5-23c9fc80388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:48.616569 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93823d7-ba40-4853-85f5-23c9fc80388f admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:48.616848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93823d7-ba40-4853-85f5-23c9fc80388f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:48.617188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93823d7-ba40-4853-85f5-23c9fc80388f admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:48.617909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93823d7-ba40-4853-85f5-23c9fc80388f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:48.620030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93823d7-ba40-4853-85f5-23c9fc80388f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:48.683288 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 830/1679] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:48 2022] POST /identity/v3/projects => generated 375 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:48.688455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3b514-f740-4b99-bf8f-1660fa3e22b6 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:48.764323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:48.776727 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 850/1680] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:48 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:55:48.777680 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93823d7-ba40-4853-85f5-23c9fc80388f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:48.867528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3b514-f740-4b99-bf8f-1660fa3e22b6 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:48.978149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93823d7-ba40-4853-85f5-23c9fc80388f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:48.990967 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989669f-54fd-44e5-8745-dc4a44241150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:48.991916 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989669f-54fd-44e5-8745-dc4a44241150 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:48.993001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989669f-54fd-44e5-8745-dc4a44241150 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:48.995474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989669f-54fd-44e5-8745-dc4a44241150 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:48.996632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989669f-54fd-44e5-8745-dc4a44241150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:49.002245 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989669f-54fd-44e5-8745-dc4a44241150 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:49.004119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f936afe-907d-4bf4-8738-c3982e77b74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:49.005098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f936afe-907d-4bf4-8738-c3982e77b74c admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:49.005576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f936afe-907d-4bf4-8738-c3982e77b74c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:49.006092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f936afe-907d-4bf4-8738-c3982e77b74c admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:49.007014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f936afe-907d-4bf4-8738-c3982e77b74c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:49.009237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f936afe-907d-4bf4-8738-c3982e77b74c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:49.117557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 851/1681] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:48 2022] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:49.121398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989669f-54fd-44e5-8745-dc4a44241150 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:49.147362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989669f-54fd-44e5-8745-dc4a44241150 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:49.153357 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f99f3-8f43-4f8b-80aa-5c282d6ec4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:49.154848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f99f3-8f43-4f8b-80aa-5c282d6ec4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:49.158975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f99f3-8f43-4f8b-80aa-5c282d6ec4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:49.158975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f99f3-8f43-4f8b-80aa-5c282d6ec4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:49.158975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f99f3-8f43-4f8b-80aa-5c282d6ec4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:49.158975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f99f3-8f43-4f8b-80aa-5c282d6ec4d4 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:49.161158 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:49.169083 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 831/1682] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:48 2022] POST /identity/v3/users => generated 288 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:55:49.173607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f936afe-907d-4bf4-8738-c3982e77b74c admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:49.182649 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 852/1683] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:55:49.190717 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f99f3-8f43-4f8b-80aa-5c282d6ec4d4 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:49.195444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f936afe-907d-4bf4-8738-c3982e77b74c admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:49.207837 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f99f3-8f43-4f8b-80aa-5c282d6ec4d4 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:49.223778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81930f24-1ed5-477a-95dc-36c68013299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:49.224623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81930f24-1ed5-477a-95dc-36c68013299c admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:49.224949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807405de-7636-4483-86d4-ba2135c7113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:49.225089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81930f24-1ed5-477a-95dc-36c68013299c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:49.225364 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81930f24-1ed5-477a-95dc-36c68013299c admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:49.225851 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807405de-7636-4483-86d4-ba2135c7113e admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:49.226135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807405de-7636-4483-86d4-ba2135c7113e admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:49.226412 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807405de-7636-4483-86d4-ba2135c7113e admin admin] PATH_INFO: `/v3/projects/d00da6583a6c4c09808e287b922e8bd8/users/884b3b1df1314231ab0dde0c267f410e/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:49.227141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81930f24-1ed5-477a-95dc-36c68013299c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:49.232279 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81930f24-1ed5-477a-95dc-36c68013299c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:49.256007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807405de-7636-4483-86d4-ba2135c7113e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00da6583a6c4c09808e287b922e8bd8, user_id=884b3b1df1314231ab0dde0c267f410e, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:49.258992 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807405de-7636-4483-86d4-ba2135c7113e admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:49.259757 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 832/1684] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:55:49.264408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81930f24-1ed5-477a-95dc-36c68013299c admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:49.284484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81930f24-1ed5-477a-95dc-36c68013299c admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:49.295865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99368a6-a99e-4039-9608-c0bc363de6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:49.296777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99368a6-a99e-4039-9608-c0bc363de6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:49.298096 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99368a6-a99e-4039-9608-c0bc363de6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:49.298921 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99368a6-a99e-4039-9608-c0bc363de6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:49.299770 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99368a6-a99e-4039-9608-c0bc363de6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:49.303554 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99368a6-a99e-4039-9608-c0bc363de6d4 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:49.327650 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 833/1685] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:55:49.335539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99368a6-a99e-4039-9608-c0bc363de6d4 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:49.351106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 853/1686] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:49 2022] PUT /identity/v3/projects/d00da6583a6c4c09808e287b922e8bd8/users/884b3b1df1314231ab0dde0c267f410e/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:55:49.355292 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99368a6-a99e-4039-9608-c0bc363de6d4 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:49.357005 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807405de-7636-4483-86d4-ba2135c7113e admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:49.489036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5fc51-3386-4297-8878-a31d31a54388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:49.490074 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5fc51-3386-4297-8878-a31d31a54388 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:49.493017 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5fc51-3386-4297-8878-a31d31a54388 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:49.497378 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5fc51-3386-4297-8878-a31d31a54388 admin admin] PATH_INFO: `/v3/projects/0cd6cd7219c44cc08060d5a80ed874a0/users/d41430b026454b62a0761971c006d870/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:49.535032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807405de-7636-4483-86d4-ba2135c7113e admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:49.537352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5fc51-3386-4297-8878-a31d31a54388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd6cd7219c44cc08060d5a80ed874a0, user_id=d41430b026454b62a0761971c006d870, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:49.542613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5fc51-3386-4297-8878-a31d31a54388 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:49.546434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563aa0a-396e-46fb-bdda-c47291211dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:49.547222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563aa0a-396e-46fb-bdda-c47291211dcc admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:49.547509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563aa0a-396e-46fb-bdda-c47291211dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:49.547782 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563aa0a-396e-46fb-bdda-c47291211dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:49.548580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563aa0a-396e-46fb-bdda-c47291211dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:49.553402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563aa0a-396e-46fb-bdda-c47291211dcc admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:49.580331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 854/1687] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:55:49.583214 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563aa0a-396e-46fb-bdda-c47291211dcc admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:49.609364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563aa0a-396e-46fb-bdda-c47291211dcc admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:49.620623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b702d30-fac3-4d97-8204-9dac842fe244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:49.621692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b702d30-fac3-4d97-8204-9dac842fe244 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:49.622187 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b702d30-fac3-4d97-8204-9dac842fe244 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:49.622398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b702d30-fac3-4d97-8204-9dac842fe244 admin admin] PATH_INFO: `/v3/projects/d00da6583a6c4c09808e287b922e8bd8/users/884b3b1df1314231ab0dde0c267f410e/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:49.627743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b702d30-fac3-4d97-8204-9dac842fe244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00da6583a6c4c09808e287b922e8bd8, user_id=884b3b1df1314231ab0dde0c267f410e, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:49.630456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b702d30-fac3-4d97-8204-9dac842fe244 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:49.660127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 834/1688] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:49 2022] PUT /identity/v3/projects/0cd6cd7219c44cc08060d5a80ed874a0/users/d41430b026454b62a0761971c006d870/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:49.661892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0698a5-5384-4e47-a88a-b533e7ea4c2c None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:49.662571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0698a5-5384-4e47-a88a-b533e7ea4c2c None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:49.663059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0698a5-5384-4e47-a88a-b533e7ea4c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:49.665526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 855/1689] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:49 2022] PUT /identity/v3/projects/d00da6583a6c4c09808e287b922e8bd8/users/884b3b1df1314231ab0dde0c267f410e/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:55:49.678635 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777eec-9d70-4121-8cd5-80b10dd55de7 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:49.678978 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777eec-9d70-4121-8cd5-80b10dd55de7 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:49.679515 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777eec-9d70-4121-8cd5-80b10dd55de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:49.702220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-ec0698a5-5384-4e47-a88a-b533e7ea4c2c None None] MFA Rules not processed for user `d41430b026454b62a0761971c006d870`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:49.707608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ec0698a5-5384-4e47-a88a-b533e7ea4c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:49.733533 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-15777eec-9d70-4121-8cd5-80b10dd55de7 None None] MFA Rules not processed for user `884b3b1df1314231ab0dde0c267f410e`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:49.735049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-15777eec-9d70-4121-8cd5-80b10dd55de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:49.821906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:49.835277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 835/1690] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:49.841600 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0698a5-5384-4e47-a88a-b533e7ea4c2c None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:49.910081 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 856/1691] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:55:49.911009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15777eec-9d70-4121-8cd5-80b10dd55de7 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:49.912555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-15777eec-9d70-4121-8cd5-80b10dd55de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:49.946404 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0698a5-5384-4e47-a88a-b533e7ea4c2c None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:49.953091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2222522-c42d-49de-95c6-160245c190a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:49.953761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2222522-c42d-49de-95c6-160245c190a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:49.954485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2222522-c42d-49de-95c6-160245c190a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:49.954485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2222522-c42d-49de-95c6-160245c190a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:49.955172 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2222522-c42d-49de-95c6-160245c190a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:49.960115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2222522-c42d-49de-95c6-160245c190a1 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:50.008348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15777eec-9d70-4121-8cd5-80b10dd55de7 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:50.022983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a3828-3bc6-43db-895c-dc196caee48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:50.023926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a3828-3bc6-43db-895c-dc196caee48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:50.024147 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a3828-3bc6-43db-895c-dc196caee48c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:50.024428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a3828-3bc6-43db-895c-dc196caee48c admin admin] PATH_INFO: `/v3/projects/6030b10a90fb421c88323d0d7927064d` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:50.025874 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a3828-3bc6-43db-895c-dc196caee48c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6030b10a90fb421c88323d0d7927064d)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:50.027813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a3828-3bc6-43db-895c-dc196caee48c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:50.149460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 836/1692] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:49 2022] POST /identity/v3/projects => generated 377 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:50.150783 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3536919-b196-4a06-bcad-3c8c2b891978 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:50.151072 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3536919-b196-4a06-bcad-3c8c2b891978 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:50.151425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3536919-b196-4a06-bcad-3c8c2b891978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:50.202202 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f3536919-b196-4a06-bcad-3c8c2b891978 None None] MFA Rules not processed for user `63ac57e741cf4d1aa9d61ccac8860f52`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:50.205731 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f3536919-b196-4a06-bcad-3c8c2b891978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:50.231173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-425a3828-3bc6-43db-895c-dc196caee48c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6030b10a90fb421c88323d0d7927064d', 'request_id': 'req-425a3828-3bc6-43db-895c-dc196caee48c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:50.240782 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-425a3828-3bc6-43db-895c-dc196caee48c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6030b10a90fb421c88323d0d7927064d', 'request_id': 'req-425a3828-3bc6-43db-895c-dc196caee48c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:50.308059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 837/1693] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:50.309461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3536919-b196-4a06-bcad-3c8c2b891978 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:50.311001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f3536919-b196-4a06-bcad-3c8c2b891978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:50.333014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-425a3828-3bc6-43db-895c-dc196caee48c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6030b10a90fb421c88323d0d7927064d', 'request_id': 'req-425a3828-3bc6-43db-895c-dc196caee48c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:50.355168 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-425a3828-3bc6-43db-895c-dc196caee48c admin admin] The token cache is being invalidate because project 6030b10a90fb421c88323d0d7927064d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:55:50.355664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-425a3828-3bc6-43db-895c-dc196caee48c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:50.356726 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-425a3828-3bc6-43db-895c-dc196caee48c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:50.359152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 857/1694] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:55:49 2022] DELETE /identity/v3/projects/6030b10a90fb421c88323d0d7927064d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:50.360104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a3828-3bc6-43db-895c-dc196caee48c admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:50.362711 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-425a3828-3bc6-43db-895c-dc196caee48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:50.451294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3536919-b196-4a06-bcad-3c8c2b891978 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:50.462459 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b0720-7e90-4703-ace9-01037a870465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:50.463442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b0720-7e90-4703-ace9-01037a870465 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:50.463724 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b0720-7e90-4703-ace9-01037a870465 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:50.463998 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b0720-7e90-4703-ace9-01037a870465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:50.469543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-5d5b0720-7e90-4703-ace9-01037a870465 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:50.516349 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a3828-3bc6-43db-895c-dc196caee48c admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:50.531247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530011a-8089-48c0-9aba-efe8c3dbe627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:50.532250 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530011a-8089-48c0-9aba-efe8c3dbe627 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:50.532732 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530011a-8089-48c0-9aba-efe8c3dbe627 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:50.533209 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530011a-8089-48c0-9aba-efe8c3dbe627 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:50.534090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530011a-8089-48c0-9aba-efe8c3dbe627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:50.536210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530011a-8089-48c0-9aba-efe8c3dbe627 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:50.590386 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b0720-7e90-4703-ace9-01037a870465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:50.600592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b0720-7e90-4703-ace9-01037a870465 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:50.622623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 838/1695] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:50.627375 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08650e2a-3d73-44db-a540-f330c6f3c819 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:50.627709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08650e2a-3d73-44db-a540-f330c6f3c819 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:50.628893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08650e2a-3d73-44db-a540-f330c6f3c819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:50.641224 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 858/1696] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:50 2022] POST /identity/v3/users => generated 295 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:50.642148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530011a-8089-48c0-9aba-efe8c3dbe627 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:50.646388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4530011a-8089-48c0-9aba-efe8c3dbe627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:50.680173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530011a-8089-48c0-9aba-efe8c3dbe627 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:50.693451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4d609-be7e-4f06-9221-e6570c84dbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:50.694797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4d609-be7e-4f06-9221-e6570c84dbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:50.695080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4d609-be7e-4f06-9221-e6570c84dbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:50.695363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4d609-be7e-4f06-9221-e6570c84dbe2 admin admin] PATH_INFO: `/v3/users/8cdc8d80cc89429fb5c996c26d695345` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:50.704699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-08650e2a-3d73-44db-a540-f330c6f3c819 None None] MFA Rules not processed for user `d93abd4361d240919ec85cf4b92347fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:50.705590 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4d609-be7e-4f06-9221-e6570c84dbe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cdc8d80cc89429fb5c996c26d695345)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:50.707576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4d609-be7e-4f06-9221-e6570c84dbe2 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:50.710077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-08650e2a-3d73-44db-a540-f330c6f3c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:50.804590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:50.883686 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 839/1697] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:50.883686 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08650e2a-3d73-44db-a540-f330c6f3c819 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:50.902798 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08650e2a-3d73-44db-a540-f330c6f3c819 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:50.916157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f5349-ae8a-46ed-8d02-f9624d56201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:50.916969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f5349-ae8a-46ed-8d02-f9624d56201e admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:50.917249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f5349-ae8a-46ed-8d02-f9624d56201e admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:50.917531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f5349-ae8a-46ed-8d02-f9624d56201e admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:50.918274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f5349-ae8a-46ed-8d02-f9624d56201e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:50.923303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f5349-ae8a-46ed-8d02-f9624d56201e admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:50.947051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 840/1698] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:50.952939 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f5349-ae8a-46ed-8d02-f9624d56201e admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:50.954790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-3c7f5349-ae8a-46ed-8d02-f9624d56201e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:50.969650 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f5349-ae8a-46ed-8d02-f9624d56201e admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:50.974552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:50.976541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9eef05-a3e4-4aef-989e-4a0ed4d048c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:50.977365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eef05-a3e4-4aef-989e-4a0ed4d048c8 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:50.977647 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eef05-a3e4-4aef-989e-4a0ed4d048c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:50.983934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eef05-a3e4-4aef-989e-4a0ed4d048c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:50.983934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-db9eef05-a3e4-4aef-989e-4a0ed4d048c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:50.984144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4ef4d609-be7e-4f06-9221-e6570c84dbe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cdc8d80cc89429fb5c996c26d695345'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:51.007978 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4ef4d609-be7e-4f06-9221-e6570c84dbe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cdc8d80cc89429fb5c996c26d695345'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:51.055618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9eef05-a3e4-4aef-989e-4a0ed4d048c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:51.057391 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9eef05-a3e4-4aef-989e-4a0ed4d048c8 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:51.068664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 841/1699] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:51.070402 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b82b5-db57-4065-9dc4-e2ce529460c0 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:51.070906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b82b5-db57-4065-9dc4-e2ce529460c0 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:51.071277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b82b5-db57-4065-9dc4-e2ce529460c0 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:51.072695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 842/1700] 10.222.0.44 () {54 vars in 961 bytes} [Mon Jun 27 14:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:55:51.073523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b82b5-db57-4065-9dc4-e2ce529460c0 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:51.090374 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b82b5-db57-4065-9dc4-e2ce529460c0 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:51.105447 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d92750-9780-4aab-88a0-7bdf58f40e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:51.105447 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d92750-9780-4aab-88a0-7bdf58f40e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:51.105447 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d92750-9780-4aab-88a0-7bdf58f40e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:51.105447 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d92750-9780-4aab-88a0-7bdf58f40e0a admin admin] PATH_INFO: `/v3/projects/49e9fc1b76274fa79e19bc3220fd9cbd/users/058efe3d813740b1a6aeb79affc7f399/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:51.120553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4ef4d609-be7e-4f06-9221-e6570c84dbe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cdc8d80cc89429fb5c996c26d695345'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:51.121916 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4ef4d609-be7e-4f06-9221-e6570c84dbe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cdc8d80cc89429fb5c996c26d695345'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:51.130833 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4ef4d609-be7e-4f06-9221-e6570c84dbe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cdc8d80cc89429fb5c996c26d695345'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:51.144468 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d92750-9780-4aab-88a0-7bdf58f40e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e9fc1b76274fa79e19bc3220fd9cbd, user_id=058efe3d813740b1a6aeb79affc7f399, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:51.147192 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d92750-9780-4aab-88a0-7bdf58f40e0a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:51.147543 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 859/1701] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:55:50 2022] DELETE /identity/v3/users/8cdc8d80cc89429fb5c996c26d695345 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:51.149571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe16d2c-6633-4b52-bfa9-b0a87ab1b02c None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:51.150709 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe16d2c-6633-4b52-bfa9-b0a87ab1b02c None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:51.151908 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe16d2c-6633-4b52-bfa9-b0a87ab1b02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:51.193429 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-afe16d2c-6633-4b52-bfa9-b0a87ab1b02c None None] MFA Rules not processed for user `08529776af224c36ab560c13f5941e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:51.199030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-afe16d2c-6633-4b52-bfa9-b0a87ab1b02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:51.252403 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 843/1702] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:51 2022] PUT /identity/v3/projects/49e9fc1b76274fa79e19bc3220fd9cbd/users/058efe3d813740b1a6aeb79affc7f399/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:51.253547 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d92750-9780-4aab-88a0-7bdf58f40e0a admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:51.257797 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-a5d92750-9780-4aab-88a0-7bdf58f40e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:51.305566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 860/1703] 10.222.0.44 () {58 vars in 1058 bytes} [Mon Jun 27 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:51.316927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe16d2c-6633-4b52-bfa9-b0a87ab1b02c None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:51.335611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe16d2c-6633-4b52-bfa9-b0a87ab1b02c None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:51.407873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d92750-9780-4aab-88a0-7bdf58f40e0a admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:51.421155 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27b39c-394c-4dd0-b697-43ab19bffdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:51.421845 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27b39c-394c-4dd0-b697-43ab19bffdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:51.422128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27b39c-394c-4dd0-b697-43ab19bffdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:51.422660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27b39c-394c-4dd0-b697-43ab19bffdb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:51.423531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27b39c-394c-4dd0-b697-43ab19bffdb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:51.437886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27b39c-394c-4dd0-b697-43ab19bffdb3 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:51.459943 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 844/1704] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:51.462037 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0219117-bc1e-45a4-b73b-7cc706146679 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:51.462710 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0219117-bc1e-45a4-b73b-7cc706146679 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:51.462995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0219117-bc1e-45a4-b73b-7cc706146679 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:51.463532 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0219117-bc1e-45a4-b73b-7cc706146679 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:51.465921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a0219117-bc1e-45a4-b73b-7cc706146679 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:51.466045 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27b39c-394c-4dd0-b697-43ab19bffdb3 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:51.491780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27b39c-394c-4dd0-b697-43ab19bffdb3 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:51.507656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7b46c-dfff-4124-b76c-09e30ce70edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:51.508672 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7b46c-dfff-4124-b76c-09e30ce70edc admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:51.508955 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7b46c-dfff-4124-b76c-09e30ce70edc admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:51.511799 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7b46c-dfff-4124-b76c-09e30ce70edc admin admin] PATH_INFO: `/v3/projects/49e9fc1b76274fa79e19bc3220fd9cbd/users/058efe3d813740b1a6aeb79affc7f399/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:51.515885 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7b46c-dfff-4124-b76c-09e30ce70edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e9fc1b76274fa79e19bc3220fd9cbd, user_id=058efe3d813740b1a6aeb79affc7f399, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:51.518603 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7b46c-dfff-4124-b76c-09e30ce70edc admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:51.554720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 845/1705] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:51 2022] PUT /identity/v3/projects/49e9fc1b76274fa79e19bc3220fd9cbd/users/058efe3d813740b1a6aeb79affc7f399/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:51.573768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c99cb8-4990-4d8c-9e46-5a11dc176893 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:51.574075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c99cb8-4990-4d8c-9e46-5a11dc176893 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:51.575578 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c99cb8-4990-4d8c-9e46-5a11dc176893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:51.634027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0219117-bc1e-45a4-b73b-7cc706146679 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:51.638128 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0219117-bc1e-45a4-b73b-7cc706146679 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:51.643257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f1c99cb8-4990-4d8c-9e46-5a11dc176893 None None] MFA Rules not processed for user `058efe3d813740b1a6aeb79affc7f399`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:51.648121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f1c99cb8-4990-4d8c-9e46-5a11dc176893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:51.686302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 861/1706] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:51.851101 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 846/1707] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:51.865610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0219117-bc1e-45a4-b73b-7cc706146679 service nova] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:51.867292 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a0219117-bc1e-45a4-b73b-7cc706146679 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:52.008842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:52.054054 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0219117-bc1e-45a4-b73b-7cc706146679 service nova] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:52.181304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:52.208626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752df870-48a9-48eb-a288-e1c174291021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:52.209192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752df870-48a9-48eb-a288-e1c174291021 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:52.209476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752df870-48a9-48eb-a288-e1c174291021 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:52.209752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752df870-48a9-48eb-a288-e1c174291021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:52.213702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-752df870-48a9-48eb-a288-e1c174291021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:52.366303 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752df870-48a9-48eb-a288-e1c174291021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:52.367756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752df870-48a9-48eb-a288-e1c174291021 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:52.404021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 862/1708] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:52.591877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c99cb8-4990-4d8c-9e46-5a11dc176893 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:52.594137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f1c99cb8-4990-4d8c-9e46-5a11dc176893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:52.846464 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c99cb8-4990-4d8c-9e46-5a11dc176893 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:52.866541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18b4ed-bd66-47ee-ae88-91935c83abaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:52.873993 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18b4ed-bd66-47ee-ae88-91935c83abaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:52.873993 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18b4ed-bd66-47ee-ae88-91935c83abaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:52.873993 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18b4ed-bd66-47ee-ae88-91935c83abaa admin admin] PATH_INFO: `/v3/projects/96df6dcdd19643459b13f77bf3c81932` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:52.880342 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18b4ed-bd66-47ee-ae88-91935c83abaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=96df6dcdd19643459b13f77bf3c81932)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:52.883627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18b4ed-bd66-47ee-ae88-91935c83abaa admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:52.907822 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:53.095317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8e18b4ed-bd66-47ee-ae88-91935c83abaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96df6dcdd19643459b13f77bf3c81932', 'request_id': 'req-8e18b4ed-bd66-47ee-ae88-91935c83abaa'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:53.178924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8e18b4ed-bd66-47ee-ae88-91935c83abaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96df6dcdd19643459b13f77bf3c81932', 'request_id': 'req-8e18b4ed-bd66-47ee-ae88-91935c83abaa'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:53.187548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8e18b4ed-bd66-47ee-ae88-91935c83abaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96df6dcdd19643459b13f77bf3c81932', 'request_id': 'req-8e18b4ed-bd66-47ee-ae88-91935c83abaa'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:53.212734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8e18b4ed-bd66-47ee-ae88-91935c83abaa admin admin] The token cache is being invalidate because project 96df6dcdd19643459b13f77bf3c81932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:55:53.213155 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8e18b4ed-bd66-47ee-ae88-91935c83abaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:53.213774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8e18b4ed-bd66-47ee-ae88-91935c83abaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:53.219712 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 847/1709] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:55:52 2022] DELETE /identity/v3/projects/96df6dcdd19643459b13f77bf3c81932 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:53.222911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2ed1e-21ec-463d-938a-8fa44c3419a7 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:53.226786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2ed1e-21ec-463d-938a-8fa44c3419a7 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:53.226786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2ed1e-21ec-463d-938a-8fa44c3419a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:53.294776 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-81a2ed1e-21ec-463d-938a-8fa44c3419a7 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:53.316087 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-81a2ed1e-21ec-463d-938a-8fa44c3419a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:53.404667 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:53.659340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:53.661266 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 863/1710] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:53.668450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ca774-2d63-4d7f-a9cc-af3c79db04f1 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:53.668623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ca774-2d63-4d7f-a9cc-af3c79db04f1 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:53.668880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ca774-2d63-4d7f-a9cc-af3c79db04f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:53.744101 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f98ca774-2d63-4d7f-a9cc-af3c79db04f1 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:53.752470 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f98ca774-2d63-4d7f-a9cc-af3c79db04f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:53.802255 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 848/1711] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:53.806376 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2ed1e-21ec-463d-938a-8fa44c3419a7 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:53.831850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2ed1e-21ec-463d-938a-8fa44c3419a7 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:53.864001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa83cf2-38ee-4a94-905a-764b35abeb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:53.864860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa83cf2-38ee-4a94-905a-764b35abeb68 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:53.865152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa83cf2-38ee-4a94-905a-764b35abeb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:53.865434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa83cf2-38ee-4a94-905a-764b35abeb68 admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:53.871700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa83cf2-38ee-4a94-905a-764b35abeb68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:55:53.872031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa83cf2-38ee-4a94-905a-764b35abeb68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:53.881366 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa83cf2-38ee-4a94-905a-764b35abeb68 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:53.957363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ca774-2d63-4d7f-a9cc-af3c79db04f1 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:53.957576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 864/1712] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:55:53.968678 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ca774-2d63-4d7f-a9cc-af3c79db04f1 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:53.987150 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12814d86-95e9-4ee5-84f7-0b7296f62f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:53.987833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12814d86-95e9-4ee5-84f7-0b7296f62f0c admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:53.988118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12814d86-95e9-4ee5-84f7-0b7296f62f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:53.988395 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12814d86-95e9-4ee5-84f7-0b7296f62f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:53.989134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12814d86-95e9-4ee5-84f7-0b7296f62f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:53.991050 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12814d86-95e9-4ee5-84f7-0b7296f62f0c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:54.051985 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a4096-9921-4b45-a184-8941f64682bb None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:54.052299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a4096-9921-4b45-a184-8941f64682bb None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:54.053030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a4096-9921-4b45-a184-8941f64682bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:54.146922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 849/1713] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:53 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:55:54.147405 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a47a4096-9921-4b45-a184-8941f64682bb None None] MFA Rules not processed for user `29e7fc2290a641bcb6f1f96501f98d69`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:54.149732 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a47a4096-9921-4b45-a184-8941f64682bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:54.151315 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12814d86-95e9-4ee5-84f7-0b7296f62f0c admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:54.330216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 865/1714] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:54.357606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12814d86-95e9-4ee5-84f7-0b7296f62f0c admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:54.361061 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:54.371177 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977fda7-6095-4064-82d3-7f85bf18c111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:54.371177 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977fda7-6095-4064-82d3-7f85bf18c111 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:54.371177 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977fda7-6095-4064-82d3-7f85bf18c111 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:54.371177 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977fda7-6095-4064-82d3-7f85bf18c111 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:54.371473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977fda7-6095-4064-82d3-7f85bf18c111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:54.377181 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977fda7-6095-4064-82d3-7f85bf18c111 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:54.431131 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13859df5-8cb4-4b85-9d3c-986c93d80ed1 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:54.431654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13859df5-8cb4-4b85-9d3c-986c93d80ed1 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:54.432181 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13859df5-8cb4-4b85-9d3c-986c93d80ed1 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:54.434275 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 866/1715] 10.222.0.44 () {54 vars in 961 bytes} [Mon Jun 27 14:55:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:55:54.448537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:54.470449 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35240510-295a-4b8f-b994-72572ac25e99 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:54.470449 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35240510-295a-4b8f-b994-72572ac25e99 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:54.470704 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35240510-295a-4b8f-b994-72572ac25e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:54.483876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 850/1716] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:54 2022] POST /identity/v3/users => generated 292 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:54.488142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977fda7-6095-4064-82d3-7f85bf18c111 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:54.511942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977fda7-6095-4064-82d3-7f85bf18c111 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:54.527898 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e7188-30fd-456b-b66d-cf37f4200cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:54.530115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e7188-30fd-456b-b66d-cf37f4200cef admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:54.531440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e7188-30fd-456b-b66d-cf37f4200cef admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:54.531440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e7188-30fd-456b-b66d-cf37f4200cef admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:54.532798 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e7188-30fd-456b-b66d-cf37f4200cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:54.538098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e7188-30fd-456b-b66d-cf37f4200cef admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:54.543583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-35240510-295a-4b8f-b994-72572ac25e99 None None] MFA Rules not processed for user `08529776af224c36ab560c13f5941e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:54.549499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-35240510-295a-4b8f-b994-72572ac25e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:54.571764 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 851/1717] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:55:54.572609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e7188-30fd-456b-b66d-cf37f4200cef admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:54.593419 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e7188-30fd-456b-b66d-cf37f4200cef admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:54.606065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171ff2d-46e6-4df4-986e-9b0679bba04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:54.607651 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ff2d-46e6-4df4-986e-9b0679bba04a admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:54.608109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ff2d-46e6-4df4-986e-9b0679bba04a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:54.608878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ff2d-46e6-4df4-986e-9b0679bba04a admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:54.610432 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171ff2d-46e6-4df4-986e-9b0679bba04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:54.616866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171ff2d-46e6-4df4-986e-9b0679bba04a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:54.641856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 852/1718] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:54.645738 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171ff2d-46e6-4df4-986e-9b0679bba04a admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:54.667895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171ff2d-46e6-4df4-986e-9b0679bba04a admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:54.685457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9052c-8b8d-48e9-995c-2116be39bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:54.687338 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9052c-8b8d-48e9-995c-2116be39bf31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:54.687809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9052c-8b8d-48e9-995c-2116be39bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:54.688269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9052c-8b8d-48e9-995c-2116be39bf31 admin admin] PATH_INFO: `/v3/projects/2eaf367443034b0e847c3aadf978c3ea/users/c2d00f37bc7c4e3aa4f987ee469eca48/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:54.720773 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9052c-8b8d-48e9-995c-2116be39bf31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eaf367443034b0e847c3aadf978c3ea, user_id=c2d00f37bc7c4e3aa4f987ee469eca48, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:54.724057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9052c-8b8d-48e9-995c-2116be39bf31 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:54.789612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 867/1719] 10.222.0.44 () {58 vars in 1058 bytes} [Mon Jun 27 14:55:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:55:54.802122 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35240510-295a-4b8f-b994-72572ac25e99 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:54.843082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 853/1720] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:54 2022] PUT /identity/v3/projects/2eaf367443034b0e847c3aadf978c3ea/users/c2d00f37bc7c4e3aa4f987ee469eca48/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:55:54.844872 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35240510-295a-4b8f-b994-72572ac25e99 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:54.854079 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec874d-f9ad-407c-a8d0-20b4de2da9de None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:54.854727 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec874d-f9ad-407c-a8d0-20b4de2da9de None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:54.855192 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec874d-f9ad-407c-a8d0-20b4de2da9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:54.925076 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-efec874d-f9ad-407c-a8d0-20b4de2da9de None None] MFA Rules not processed for user `c2d00f37bc7c4e3aa4f987ee469eca48`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:54.929994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-efec874d-f9ad-407c-a8d0-20b4de2da9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:55.045652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c452e-a47c-4d35-a0d8-ceb4d2a7a982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:55.048890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c452e-a47c-4d35-a0d8-ceb4d2a7a982 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:55.049888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c452e-a47c-4d35-a0d8-ceb4d2a7a982 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:55.050309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c452e-a47c-4d35-a0d8-ceb4d2a7a982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:55.065639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:55.078791 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 854/1721] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:55:55.078791 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48371d5e-91d7-4a2d-bc4e-b38415589092 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:55.078791 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48371d5e-91d7-4a2d-bc4e-b38415589092 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:55.078791 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48371d5e-91d7-4a2d-bc4e-b38415589092 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:55.084194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 855/1722] 10.222.0.44 () {54 vars in 921 bytes} [Mon Jun 27 14:55:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:55:55.085706 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48371d5e-91d7-4a2d-bc4e-b38415589092 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:55.205802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48371d5e-91d7-4a2d-bc4e-b38415589092 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:55.214028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3081b-a415-4deb-90e7-b1a5a30b41e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:55.214999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3081b-a415-4deb-90e7-b1a5a30b41e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:55.215437 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3081b-a415-4deb-90e7-b1a5a30b41e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:55.216501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3081b-a415-4deb-90e7-b1a5a30b41e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:55.217761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3081b-a415-4deb-90e7-b1a5a30b41e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:55.220321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3081b-a415-4deb-90e7-b1a5a30b41e6 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:55.231176 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c452e-a47c-4d35-a0d8-ceb4d2a7a982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:55.233753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c452e-a47c-4d35-a0d8-ceb4d2a7a982 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:55.278065 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 868/1723] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:55:55.280362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76536030-be7f-4c3a-8c4b-6427427d77e7 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:55.281050 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76536030-be7f-4c3a-8c4b-6427427d77e7 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:55.282944 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76536030-be7f-4c3a-8c4b-6427427d77e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:55.344343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 856/1724] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:55:55 2022] POST /identity/v3/projects => generated 383 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:55.345198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3081b-a415-4deb-90e7-b1a5a30b41e6 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:55.368071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-76536030-be7f-4c3a-8c4b-6427427d77e7 None None] MFA Rules not processed for user `f3ced893407a484e8ed0c4918438edf0`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:55.370090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-76536030-be7f-4c3a-8c4b-6427427d77e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:55.585627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3081b-a415-4deb-90e7-b1a5a30b41e6 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:55.592440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 869/1725] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Jun 27 14:55:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:55.605360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584bb93-5750-44a8-bcd8-9efaed139203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:55.606059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584bb93-5750-44a8-bcd8-9efaed139203 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:55.606343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584bb93-5750-44a8-bcd8-9efaed139203 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:55.606621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584bb93-5750-44a8-bcd8-9efaed139203 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:55.607441 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584bb93-5750-44a8-bcd8-9efaed139203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:55.623058 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584bb93-5750-44a8-bcd8-9efaed139203 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:55.624888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:55.671274 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf18322-4a79-4446-93f7-9c9f3c1310ec None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:55.671570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf18322-4a79-4446-93f7-9c9f3c1310ec None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:55.671866 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf18322-4a79-4446-93f7-9c9f3c1310ec None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:55.674455 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 870/1726] 10.222.0.44 () {54 vars in 960 bytes} [Mon Jun 27 14:55:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:55:55.687382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa19a5-11ba-4285-af07-35ef35089e50 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:55.688178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa19a5-11ba-4285-af07-35ef35089e50 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:55.688178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa19a5-11ba-4285-af07-35ef35089e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:55.725572 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 857/1727] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:55:55 2022] POST /identity/v3/users => generated 298 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:55:55.727119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584bb93-5750-44a8-bcd8-9efaed139203 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:55.747196 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-f1aa19a5-11ba-4285-af07-35ef35089e50 None None] MFA Rules not processed for user `f3ced893407a484e8ed0c4918438edf0`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:55.749964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f1aa19a5-11ba-4285-af07-35ef35089e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:55.754746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584bb93-5750-44a8-bcd8-9efaed139203 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:55.769270 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32077c2b-3d36-4ca9-a91e-9867452a2298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:55.769960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32077c2b-3d36-4ca9-a91e-9867452a2298 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:55.770248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32077c2b-3d36-4ca9-a91e-9867452a2298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:55.770527 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32077c2b-3d36-4ca9-a91e-9867452a2298 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:55.771414 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32077c2b-3d36-4ca9-a91e-9867452a2298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:55.781882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32077c2b-3d36-4ca9-a91e-9867452a2298 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:55.783663 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 871/1728] 10.222.0.44 () {58 vars in 1057 bytes} [Mon Jun 27 14:55:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:55.784670 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa19a5-11ba-4285-af07-35ef35089e50 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:55.809458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa19a5-11ba-4285-af07-35ef35089e50 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:55.828176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 858/1729] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:55:55.829211 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e04dc-d116-4e65-8430-0a98f535469b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:55.830927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e04dc-d116-4e65-8430-0a98f535469b service placement] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:55.831217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e04dc-d116-4e65-8430-0a98f535469b service placement] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:55.837083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e04dc-d116-4e65-8430-0a98f535469b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:55.838231 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32077c2b-3d36-4ca9-a91e-9867452a2298 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:55.869467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e04dc-d116-4e65-8430-0a98f535469b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:55.876608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32077c2b-3d36-4ca9-a91e-9867452a2298 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:55.877247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e04dc-d116-4e65-8430-0a98f535469b service placement] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:55.894333 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380a909-9701-4d24-bd4f-11be4ecb86fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:55.898427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a909-9701-4d24-bd4f-11be4ecb86fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:55.898821 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a909-9701-4d24-bd4f-11be4ecb86fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:55.899636 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a909-9701-4d24-bd4f-11be4ecb86fc admin admin] PATH_INFO: `/v3/projects/73ff905040f2415e9e4a7d5eb6f1d81b/users/7e6a5435673441a3abee1f8c4728b881/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:55.911989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 872/1730] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:55.934813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380a909-9701-4d24-bd4f-11be4ecb86fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ff905040f2415e9e4a7d5eb6f1d81b, user_id=7e6a5435673441a3abee1f8c4728b881, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:55.939126 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380a909-9701-4d24-bd4f-11be4ecb86fc admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:56.036685 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 859/1731] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:55 2022] PUT /identity/v3/projects/73ff905040f2415e9e4a7d5eb6f1d81b/users/7e6a5435673441a3abee1f8c4728b881/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:56.041385 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e04dc-d116-4e65-8430-0a98f535469b service placement] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:56.057856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e04dc-d116-4e65-8430-0a98f535469b service placement] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:56.058073 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:56.245143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c794dd-b7cc-49d5-9eed-a88596ca7967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:56.246138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c794dd-b7cc-49d5-9eed-a88596ca7967 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:56.246860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c794dd-b7cc-49d5-9eed-a88596ca7967 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:56.247350 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c794dd-b7cc-49d5-9eed-a88596ca7967 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:56.248517 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c794dd-b7cc-49d5-9eed-a88596ca7967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:56.255011 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c794dd-b7cc-49d5-9eed-a88596ca7967 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:56.294851 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 873/1732] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:55:56.295041 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380a909-9701-4d24-bd4f-11be4ecb86fc admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:56.309328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380a909-9701-4d24-bd4f-11be4ecb86fc admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:56.319926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbdbf0-a002-4776-9764-9c2c7f93fcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:56.321840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbdbf0-a002-4776-9764-9c2c7f93fcf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:56.322301 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbdbf0-a002-4776-9764-9c2c7f93fcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:56.322712 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbdbf0-a002-4776-9764-9c2c7f93fcf7 admin admin] PATH_INFO: `/v3/projects/73ff905040f2415e9e4a7d5eb6f1d81b/users/7e6a5435673441a3abee1f8c4728b881/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:56.326803 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbdbf0-a002-4776-9764-9c2c7f93fcf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ff905040f2415e9e4a7d5eb6f1d81b, user_id=7e6a5435673441a3abee1f8c4728b881, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:56.330570 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbdbf0-a002-4776-9764-9c2c7f93fcf7 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:56.354438 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 860/1733] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:55:56 2022] PUT /identity/v3/projects/73ff905040f2415e9e4a7d5eb6f1d81b/users/7e6a5435673441a3abee1f8c4728b881/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:56.358052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad8ef2-6531-4312-a806-f59464e77a6c None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:56.358273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad8ef2-6531-4312-a806-f59464e77a6c None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:56.358734 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad8ef2-6531-4312-a806-f59464e77a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:56.398642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-2cad8ef2-6531-4312-a806-f59464e77a6c None None] MFA Rules not processed for user `7e6a5435673441a3abee1f8c4728b881`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:56.402445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2cad8ef2-6531-4312-a806-f59464e77a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:56.603556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 874/1734] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:56.620766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbdbf0-a002-4776-9764-9c2c7f93fcf7 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:56.623214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-cffbdbf0-a002-4776-9764-9c2c7f93fcf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:56.767602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbdbf0-a002-4776-9764-9c2c7f93fcf7 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:56.777186 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998baf5c-9145-4884-9842-7cb720cecf68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:56.779635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998baf5c-9145-4884-9842-7cb720cecf68 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:56.785193 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998baf5c-9145-4884-9842-7cb720cecf68 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:56.785193 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998baf5c-9145-4884-9842-7cb720cecf68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:56.807286 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998baf5c-9145-4884-9842-7cb720cecf68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:56.819126 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998baf5c-9145-4884-9842-7cb720cecf68 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:56.840728 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 861/1735] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:57.396033 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:57.480010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad8ef2-6531-4312-a806-f59464e77a6c None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:57.484028 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2cad8ef2-6531-4312-a806-f59464e77a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:57.532888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad8ef2-6531-4312-a806-f59464e77a6c None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:57.542075 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758fd7-7d05-4f3f-a3d9-2cab67a2801d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:57.543163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758fd7-7d05-4f3f-a3d9-2cab67a2801d service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:57.543705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758fd7-7d05-4f3f-a3d9-2cab67a2801d service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:57.544201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758fd7-7d05-4f3f-a3d9-2cab67a2801d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:57.597189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:57.636425 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63758fd7-7d05-4f3f-a3d9-2cab67a2801d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:57.638148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63758fd7-7d05-4f3f-a3d9-2cab67a2801d service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:57.660266 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 875/1736] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:58.387871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998baf5c-9145-4884-9842-7cb720cecf68 service cinder] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:58.389826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-998baf5c-9145-4884-9842-7cb720cecf68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:58.400555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178e5d1-e69b-4e9d-a8bb-2390cc11ad15 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:58.401432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178e5d1-e69b-4e9d-a8bb-2390cc11ad15 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:58.401930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178e5d1-e69b-4e9d-a8bb-2390cc11ad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:58.505111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-e178e5d1-e69b-4e9d-a8bb-2390cc11ad15 None None] MFA Rules not processed for user `d93abd4361d240919ec85cf4b92347fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:58.507636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e178e5d1-e69b-4e9d-a8bb-2390cc11ad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:58.569181 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998baf5c-9145-4884-9842-7cb720cecf68 service cinder] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:58.579095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8f313-18e3-43df-a1b5-158f1c85ad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:58.580110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8f313-18e3-43df-a1b5-158f1c85ad2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:58.580506 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8f313-18e3-43df-a1b5-158f1c85ad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:58.581199 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8f313-18e3-43df-a1b5-158f1c85ad2f admin admin] PATH_INFO: `/v3/users/6d860e5068ff4a8791ad67ff346023db` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:58.584713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8f313-18e3-43df-a1b5-158f1c85ad2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d860e5068ff4a8791ad67ff346023db)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:58.599460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8f313-18e3-43df-a1b5-158f1c85ad2f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:58.701187 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 876/1737] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:58.703113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94577a3b-cf5c-4549-8549-1b2295c276c2 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:58.703407 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94577a3b-cf5c-4549-8549-1b2295c276c2 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:58.703687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94577a3b-cf5c-4549-8549-1b2295c276c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:58.793344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-94577a3b-cf5c-4549-8549-1b2295c276c2 None None] MFA Rules not processed for user `27b0e2428571450ea1d5edfd1c3b0f80`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:58.795116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-94577a3b-cf5c-4549-8549-1b2295c276c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:58.899975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f7e8f313-18e3-43df-a1b5-158f1c85ad2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d860e5068ff4a8791ad67ff346023db'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:58.937493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f7e8f313-18e3-43df-a1b5-158f1c85ad2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d860e5068ff4a8791ad67ff346023db'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:58.992688 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 877/1738] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:58.992688 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16501e8-0c7f-4918-993f-245404c3fc74 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:58.992688 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16501e8-0c7f-4918-993f-245404c3fc74 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:58.992688 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16501e8-0c7f-4918-993f-245404c3fc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:59.041327 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-f16501e8-0c7f-4918-993f-245404c3fc74 None None] MFA Rules not processed for user `340af9c8b53a483d9fc311b36736ca01`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:59.042600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f16501e8-0c7f-4918-993f-245404c3fc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:59.060552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f7e8f313-18e3-43df-a1b5-158f1c85ad2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d860e5068ff4a8791ad67ff346023db'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:59.063611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f7e8f313-18e3-43df-a1b5-158f1c85ad2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d860e5068ff4a8791ad67ff346023db'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:59.070984 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f7e8f313-18e3-43df-a1b5-158f1c85ad2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d860e5068ff4a8791ad67ff346023db'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:55:59.079413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 862/1739] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:55:58 2022] DELETE /identity/v3/users/6d860e5068ff4a8791ad67ff346023db => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:55:59.081319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842896d-c755-4c72-b809-b3020d4807d7 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:59.086557 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842896d-c755-4c72-b809-b3020d4807d7 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:59.086557 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842896d-c755-4c72-b809-b3020d4807d7 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:59.086557 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 863/1740] 10.222.0.44 () {54 vars in 912 bytes} [Mon Jun 27 14:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:55:59.107422 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f111358-d6bf-4630-94a9-1d144447dcc7 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:59.107736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f111358-d6bf-4630-94a9-1d144447dcc7 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:59.107994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f111358-d6bf-4630-94a9-1d144447dcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:59.152672 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:59.163187 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-1f111358-d6bf-4630-94a9-1d144447dcc7 None None] MFA Rules not processed for user `27b0e2428571450ea1d5edfd1c3b0f80`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:59.164431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-1f111358-d6bf-4630-94a9-1d144447dcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:59.166485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 878/1741] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:59.171709 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c4cb6-3c43-4ba5-a0ab-8f2a9725a58f None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:59.172258 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c4cb6-3c43-4ba5-a0ab-8f2a9725a58f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:59.172706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c4cb6-3c43-4ba5-a0ab-8f2a9725a58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:59.198362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-b92c4cb6-3c43-4ba5-a0ab-8f2a9725a58f None None] MFA Rules not processed for user `08529776af224c36ab560c13f5941e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:59.199850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b92c4cb6-3c43-4ba5-a0ab-8f2a9725a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:59.295831 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 864/1742] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:59.297651 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d081dc-03c7-4433-a941-345695fd69ad None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:59.298501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d081dc-03c7-4433-a941-345695fd69ad None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:59.299985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d081dc-03c7-4433-a941-345695fd69ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:59.334284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-d7d081dc-03c7-4433-a941-345695fd69ad None None] MFA Rules not processed for user `340af9c8b53a483d9fc311b36736ca01`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:59.335608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-d7d081dc-03c7-4433-a941-345695fd69ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:59.342943 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 879/1743] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Jun 27 14:55:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:59.343837 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c4cb6-3c43-4ba5-a0ab-8f2a9725a58f None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:59.348539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b92c4cb6-3c43-4ba5-a0ab-8f2a9725a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:59.351299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:55:59.389554 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c4cb6-3c43-4ba5-a0ab-8f2a9725a58f None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:59.411204 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d57b95-7acb-4eb1-896d-abe0e69f7fe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:59.411884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d57b95-7acb-4eb1-896d-abe0e69f7fe6 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:59.412234 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d57b95-7acb-4eb1-896d-abe0e69f7fe6 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:59.412432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d57b95-7acb-4eb1-896d-abe0e69f7fe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:59.416010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-76d57b95-7acb-4eb1-896d-abe0e69f7fe6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:59.464055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d57b95-7acb-4eb1-896d-abe0e69f7fe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:59.464055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d57b95-7acb-4eb1-896d-abe0e69f7fe6 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:59.472025 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 865/1744] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:55:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:55:59.477949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d081dc-03c7-4433-a941-345695fd69ad None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:59.481170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-d7d081dc-03c7-4433-a941-345695fd69ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:59.498748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 880/1745] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:59.554872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d081dc-03c7-4433-a941-345695fd69ad None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:59.560753 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071295d-50de-4091-b506-9f7facbca8bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e93d0321eaa4936a55390155d5aab0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:59.561828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071295d-50de-4091-b506-9f7facbca8bf service glance] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:59.562110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071295d-50de-4091-b506-9f7facbca8bf service glance] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:59.562386 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071295d-50de-4091-b506-9f7facbca8bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:59.589962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d57b95-7acb-4eb1-896d-abe0e69f7fe6 service nova] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:59.593975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071295d-50de-4091-b506-9f7facbca8bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:59.595284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-76d57b95-7acb-4eb1-896d-abe0e69f7fe6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:59.610541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071295d-50de-4091-b506-9f7facbca8bf service glance] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:59.651057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 866/1746] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:55:59.670189 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f804a20-f701-46ac-96aa-5ee001fb1dc8 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:59.670899 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f804a20-f701-46ac-96aa-5ee001fb1dc8 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:59.671328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f804a20-f701-46ac-96aa-5ee001fb1dc8 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:59.673252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 867/1747] 10.222.0.44 () {54 vars in 912 bytes} [Mon Jun 27 14:55:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:55:59.679518 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6c49-bf82-4496-8f84-5c1ee961e8ec None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:59.680069 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6c49-bf82-4496-8f84-5c1ee961e8ec None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:59.680496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6c49-bf82-4496-8f84-5c1ee961e8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:59.759463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-df3b6c49-bf82-4496-8f84-5c1ee961e8ec None None] MFA Rules not processed for user `08529776af224c36ab560c13f5941e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:55:59.759463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-df3b6c49-bf82-4496-8f84-5c1ee961e8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:55:59.762448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d57b95-7acb-4eb1-896d-abe0e69f7fe6 service nova] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:59.784863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2a6eb-d757-4823-8586-251e9791683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:59.785774 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2a6eb-d757-4823-8586-251e9791683b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:59.786105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2a6eb-d757-4823-8586-251e9791683b admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:59.786387 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2a6eb-d757-4823-8586-251e9791683b admin admin] PATH_INFO: `/v3/projects/4de3ea0da91d45e9b27b943d69f394c7` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:59.788164 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2a6eb-d757-4823-8586-251e9791683b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de3ea0da91d45e9b27b943d69f394c7)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:59.791965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2a6eb-d757-4823-8586-251e9791683b admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:59.795241 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 868/1748] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Jun 27 14:55:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:55:59.824332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b6c49-bf82-4496-8f84-5c1ee961e8ec None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:55:59.851578 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b6c49-bf82-4496-8f84-5c1ee961e8ec None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:55:59.863979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568726d-216c-441b-a6b4-cc210ba78ef8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e93d0321eaa4936a55390155d5aab0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:55:59.865146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568726d-216c-441b-a6b4-cc210ba78ef8 service glance] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:55:59.865430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568726d-216c-441b-a6b4-cc210ba78ef8 service glance] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:55:59.865703 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568726d-216c-441b-a6b4-cc210ba78ef8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:55:59.893590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568726d-216c-441b-a6b4-cc210ba78ef8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:55:59.895042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568726d-216c-441b-a6b4-cc210ba78ef8 service glance] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:55:59.940143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 869/1749] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:55:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:00.037593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a8d2a6eb-d757-4823-8586-251e9791683b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de3ea0da91d45e9b27b943d69f394c7', 'request_id': 'req-a8d2a6eb-d757-4823-8586-251e9791683b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:00.057318 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a8d2a6eb-d757-4823-8586-251e9791683b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de3ea0da91d45e9b27b943d69f394c7', 'request_id': 'req-a8d2a6eb-d757-4823-8586-251e9791683b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:00.151616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a8d2a6eb-d757-4823-8586-251e9791683b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de3ea0da91d45e9b27b943d69f394c7', 'request_id': 'req-a8d2a6eb-d757-4823-8586-251e9791683b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:00.181069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a8d2a6eb-d757-4823-8586-251e9791683b admin admin] The token cache is being invalidate because project 4de3ea0da91d45e9b27b943d69f394c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:00.181594 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a8d2a6eb-d757-4823-8586-251e9791683b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:00.182456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a8d2a6eb-d757-4823-8586-251e9791683b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:00.184682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 881/1750] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:55:59 2022] DELETE /identity/v3/projects/4de3ea0da91d45e9b27b943d69f394c7 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:00.190877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568726d-216c-441b-a6b4-cc210ba78ef8 service glance] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:00.205631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568726d-216c-441b-a6b4-cc210ba78ef8 service glance] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:00.381876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4acd9-cbda-4cec-b554-61817ff0a91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:00.382496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4acd9-cbda-4cec-b554-61817ff0a91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:00.392280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4acd9-cbda-4cec-b554-61817ff0a91f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:00.392745 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4acd9-cbda-4cec-b554-61817ff0a91f admin admin] PATH_INFO: `/v3/users/63ac57e741cf4d1aa9d61ccac8860f52` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:00.395874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4acd9-cbda-4cec-b554-61817ff0a91f admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ac57e741cf4d1aa9d61ccac8860f52)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:00.397835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4acd9-cbda-4cec-b554-61817ff0a91f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:00.604825 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45a009-4f03-4c5e-a0a6-77794871dc15 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:00.605297 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45a009-4f03-4c5e-a0a6-77794871dc15 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:00.605400 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45a009-4f03-4c5e-a0a6-77794871dc15 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:00.608206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 882/1751] 10.222.0.44 () {54 vars in 912 bytes} [Mon Jun 27 14:56:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 14:56:00.617102 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850e278-5754-4044-8802-0109cd6ed58d None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:00.617566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850e278-5754-4044-8802-0109cd6ed58d None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:00.618032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850e278-5754-4044-8802-0109cd6ed58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:00.641175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:00.680863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d850e278-5754-4044-8802-0109cd6ed58d None None] MFA Rules not processed for user `bdf31d7d8c164809bde0e12b71ecfca0`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:00.682925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d850e278-5754-4044-8802-0109cd6ed58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:00.701110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e1e4acd9-cbda-4cec-b554-61817ff0a91f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ac57e741cf4d1aa9d61ccac8860f52'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:00.738224 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e1e4acd9-cbda-4cec-b554-61817ff0a91f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ac57e741cf4d1aa9d61ccac8860f52'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:00.820148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e1e4acd9-cbda-4cec-b554-61817ff0a91f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ac57e741cf4d1aa9d61ccac8860f52'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:00.821014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e1e4acd9-cbda-4cec-b554-61817ff0a91f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ac57e741cf4d1aa9d61ccac8860f52'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:00.827240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 883/1752] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Jun 27 14:56:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:00.831100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e1e4acd9-cbda-4cec-b554-61817ff0a91f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ac57e741cf4d1aa9d61ccac8860f52'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:00.833379 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d71692-2677-48d2-ad0d-90549fd87c9f None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:00.833820 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d71692-2677-48d2-ad0d-90549fd87c9f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:00.834173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d71692-2677-48d2-ad0d-90549fd87c9f None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:00.836068 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 884/1753] 10.222.0.44 () {54 vars in 912 bytes} [Mon Jun 27 14:56:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:56:00.840774 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d71692-2677-48d2-ad0d-90549fd87c9f None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:00.842940 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-78d71692-2677-48d2-ad0d-90549fd87c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:00.856103 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 870/1754] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:00 2022] DELETE /identity/v3/users/63ac57e741cf4d1aa9d61ccac8860f52 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:00.864114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522eda8-9af2-4866-8a2c-2a538ba9b48b None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:00.864806 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522eda8-9af2-4866-8a2c-2a538ba9b48b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:00.870035 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522eda8-9af2-4866-8a2c-2a538ba9b48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:00.879774 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d71692-2677-48d2-ad0d-90549fd87c9f None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:00.888009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:00.940967 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-0522eda8-9af2-4866-8a2c-2a538ba9b48b None None] MFA Rules not processed for user `bdf31d7d8c164809bde0e12b71ecfca0`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:00.944902 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0522eda8-9af2-4866-8a2c-2a538ba9b48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:00.978060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03b104-b09d-4201-8ac6-b2ecec02346c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:00.979002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03b104-b09d-4201-8ac6-b2ecec02346c service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:00.979444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03b104-b09d-4201-8ac6-b2ecec02346c service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:00.979873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03b104-b09d-4201-8ac6-b2ecec02346c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:00.985824 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1e03b104-b09d-4201-8ac6-b2ecec02346c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:01.007769 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03b104-b09d-4201-8ac6-b2ecec02346c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:01.009323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03b104-b09d-4201-8ac6-b2ecec02346c service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:01.052206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 885/1755] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:56:01.058398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 871/1756] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Jun 27 14:56:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:01.083127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03b104-b09d-4201-8ac6-b2ecec02346c service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:01.088028 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1e03b104-b09d-4201-8ac6-b2ecec02346c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:01.108353 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03b104-b09d-4201-8ac6-b2ecec02346c service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:01.116916 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bc84a-5206-4a0d-88fa-8dda9c9e87e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:01.120470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bc84a-5206-4a0d-88fa-8dda9c9e87e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:01.120819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bc84a-5206-4a0d-88fa-8dda9c9e87e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:01.121099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bc84a-5206-4a0d-88fa-8dda9c9e87e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:01.153368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3bc84a-5206-4a0d-88fa-8dda9c9e87e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:01.160095 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3bc84a-5206-4a0d-88fa-8dda9c9e87e3 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:01.177743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 886/1757] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:01.529630 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522eda8-9af2-4866-8a2c-2a538ba9b48b None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:01.531316 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0522eda8-9af2-4866-8a2c-2a538ba9b48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:01.688141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522eda8-9af2-4866-8a2c-2a538ba9b48b None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:01.693440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c826-7cd9-4c35-8386-75ebd7b23445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:01.694890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c826-7cd9-4c35-8386-75ebd7b23445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:01.695174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c826-7cd9-4c35-8386-75ebd7b23445 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:01.700164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c826-7cd9-4c35-8386-75ebd7b23445 admin admin] PATH_INFO: `/v3/projects/1f1d07f25f4c48fb98386b10c65040b8` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:01.700164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786c826-7cd9-4c35-8386-75ebd7b23445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1d07f25f4c48fb98386b10c65040b8)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:01.700164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786c826-7cd9-4c35-8386-75ebd7b23445 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:01.759977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bc84a-5206-4a0d-88fa-8dda9c9e87e3 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:01.766203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4b3bc84a-5206-4a0d-88fa-8dda9c9e87e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:01.862304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6786c826-7cd9-4c35-8386-75ebd7b23445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1d07f25f4c48fb98386b10c65040b8', 'request_id': 'req-6786c826-7cd9-4c35-8386-75ebd7b23445'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:01.914426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bc84a-5206-4a0d-88fa-8dda9c9e87e3 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:01.944050 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6786c826-7cd9-4c35-8386-75ebd7b23445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1d07f25f4c48fb98386b10c65040b8', 'request_id': 'req-6786c826-7cd9-4c35-8386-75ebd7b23445'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:01.954755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6786c826-7cd9-4c35-8386-75ebd7b23445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1d07f25f4c48fb98386b10c65040b8', 'request_id': 'req-6786c826-7cd9-4c35-8386-75ebd7b23445'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:01.983334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6786c826-7cd9-4c35-8386-75ebd7b23445 admin admin] The token cache is being invalidate because project 1f1d07f25f4c48fb98386b10c65040b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:01.983334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6786c826-7cd9-4c35-8386-75ebd7b23445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:01.986675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6786c826-7cd9-4c35-8386-75ebd7b23445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:01.993113 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 872/1758] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:01 2022] DELETE /identity/v3/projects/1f1d07f25f4c48fb98386b10c65040b8 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:01.995929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c826-7cd9-4c35-8386-75ebd7b23445 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:02.000139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6786c826-7cd9-4c35-8386-75ebd7b23445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:02.015967 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:02.078572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33cdb6-e3e9-4cbb-a1b3-8d2b16d91d52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:02.079395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33cdb6-e3e9-4cbb-a1b3-8d2b16d91d52 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:02.079781 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33cdb6-e3e9-4cbb-a1b3-8d2b16d91d52 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:02.080736 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33cdb6-e3e9-4cbb-a1b3-8d2b16d91d52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:02.083223 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-3d33cdb6-e3e9-4cbb-a1b3-8d2b16d91d52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:02.152089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c826-7cd9-4c35-8386-75ebd7b23445 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:02.160040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e43b82-99e7-4b62-b9df-8753428990c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:02.160760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e43b82-99e7-4b62-b9df-8753428990c3 service placement] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:02.161047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e43b82-99e7-4b62-b9df-8753428990c3 service placement] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:02.161329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e43b82-99e7-4b62-b9df-8753428990c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:02.163975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-41e43b82-99e7-4b62-b9df-8753428990c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:02.179065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e43b82-99e7-4b62-b9df-8753428990c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:02.181030 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e43b82-99e7-4b62-b9df-8753428990c3 service placement] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:02.193403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33cdb6-e3e9-4cbb-a1b3-8d2b16d91d52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:02.195002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33cdb6-e3e9-4cbb-a1b3-8d2b16d91d52 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:02.207346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 887/1759] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:56:02.208627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3233bf-3224-4599-bf6c-4ba2440c8f11 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:02.209064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3233bf-3224-4599-bf6c-4ba2440c8f11 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:02.209390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3233bf-3224-4599-bf6c-4ba2440c8f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:02.236827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 873/1760] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:02.269070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-3a3233bf-3224-4599-bf6c-4ba2440c8f11 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:02.271276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-3a3233bf-3224-4599-bf6c-4ba2440c8f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:02.280513 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570c5ff-6697-4ac7-a1cd-64763c096488 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:02.281196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570c5ff-6697-4ac7-a1cd-64763c096488 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:02.281196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570c5ff-6697-4ac7-a1cd-64763c096488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:02.322303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-d570c5ff-6697-4ac7-a1cd-64763c096488 None None] MFA Rules not processed for user `29e7fc2290a641bcb6f1f96501f98d69`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:02.323594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-d570c5ff-6697-4ac7-a1cd-64763c096488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:02.356060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:02.575046 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 888/1761] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:02.583042 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b21867-e6f9-43ae-b45b-e3a11d810e66 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:02.583333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b21867-e6f9-43ae-b45b-e3a11d810e66 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:02.583614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b21867-e6f9-43ae-b45b-e3a11d810e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:02.589284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 874/1762] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:02.678715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-13b21867-e6f9-43ae-b45b-e3a11d810e66 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:02.679965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-13b21867-e6f9-43ae-b45b-e3a11d810e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:02.725876 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 889/1763] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:02.727385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570c5ff-6697-4ac7-a1cd-64763c096488 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:02.748443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570c5ff-6697-4ac7-a1cd-64763c096488 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:02.772159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08b88-35a0-49f3-9997-8b1035f441cb None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:02.772790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08b88-35a0-49f3-9997-8b1035f441cb None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:02.772790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08b88-35a0-49f3-9997-8b1035f441cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:02.774391 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c637656-b0ec-4ed3-a029-d2fd47310e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:02.775847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c637656-b0ec-4ed3-a029-d2fd47310e6c admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:02.775847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c637656-b0ec-4ed3-a029-d2fd47310e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:02.775847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c637656-b0ec-4ed3-a029-d2fd47310e6c admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:02.776497 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c637656-b0ec-4ed3-a029-d2fd47310e6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:56:02.776852 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c637656-b0ec-4ed3-a029-d2fd47310e6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:02.778974 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c637656-b0ec-4ed3-a029-d2fd47310e6c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:02.798779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 875/1764] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:56:02.800428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c637656-b0ec-4ed3-a029-d2fd47310e6c admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:02.817821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-b2c08b88-35a0-49f3-9997-8b1035f441cb None None] MFA Rules not processed for user `27b0e2428571450ea1d5edfd1c3b0f80`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:02.819333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b2c08b88-35a0-49f3-9997-8b1035f441cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:02.824463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c637656-b0ec-4ed3-a029-d2fd47310e6c admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:02.832309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950cca4-09fe-4427-8b88-62eae57f725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:02.833111 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950cca4-09fe-4427-8b88-62eae57f725a admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:02.833398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950cca4-09fe-4427-8b88-62eae57f725a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:02.834045 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950cca4-09fe-4427-8b88-62eae57f725a admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:02.834836 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950cca4-09fe-4427-8b88-62eae57f725a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:02.836876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950cca4-09fe-4427-8b88-62eae57f725a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:02.926823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 890/1765] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:02.958267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08b88-35a0-49f3-9997-8b1035f441cb None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:02.960053 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 876/1766] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:02 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:02.971597 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08b88-35a0-49f3-9997-8b1035f441cb None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:02.979255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:03.127868 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963dc26-3a11-4c3d-9443-a4d86e3a9e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:03.128551 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963dc26-3a11-4c3d-9443-a4d86e3a9e2f admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:03.128879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963dc26-3a11-4c3d-9443-a4d86e3a9e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:03.129251 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963dc26-3a11-4c3d-9443-a4d86e3a9e2f admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:03.129958 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963dc26-3a11-4c3d-9443-a4d86e3a9e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:03.131924 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963dc26-3a11-4c3d-9443-a4d86e3a9e2f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:03.291121 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 891/1767] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:02 2022] POST /identity/v3/users => generated 286 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:03.295376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950cca4-09fe-4427-8b88-62eae57f725a admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:03.318704 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950cca4-09fe-4427-8b88-62eae57f725a admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:03.326896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf388b2-794a-455e-8aba-6f666006a307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:03.327602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf388b2-794a-455e-8aba-6f666006a307 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:03.327884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf388b2-794a-455e-8aba-6f666006a307 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:03.328160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf388b2-794a-455e-8aba-6f666006a307 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:03.328960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf388b2-794a-455e-8aba-6f666006a307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:03.331556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf388b2-794a-455e-8aba-6f666006a307 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:03.354508 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 877/1768] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:03.359562 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963dc26-3a11-4c3d-9443-a4d86e3a9e2f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:03.393541 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963dc26-3a11-4c3d-9443-a4d86e3a9e2f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:03.399072 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013fb9e-28cd-4bb2-ac00-92bd3e966950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:03.399790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013fb9e-28cd-4bb2-ac00-92bd3e966950 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:03.400066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013fb9e-28cd-4bb2-ac00-92bd3e966950 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:03.400337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013fb9e-28cd-4bb2-ac00-92bd3e966950 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:03.401149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013fb9e-28cd-4bb2-ac00-92bd3e966950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:03.402866 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013fb9e-28cd-4bb2-ac00-92bd3e966950 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:03.437152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 892/1769] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:03.438129 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf388b2-794a-455e-8aba-6f666006a307 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:03.452773 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf388b2-794a-455e-8aba-6f666006a307 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:03.462264 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944159fd-16e2-46e2-80c8-443b68224863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:03.463282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944159fd-16e2-46e2-80c8-443b68224863 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:03.463681 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944159fd-16e2-46e2-80c8-443b68224863 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:03.464066 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944159fd-16e2-46e2-80c8-443b68224863 admin admin] PATH_INFO: `/v3/projects/3517a413bfa941e098e328408ce43d08/users/55b699a0822140bf930c6ddc15e2a9d2/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:03.499245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944159fd-16e2-46e2-80c8-443b68224863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3517a413bfa941e098e328408ce43d08, user_id=55b699a0822140bf930c6ddc15e2a9d2, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:03.504205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944159fd-16e2-46e2-80c8-443b68224863 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:03.591628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 878/1770] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:03 2022] PUT /identity/v3/projects/3517a413bfa941e098e328408ce43d08/users/55b699a0822140bf930c6ddc15e2a9d2/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:03.601911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad989f52-acd5-481d-ba33-92a4eadca227 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:03.602206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad989f52-acd5-481d-ba33-92a4eadca227 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:03.602571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad989f52-acd5-481d-ba33-92a4eadca227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:03.654702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-ad989f52-acd5-481d-ba33-92a4eadca227 None None] MFA Rules not processed for user `55b699a0822140bf930c6ddc15e2a9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:03.658231 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-ad989f52-acd5-481d-ba33-92a4eadca227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:03.811124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 893/1771] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:03.815700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944159fd-16e2-46e2-80c8-443b68224863 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:03.900272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:03.994780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944159fd-16e2-46e2-80c8-443b68224863 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:04.017167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd48f1d-06fb-4c01-ba3a-967518a5a1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:04.018819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd48f1d-06fb-4c01-ba3a-967518a5a1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:04.019396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd48f1d-06fb-4c01-ba3a-967518a5a1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:04.019808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd48f1d-06fb-4c01-ba3a-967518a5a1d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:04.020689 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd48f1d-06fb-4c01-ba3a-967518a5a1d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:04.023634 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd48f1d-06fb-4c01-ba3a-967518a5a1d9 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:04.164461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 879/1772] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:03 2022] POST /identity/v3/projects => generated 371 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:04.165887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad989f52-acd5-481d-ba33-92a4eadca227 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:04.196135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad989f52-acd5-481d-ba33-92a4eadca227 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:04.355597 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634dad3-04a6-4901-b477-303654bd4d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:04.356682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634dad3-04a6-4901-b477-303654bd4d2c admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:04.358193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634dad3-04a6-4901-b477-303654bd4d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:04.358616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634dad3-04a6-4901-b477-303654bd4d2c admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:04.359475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634dad3-04a6-4901-b477-303654bd4d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:04.363893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634dad3-04a6-4901-b477-303654bd4d2c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:04.506560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 894/1773] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:04 2022] POST /identity/v3/users => generated 292 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:04.510230 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd48f1d-06fb-4c01-ba3a-967518a5a1d9 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:04.523167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd48f1d-06fb-4c01-ba3a-967518a5a1d9 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:04.529576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6684-08dd-4809-b9fe-88c71b19ca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:04.530504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6684-08dd-4809-b9fe-88c71b19ca44 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:04.531193 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6684-08dd-4809-b9fe-88c71b19ca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:04.531740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6684-08dd-4809-b9fe-88c71b19ca44 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:04.532673 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f6684-08dd-4809-b9fe-88c71b19ca44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:04.534565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f6684-08dd-4809-b9fe-88c71b19ca44 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:04.549543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 880/1774] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:04.553426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634dad3-04a6-4901-b477-303654bd4d2c admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:04.583005 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634dad3-04a6-4901-b477-303654bd4d2c admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:04.593541 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eb4af-be5d-47a1-b896-677cc27d2a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:04.594499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eb4af-be5d-47a1-b896-677cc27d2a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:04.594777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eb4af-be5d-47a1-b896-677cc27d2a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:04.595050 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eb4af-be5d-47a1-b896-677cc27d2a79 admin admin] PATH_INFO: `/v3/projects/bea04f8fa5cf4a34b3e99d3ee894aabe/users/43ade04bb86d46d0beb71ec236321a18/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:04.597677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:04.629229 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58eb4af-be5d-47a1-b896-677cc27d2a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea04f8fa5cf4a34b3e99d3ee894aabe, user_id=43ade04bb86d46d0beb71ec236321a18, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:04.632321 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58eb4af-be5d-47a1-b896-677cc27d2a79 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:04.751666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 895/1775] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:04 2022] PUT /identity/v3/projects/bea04f8fa5cf4a34b3e99d3ee894aabe/users/43ade04bb86d46d0beb71ec236321a18/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:56:04.755845 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6684-08dd-4809-b9fe-88c71b19ca44 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:04.775993 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6684-08dd-4809-b9fe-88c71b19ca44 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:04.841357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459d8ec-24af-4999-9375-fbadae6ecca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:04.842050 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459d8ec-24af-4999-9375-fbadae6ecca8 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:04.842348 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459d8ec-24af-4999-9375-fbadae6ecca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:04.842655 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459d8ec-24af-4999-9375-fbadae6ecca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:04.843560 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459d8ec-24af-4999-9375-fbadae6ecca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:04.845213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459d8ec-24af-4999-9375-fbadae6ecca8 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:04.851545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eb4af-be5d-47a1-b896-677cc27d2a79 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:04.853465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-c58eb4af-be5d-47a1-b896-677cc27d2a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:04.857014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 881/1776] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:04.861385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459d8ec-24af-4999-9375-fbadae6ecca8 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:04.871361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459d8ec-24af-4999-9375-fbadae6ecca8 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:04.877546 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353772e-545b-45ff-a1f9-cb1c53779078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:04.878606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353772e-545b-45ff-a1f9-cb1c53779078 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:04.878891 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353772e-545b-45ff-a1f9-cb1c53779078 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:04.879166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353772e-545b-45ff-a1f9-cb1c53779078 admin admin] PATH_INFO: `/v3/projects/bea04f8fa5cf4a34b3e99d3ee894aabe/users/43ade04bb86d46d0beb71ec236321a18/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:04.882026 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353772e-545b-45ff-a1f9-cb1c53779078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea04f8fa5cf4a34b3e99d3ee894aabe, user_id=43ade04bb86d46d0beb71ec236321a18, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:04.885107 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353772e-545b-45ff-a1f9-cb1c53779078 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:04.897335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 882/1777] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:04 2022] PUT /identity/v3/projects/bea04f8fa5cf4a34b3e99d3ee894aabe/users/43ade04bb86d46d0beb71ec236321a18/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:56:04.910268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd8b14-f79d-4b2f-8508-c3a270e69163 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:04.910569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd8b14-f79d-4b2f-8508-c3a270e69163 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:04.910846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd8b14-f79d-4b2f-8508-c3a270e69163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:04.933770 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eb4af-be5d-47a1-b896-677cc27d2a79 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:04.956861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-71fd8b14-f79d-4b2f-8508-c3a270e69163 None None] MFA Rules not processed for user `43ade04bb86d46d0beb71ec236321a18`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:04.959749 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-71fd8b14-f79d-4b2f-8508-c3a270e69163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:05.004426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deb8e5-7a3c-4e82-a6f3-caed9b7490a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:05.005922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deb8e5-7a3c-4e82-a6f3-caed9b7490a8 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:05.006206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deb8e5-7a3c-4e82-a6f3-caed9b7490a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:05.006477 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deb8e5-7a3c-4e82-a6f3-caed9b7490a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:05.008309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b3deb8e5-7a3c-4e82-a6f3-caed9b7490a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:05.098662 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 883/1778] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:05.114600 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd8b14-f79d-4b2f-8508-c3a270e69163 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:05.128435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-71fd8b14-f79d-4b2f-8508-c3a270e69163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:05.152371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd8b14-f79d-4b2f-8508-c3a270e69163 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:05.153308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deb8e5-7a3c-4e82-a6f3-caed9b7490a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:05.156081 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deb8e5-7a3c-4e82-a6f3-caed9b7490a8 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:05.157729 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ebe39-2703-434a-94a9-7f8e1ad0ed17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:05.158397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ebe39-2703-434a-94a9-7f8e1ad0ed17 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:05.158833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ebe39-2703-434a-94a9-7f8e1ad0ed17 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:05.159535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ebe39-2703-434a-94a9-7f8e1ad0ed17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:05.189866 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 896/1779] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:56:05.191425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ebe39-2703-434a-94a9-7f8e1ad0ed17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:05.191425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ebe39-2703-434a-94a9-7f8e1ad0ed17 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:05.206103 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 884/1780] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:05.800743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:06.597697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deb8e5-7a3c-4e82-a6f3-caed9b7490a8 service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:06.686671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:06.703629 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deb8e5-7a3c-4e82-a6f3-caed9b7490a8 service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:06.710699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281cda4-bcc3-4d0a-8272-72205a030ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:06.712203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281cda4-bcc3-4d0a-8272-72205a030ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:06.712629 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281cda4-bcc3-4d0a-8272-72205a030ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:06.713085 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281cda4-bcc3-4d0a-8272-72205a030ef6 admin admin] PATH_INFO: `/v3/users/55b699a0822140bf930c6ddc15e2a9d2` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:06.714544 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281cda4-bcc3-4d0a-8272-72205a030ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b699a0822140bf930c6ddc15e2a9d2)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:06.728447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281cda4-bcc3-4d0a-8272-72205a030ef6 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:06.971089 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-7281cda4-bcc3-4d0a-8272-72205a030ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b699a0822140bf930c6ddc15e2a9d2'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:06.985313 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-7281cda4-bcc3-4d0a-8272-72205a030ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b699a0822140bf930c6ddc15e2a9d2'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:07.092197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-7281cda4-bcc3-4d0a-8272-72205a030ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b699a0822140bf930c6ddc15e2a9d2'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:07.092844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-7281cda4-bcc3-4d0a-8272-72205a030ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b699a0822140bf930c6ddc15e2a9d2'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:07.101546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-7281cda4-bcc3-4d0a-8272-72205a030ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b699a0822140bf930c6ddc15e2a9d2'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:07.108968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 897/1781] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:06 2022] DELETE /identity/v3/users/55b699a0822140bf930c6ddc15e2a9d2 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:07.113640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b4af1-a127-48c7-93e9-63bbc3d6c6d5 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:07.114108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b4af1-a127-48c7-93e9-63bbc3d6c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:07.114224 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b4af1-a127-48c7-93e9-63bbc3d6c6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:07.133329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-788b4af1-a127-48c7-93e9-63bbc3d6c6d5 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:07.134533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-788b4af1-a127-48c7-93e9-63bbc3d6c6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:07.193837 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 885/1782] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:07.204396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281cda4-bcc3-4d0a-8272-72205a030ef6 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:07.205891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7281cda4-bcc3-4d0a-8272-72205a030ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:07.264936 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281cda4-bcc3-4d0a-8272-72205a030ef6 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:07.268743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37fec6-d60e-475b-bdbd-40ffccceaef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:07.269429 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37fec6-d60e-475b-bdbd-40ffccceaef6 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:07.269712 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37fec6-d60e-475b-bdbd-40ffccceaef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:07.269986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37fec6-d60e-475b-bdbd-40ffccceaef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:07.279405 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37fec6-d60e-475b-bdbd-40ffccceaef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:07.280885 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37fec6-d60e-475b-bdbd-40ffccceaef6 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:07.291276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 898/1783] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:07.693650 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b4af1-a127-48c7-93e9-63bbc3d6c6d5 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:07.695086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-788b4af1-a127-48c7-93e9-63bbc3d6c6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:07.707670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b4af1-a127-48c7-93e9-63bbc3d6c6d5 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:07.713002 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120490f-71cc-420f-9aa2-6d8c061dca2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:07.718631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120490f-71cc-420f-9aa2-6d8c061dca2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:07.718631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120490f-71cc-420f-9aa2-6d8c061dca2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:07.718631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120490f-71cc-420f-9aa2-6d8c061dca2b admin admin] PATH_INFO: `/v3/projects/3517a413bfa941e098e328408ce43d08` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:07.718631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120490f-71cc-420f-9aa2-6d8c061dca2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3517a413bfa941e098e328408ce43d08)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:07.718631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120490f-71cc-420f-9aa2-6d8c061dca2b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:07.886558 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c120490f-71cc-420f-9aa2-6d8c061dca2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3517a413bfa941e098e328408ce43d08', 'request_id': 'req-c120490f-71cc-420f-9aa2-6d8c061dca2b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:08.058550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c120490f-71cc-420f-9aa2-6d8c061dca2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3517a413bfa941e098e328408ce43d08', 'request_id': 'req-c120490f-71cc-420f-9aa2-6d8c061dca2b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:08.066967 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c120490f-71cc-420f-9aa2-6d8c061dca2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3517a413bfa941e098e328408ce43d08', 'request_id': 'req-c120490f-71cc-420f-9aa2-6d8c061dca2b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:08.080134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c120490f-71cc-420f-9aa2-6d8c061dca2b admin admin] The token cache is being invalidate because project 3517a413bfa941e098e328408ce43d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:08.080134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c120490f-71cc-420f-9aa2-6d8c061dca2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:08.080321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c120490f-71cc-420f-9aa2-6d8c061dca2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:08.082045 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 886/1784] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:07 2022] DELETE /identity/v3/projects/3517a413bfa941e098e328408ce43d08 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:08.089810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37fec6-d60e-475b-bdbd-40ffccceaef6 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:08.109580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37fec6-d60e-475b-bdbd-40ffccceaef6 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:08.176387 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2895797-4453-4f72-8eba-5f3e1c371d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:08.177339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2895797-4453-4f72-8eba-5f3e1c371d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:08.177613 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2895797-4453-4f72-8eba-5f3e1c371d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:08.178059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2895797-4453-4f72-8eba-5f3e1c371d92 admin admin] PATH_INFO: `/v3/users/43ade04bb86d46d0beb71ec236321a18` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:08.179746 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2895797-4453-4f72-8eba-5f3e1c371d92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ade04bb86d46d0beb71ec236321a18)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:08.182153 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2895797-4453-4f72-8eba-5f3e1c371d92 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:08.200043 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:08.424513 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a2895797-4453-4f72-8eba-5f3e1c371d92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ade04bb86d46d0beb71ec236321a18'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:08.439440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a2895797-4453-4f72-8eba-5f3e1c371d92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ade04bb86d46d0beb71ec236321a18'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:08.527727 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a2895797-4453-4f72-8eba-5f3e1c371d92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ade04bb86d46d0beb71ec236321a18'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:08.529066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a2895797-4453-4f72-8eba-5f3e1c371d92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ade04bb86d46d0beb71ec236321a18'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:08.536895 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a2895797-4453-4f72-8eba-5f3e1c371d92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ade04bb86d46d0beb71ec236321a18'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:08.543060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 899/1785] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:08 2022] DELETE /identity/v3/users/43ade04bb86d46d0beb71ec236321a18 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:08.959890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120490f-71cc-420f-9aa2-6d8c061dca2b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:08.959890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-c120490f-71cc-420f-9aa2-6d8c061dca2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:08.965747 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120490f-71cc-420f-9aa2-6d8c061dca2b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:09.051515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd2855-1c91-4bd6-889c-b0e7d2bafef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:09.052365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd2855-1c91-4bd6-889c-b0e7d2bafef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:09.052715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd2855-1c91-4bd6-889c-b0e7d2bafef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:09.052964 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd2855-1c91-4bd6-889c-b0e7d2bafef0 admin admin] PATH_INFO: `/v3/projects/bea04f8fa5cf4a34b3e99d3ee894aabe` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:09.054393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd2855-1c91-4bd6-889c-b0e7d2bafef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea04f8fa5cf4a34b3e99d3ee894aabe)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:09.056337 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd2855-1c91-4bd6-889c-b0e7d2bafef0 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:09.084601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:09.224666 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-93bd2855-1c91-4bd6-889c-b0e7d2bafef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea04f8fa5cf4a34b3e99d3ee894aabe', 'request_id': 'req-93bd2855-1c91-4bd6-889c-b0e7d2bafef0'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:09.326663 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-93bd2855-1c91-4bd6-889c-b0e7d2bafef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea04f8fa5cf4a34b3e99d3ee894aabe', 'request_id': 'req-93bd2855-1c91-4bd6-889c-b0e7d2bafef0'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:09.335244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-93bd2855-1c91-4bd6-889c-b0e7d2bafef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea04f8fa5cf4a34b3e99d3ee894aabe', 'request_id': 'req-93bd2855-1c91-4bd6-889c-b0e7d2bafef0'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:09.346516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-93bd2855-1c91-4bd6-889c-b0e7d2bafef0 admin admin] The token cache is being invalidate because project bea04f8fa5cf4a34b3e99d3ee894aabe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:09.346858 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-93bd2855-1c91-4bd6-889c-b0e7d2bafef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:09.347526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-93bd2855-1c91-4bd6-889c-b0e7d2bafef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:09.349217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 887/1786] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:08 2022] DELETE /identity/v3/projects/bea04f8fa5cf4a34b3e99d3ee894aabe => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:56:09.354241 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890607-9c5a-4b08-b94d-5f4c72bc49a7 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:09.354754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890607-9c5a-4b08-b94d-5f4c72bc49a7 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:09.355122 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890607-9c5a-4b08-b94d-5f4c72bc49a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:09.374903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-87890607-9c5a-4b08-b94d-5f4c72bc49a7 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:09.379946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-87890607-9c5a-4b08-b94d-5f4c72bc49a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:09.443247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 900/1787] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:09.450927 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267d86a-4b06-48a1-93ba-b10e64660b29 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:09.451468 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267d86a-4b06-48a1-93ba-b10e64660b29 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:09.451902 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267d86a-4b06-48a1-93ba-b10e64660b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:09.471178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-0267d86a-4b06-48a1-93ba-b10e64660b29 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:09.472372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0267d86a-4b06-48a1-93ba-b10e64660b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:09.481517 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 888/1788] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:09.486318 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890607-9c5a-4b08-b94d-5f4c72bc49a7 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:09.498064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890607-9c5a-4b08-b94d-5f4c72bc49a7 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:09.509704 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a494616-64f3-4ea2-b333-17336d1c2479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:09.510480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a494616-64f3-4ea2-b333-17336d1c2479 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:09.510835 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a494616-64f3-4ea2-b333-17336d1c2479 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:09.511214 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a494616-64f3-4ea2-b333-17336d1c2479 admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:09.512022 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a494616-64f3-4ea2-b333-17336d1c2479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:56:09.512401 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a494616-64f3-4ea2-b333-17336d1c2479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:09.514390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a494616-64f3-4ea2-b333-17336d1c2479 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:09.530904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 901/1789] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:56:09.535028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267d86a-4b06-48a1-93ba-b10e64660b29 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:09.545659 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267d86a-4b06-48a1-93ba-b10e64660b29 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:09.550608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ab62d-5886-43a1-a668-40815691949d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:09.551260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ab62d-5886-43a1-a668-40815691949d admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:09.551538 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ab62d-5886-43a1-a668-40815691949d admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:09.551808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ab62d-5886-43a1-a668-40815691949d admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:09.552515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ab62d-5886-43a1-a668-40815691949d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:09.554454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ab62d-5886-43a1-a668-40815691949d admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:09.660190 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 889/1790] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:09 2022] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:09.664616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a494616-64f3-4ea2-b333-17336d1c2479 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:09.676433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a494616-64f3-4ea2-b333-17336d1c2479 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:09.735549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9e7da-f8e3-4f83-9df9-7377c1e0e78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:09.736329 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9e7da-f8e3-4f83-9df9-7377c1e0e78f admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:09.736715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9e7da-f8e3-4f83-9df9-7377c1e0e78f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:09.737074 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9e7da-f8e3-4f83-9df9-7377c1e0e78f admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:09.737873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9e7da-f8e3-4f83-9df9-7377c1e0e78f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:09.739877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9e7da-f8e3-4f83-9df9-7377c1e0e78f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:09.830828 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 902/1791] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:09 2022] POST /identity/v3/users => generated 282 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:09.834830 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ab62d-5886-43a1-a668-40815691949d admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:09.847184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ab62d-5886-43a1-a668-40815691949d admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:09.853243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9637c-7d19-410e-92b6-ec2df311debc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:09.853981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9637c-7d19-410e-92b6-ec2df311debc admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:09.854336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9637c-7d19-410e-92b6-ec2df311debc admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:09.854689 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9637c-7d19-410e-92b6-ec2df311debc admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:09.855448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9637c-7d19-410e-92b6-ec2df311debc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:09.858065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9637c-7d19-410e-92b6-ec2df311debc admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:09.869269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 890/1792] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:09.873904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9e7da-f8e3-4f83-9df9-7377c1e0e78f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:09.883795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9e7da-f8e3-4f83-9df9-7377c1e0e78f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:09.888679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6991992-87de-4550-87e1-7b91e40ca3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:09.889580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6991992-87de-4550-87e1-7b91e40ca3bd admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:09.889861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6991992-87de-4550-87e1-7b91e40ca3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:09.890135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6991992-87de-4550-87e1-7b91e40ca3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:09.890933 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6991992-87de-4550-87e1-7b91e40ca3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:09.892476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6991992-87de-4550-87e1-7b91e40ca3bd admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:09.893896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:09.903961 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 903/1793] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:09.914640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9637c-7d19-410e-92b6-ec2df311debc admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:09.925081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9637c-7d19-410e-92b6-ec2df311debc admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:09.944430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bb0f7-5e20-4c59-a3b9-3cad3048f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:09.944430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bb0f7-5e20-4c59-a3b9-3cad3048f163 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:09.944430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bb0f7-5e20-4c59-a3b9-3cad3048f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:09.944430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bb0f7-5e20-4c59-a3b9-3cad3048f163 admin admin] PATH_INFO: `/v3/projects/d03a31b323e64d3c8592de87b0d6d6e6/users/e1b27ce6956f40a1b1659118d7c43d08/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:09.948382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324bb0f7-5e20-4c59-a3b9-3cad3048f163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d03a31b323e64d3c8592de87b0d6d6e6, user_id=e1b27ce6956f40a1b1659118d7c43d08, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:09.951230 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324bb0f7-5e20-4c59-a3b9-3cad3048f163 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:10.023089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 891/1794] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:09 2022] PUT /identity/v3/projects/d03a31b323e64d3c8592de87b0d6d6e6/users/e1b27ce6956f40a1b1659118d7c43d08/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:56:10.034001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bb3f8-691a-44d7-88bf-2370682a8da5 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:10.034332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bb3f8-691a-44d7-88bf-2370682a8da5 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:10.034663 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bb3f8-691a-44d7-88bf-2370682a8da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:10.072515 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-f43bb3f8-691a-44d7-88bf-2370682a8da5 None None] MFA Rules not processed for user `e1b27ce6956f40a1b1659118d7c43d08`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:10.072515 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f43bb3f8-691a-44d7-88bf-2370682a8da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:10.192764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 904/1795] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:10.201009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bb0f7-5e20-4c59-a3b9-3cad3048f163 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:10.274976 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bb0f7-5e20-4c59-a3b9-3cad3048f163 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:10.280311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a910b-a8b6-4bed-9c84-69aedcf4760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:10.281143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a910b-a8b6-4bed-9c84-69aedcf4760b admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:10.281425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a910b-a8b6-4bed-9c84-69aedcf4760b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:10.281697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a910b-a8b6-4bed-9c84-69aedcf4760b admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:10.282390 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a910b-a8b6-4bed-9c84-69aedcf4760b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:10.284447 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a910b-a8b6-4bed-9c84-69aedcf4760b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:10.404877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 892/1796] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:10 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:10.407665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bb3f8-691a-44d7-88bf-2370682a8da5 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:10.418618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bb3f8-691a-44d7-88bf-2370682a8da5 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:10.474927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af30be-7316-4192-abf1-cd92e2f3dc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:10.475644 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af30be-7316-4192-abf1-cd92e2f3dc90 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:10.475925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af30be-7316-4192-abf1-cd92e2f3dc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:10.476200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af30be-7316-4192-abf1-cd92e2f3dc90 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:10.476922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af30be-7316-4192-abf1-cd92e2f3dc90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:10.478823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af30be-7316-4192-abf1-cd92e2f3dc90 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:10.587140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 905/1797] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:10 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:10.588222 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a910b-a8b6-4bed-9c84-69aedcf4760b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:10.599335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a910b-a8b6-4bed-9c84-69aedcf4760b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:10.604051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214e8a1-bfa4-41ce-a8fb-1a1ab743a317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:10.604747 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214e8a1-bfa4-41ce-a8fb-1a1ab743a317 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:10.605030 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214e8a1-bfa4-41ce-a8fb-1a1ab743a317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:10.605307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214e8a1-bfa4-41ce-a8fb-1a1ab743a317 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:10.606044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214e8a1-bfa4-41ce-a8fb-1a1ab743a317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:10.607922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214e8a1-bfa4-41ce-a8fb-1a1ab743a317 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:10.619716 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 893/1798] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:10.623321 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af30be-7316-4192-abf1-cd92e2f3dc90 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:10.633689 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af30be-7316-4192-abf1-cd92e2f3dc90 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:10.638954 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54937e13-df1f-4625-b7bc-ee9b788b7bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:10.639923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937e13-df1f-4625-b7bc-ee9b788b7bca admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:10.640270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937e13-df1f-4625-b7bc-ee9b788b7bca admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:10.640610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937e13-df1f-4625-b7bc-ee9b788b7bca admin admin] PATH_INFO: `/v3/projects/f8ae1fd2cf044f28b30a0b3f9517e339/users/7ac3321e708f43989a4644133dc788e0/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:10.657076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54937e13-df1f-4625-b7bc-ee9b788b7bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ae1fd2cf044f28b30a0b3f9517e339, user_id=7ac3321e708f43989a4644133dc788e0, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:10.659999 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54937e13-df1f-4625-b7bc-ee9b788b7bca admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:10.715344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 906/1799] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:10 2022] PUT /identity/v3/projects/f8ae1fd2cf044f28b30a0b3f9517e339/users/7ac3321e708f43989a4644133dc788e0/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:56:10.720192 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214e8a1-bfa4-41ce-a8fb-1a1ab743a317 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:10.730396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214e8a1-bfa4-41ce-a8fb-1a1ab743a317 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:10.750153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:10.790833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f234696-19d0-4aef-b33c-987f38ac162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:10.791484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234696-19d0-4aef-b33c-987f38ac162e admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:10.791763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234696-19d0-4aef-b33c-987f38ac162e admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:10.792031 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234696-19d0-4aef-b33c-987f38ac162e admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:10.792778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f234696-19d0-4aef-b33c-987f38ac162e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:10.794457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f234696-19d0-4aef-b33c-987f38ac162e admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:10.804132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 894/1800] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:10.808409 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54937e13-df1f-4625-b7bc-ee9b788b7bca admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:10.819545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54937e13-df1f-4625-b7bc-ee9b788b7bca admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:10.824195 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4878552-381e-4ed4-8ef6-29624b22d42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:10.825995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4878552-381e-4ed4-8ef6-29624b22d42a admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:10.826278 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4878552-381e-4ed4-8ef6-29624b22d42a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:10.826549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4878552-381e-4ed4-8ef6-29624b22d42a admin admin] PATH_INFO: `/v3/projects/f8ae1fd2cf044f28b30a0b3f9517e339/users/7ac3321e708f43989a4644133dc788e0/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:10.828484 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4878552-381e-4ed4-8ef6-29624b22d42a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ae1fd2cf044f28b30a0b3f9517e339, user_id=7ac3321e708f43989a4644133dc788e0, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:10.831100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4878552-381e-4ed4-8ef6-29624b22d42a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:10.841877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 907/1801] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:10 2022] PUT /identity/v3/projects/f8ae1fd2cf044f28b30a0b3f9517e339/users/7ac3321e708f43989a4644133dc788e0/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:10.852085 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03877a-eec3-43ec-bb6d-634bd63aa329 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:10.852403 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03877a-eec3-43ec-bb6d-634bd63aa329 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:10.852730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03877a-eec3-43ec-bb6d-634bd63aa329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:10.879997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-ea03877a-eec3-43ec-bb6d-634bd63aa329 None None] MFA Rules not processed for user `7ac3321e708f43989a4644133dc788e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:10.881316 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ea03877a-eec3-43ec-bb6d-634bd63aa329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:10.952981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 895/1802] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:10.963549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4878552-381e-4ed4-8ef6-29624b22d42a admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:10.965272 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a4878552-381e-4ed4-8ef6-29624b22d42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:11.007476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:11.022541 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4878552-381e-4ed4-8ef6-29624b22d42a admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:11.026156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590341a-06ec-4181-a283-0ae30b8d2685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:11.026892 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590341a-06ec-4181-a283-0ae30b8d2685 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:11.027175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590341a-06ec-4181-a283-0ae30b8d2685 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:11.027476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590341a-06ec-4181-a283-0ae30b8d2685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:11.037351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590341a-06ec-4181-a283-0ae30b8d2685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:11.038762 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590341a-06ec-4181-a283-0ae30b8d2685 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:11.048426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 908/1803] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:14.035753 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cdbd8-2de3-411f-bf84-4aecb4e319b9 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:14.036629 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cdbd8-2de3-411f-bf84-4aecb4e319b9 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:14.037078 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cdbd8-2de3-411f-bf84-4aecb4e319b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:14.066509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-355cdbd8-2de3-411f-bf84-4aecb4e319b9 None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:14.068228 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-355cdbd8-2de3-411f-bf84-4aecb4e319b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:14.232142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 896/1804] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Jun 27 14:56:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:14.334049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590341a-06ec-4181-a283-0ae30b8d2685 service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:14.414960 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590341a-06ec-4181-a283-0ae30b8d2685 service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:14.422081 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acc197-bd9a-45db-a8fd-051abadd51ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:14.423299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acc197-bd9a-45db-a8fd-051abadd51ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:14.423905 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acc197-bd9a-45db-a8fd-051abadd51ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:14.425072 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acc197-bd9a-45db-a8fd-051abadd51ec admin admin] PATH_INFO: `/v3/users/e1b27ce6956f40a1b1659118d7c43d08` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:14.426528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acc197-bd9a-45db-a8fd-051abadd51ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b27ce6956f40a1b1659118d7c43d08)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:14.428899 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acc197-bd9a-45db-a8fd-051abadd51ec admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:14.583103 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cdbd8-2de3-411f-bf84-4aecb4e319b9 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:14.589678 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-355cdbd8-2de3-411f-bf84-4aecb4e319b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:14.703889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:14.734793 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c7acc197-bd9a-45db-a8fd-051abadd51ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b27ce6956f40a1b1659118d7c43d08'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:14.757300 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cdbd8-2de3-411f-bf84-4aecb4e319b9 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:14.764294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d907e-1642-4d73-8463-bcf14d2abdff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:14.764991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d907e-1642-4d73-8463-bcf14d2abdff service swift] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:14.765601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d907e-1642-4d73-8463-bcf14d2abdff service swift] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:14.765908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d907e-1642-4d73-8463-bcf14d2abdff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:14.766514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c7acc197-bd9a-45db-a8fd-051abadd51ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b27ce6956f40a1b1659118d7c43d08'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:14.777360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d907e-1642-4d73-8463-bcf14d2abdff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:14.779571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d907e-1642-4d73-8463-bcf14d2abdff service swift] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:14.806028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 897/1805] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 14:56:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 14:56:14.806028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d907e-1642-4d73-8463-bcf14d2abdff service swift] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:14.806028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-831d907e-1642-4d73-8463-bcf14d2abdff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:14.820789 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d907e-1642-4d73-8463-bcf14d2abdff service swift] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:14.828540 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56243b6-be83-4e1b-87b2-dd122cadb262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:14.832016 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56243b6-be83-4e1b-87b2-dd122cadb262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:14.832016 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56243b6-be83-4e1b-87b2-dd122cadb262 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:14.832016 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56243b6-be83-4e1b-87b2-dd122cadb262 admin admin] PATH_INFO: `/v3/users/c2d00f37bc7c4e3aa4f987ee469eca48` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:14.832016 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56243b6-be83-4e1b-87b2-dd122cadb262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d00f37bc7c4e3aa4f987ee469eca48)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:14.833870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56243b6-be83-4e1b-87b2-dd122cadb262 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:14.854292 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c7acc197-bd9a-45db-a8fd-051abadd51ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b27ce6956f40a1b1659118d7c43d08'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:14.855435 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c7acc197-bd9a-45db-a8fd-051abadd51ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b27ce6956f40a1b1659118d7c43d08'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:14.877095 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c7acc197-bd9a-45db-a8fd-051abadd51ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b27ce6956f40a1b1659118d7c43d08'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:14.906026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 909/1806] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:14 2022] DELETE /identity/v3/users/e1b27ce6956f40a1b1659118d7c43d08 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:14.910898 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c309c-32b8-4e62-b15f-e8ba198ec441 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:14.911265 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c309c-32b8-4e62-b15f-e8ba198ec441 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:14.911993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c309c-32b8-4e62-b15f-e8ba198ec441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:14.966470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a85c309c-32b8-4e62-b15f-e8ba198ec441 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:14.967895 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a85c309c-32b8-4e62-b15f-e8ba198ec441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:15.099111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:15.121740 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 910/1807] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:15.155284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d56243b6-be83-4e1b-87b2-dd122cadb262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d00f37bc7c4e3aa4f987ee469eca48'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:15.158521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c309c-32b8-4e62-b15f-e8ba198ec441 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:15.167261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a85c309c-32b8-4e62-b15f-e8ba198ec441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:15.195944 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d56243b6-be83-4e1b-87b2-dd122cadb262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d00f37bc7c4e3aa4f987ee469eca48'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:15.312174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d56243b6-be83-4e1b-87b2-dd122cadb262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d00f37bc7c4e3aa4f987ee469eca48'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:15.313267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d56243b6-be83-4e1b-87b2-dd122cadb262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d00f37bc7c4e3aa4f987ee469eca48'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:15.332194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d56243b6-be83-4e1b-87b2-dd122cadb262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d00f37bc7c4e3aa4f987ee469eca48'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:15.367775 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 898/1808] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:14 2022] DELETE /identity/v3/users/c2d00f37bc7c4e3aa4f987ee469eca48 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:15.369811 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4d0bf-3889-40ec-9a96-b12dced07dc7 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:15.370274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4d0bf-3889-40ec-9a96-b12dced07dc7 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:15.370976 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4d0bf-3889-40ec-9a96-b12dced07dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:15.379294 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c309c-32b8-4e62-b15f-e8ba198ec441 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:15.401228 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b9d4d0bf-3889-40ec-9a96-b12dced07dc7 None None] MFA Rules not processed for user `bdf31d7d8c164809bde0e12b71ecfca0`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:15.402352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b9d4d0bf-3889-40ec-9a96-b12dced07dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:15.498525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fd80b-2bb0-47da-bbce-17dba42a5020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:15.499678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fd80b-2bb0-47da-bbce-17dba42a5020 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:15.500129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fd80b-2bb0-47da-bbce-17dba42a5020 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:15.500729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fd80b-2bb0-47da-bbce-17dba42a5020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:15.503383 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-875fd80b-2bb0-47da-bbce-17dba42a5020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:15.659879 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 899/1809] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Jun 27 14:56:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:15.666948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cace49-7193-4550-8de3-151ff487cb62 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:15.667458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cace49-7193-4550-8de3-151ff487cb62 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:15.667650 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cace49-7193-4550-8de3-151ff487cb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:15.698100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-23cace49-7193-4550-8de3-151ff487cb62 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:15.703437 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-23cace49-7193-4550-8de3-151ff487cb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:15.718868 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 900/1810] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:15.731683 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fd80b-2bb0-47da-bbce-17dba42a5020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:15.733461 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fd80b-2bb0-47da-bbce-17dba42a5020 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:15.769125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 911/1811] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:15.845682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cace49-7193-4550-8de3-151ff487cb62 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:15.847398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-23cace49-7193-4550-8de3-151ff487cb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:15.848380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fd80b-2bb0-47da-bbce-17dba42a5020 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:15.850734 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-875fd80b-2bb0-47da-bbce-17dba42a5020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:15.869713 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fd80b-2bb0-47da-bbce-17dba42a5020 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:15.872812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a2e98-f40e-4fca-b507-e93028add7e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:15.873764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a2e98-f40e-4fca-b507-e93028add7e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:15.874428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a2e98-f40e-4fca-b507-e93028add7e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:15.874914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a2e98-f40e-4fca-b507-e93028add7e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:15.883368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cace49-7193-4550-8de3-151ff487cb62 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:15.883917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a2e98-f40e-4fca-b507-e93028add7e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:15.886974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a2e98-f40e-4fca-b507-e93028add7e6 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:15.889979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcf102-6cd8-4cc2-aa2f-22de62b91d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:15.895667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcf102-6cd8-4cc2-aa2f-22de62b91d2b service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:15.895667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcf102-6cd8-4cc2-aa2f-22de62b91d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:15.895667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcf102-6cd8-4cc2-aa2f-22de62b91d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:15.899258 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 912/1812] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:15.927072 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcf102-6cd8-4cc2-aa2f-22de62b91d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:15.928775 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcf102-6cd8-4cc2-aa2f-22de62b91d2b service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:15.957657 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 901/1813] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:17.743883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a2e98-f40e-4fca-b507-e93028add7e6 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:17.746202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-ce6a2e98-f40e-4fca-b507-e93028add7e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:17.790085 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a2e98-f40e-4fca-b507-e93028add7e6 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:17.799745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:17.802539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:17.802940 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:17.810634 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b admin admin] PATH_INFO: `/v3/projects/d03a31b323e64d3c8592de87b0d6d6e6` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:17.812819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d03a31b323e64d3c8592de87b0d6d6e6)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:17.814871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:17.994964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:18.002188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd03a31b323e64d3c8592de87b0d6d6e6', 'request_id': 'req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:18.017748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd03a31b323e64d3c8592de87b0d6d6e6', 'request_id': 'req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:18.116134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd03a31b323e64d3c8592de87b0d6d6e6', 'request_id': 'req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:18.139542 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b admin admin] The token cache is being invalidate because project d03a31b323e64d3c8592de87b0d6d6e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:18.139705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:18.140349 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:18.148725 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 913/1814] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:17 2022] DELETE /identity/v3/projects/d03a31b323e64d3c8592de87b0d6d6e6 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:18.149306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcf102-6cd8-4cc2-aa2f-22de62b91d2b service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:18.169813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcf102-6cd8-4cc2-aa2f-22de62b91d2b service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:18.228848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:18.253120 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b0571-186f-40c6-bb55-6967eb02650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:18.254005 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b0571-186f-40c6-bb55-6967eb02650d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:18.254371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b0571-186f-40c6-bb55-6967eb02650d admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:18.254802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b0571-186f-40c6-bb55-6967eb02650d admin admin] PATH_INFO: `/v3/users/7ac3321e708f43989a4644133dc788e0` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:18.256041 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b0571-186f-40c6-bb55-6967eb02650d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac3321e708f43989a4644133dc788e0)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:18.257982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b0571-186f-40c6-bb55-6967eb02650d admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:18.354278 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:18.357202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:18.378302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad060e-ddd5-4524-bdb7-4beaf76dd38b admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:18.389662 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1ac31-0c83-488e-b4d0-d7738964050e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:18.391065 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ac31-0c83-488e-b4d0-d7738964050e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:18.393038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ac31-0c83-488e-b4d0-d7738964050e admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:18.393479 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ac31-0c83-488e-b4d0-d7738964050e admin admin] PATH_INFO: `/v3/projects/2eaf367443034b0e847c3aadf978c3ea` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:18.398287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1ac31-0c83-488e-b4d0-d7738964050e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eaf367443034b0e847c3aadf978c3ea)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:18.402530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1ac31-0c83-488e-b4d0-d7738964050e admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:18.446765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b92b0571-186f-40c6-bb55-6967eb02650d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac3321e708f43989a4644133dc788e0'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:18.469002 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b92b0571-186f-40c6-bb55-6967eb02650d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac3321e708f43989a4644133dc788e0'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:18.568818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-68c1ac31-0c83-488e-b4d0-d7738964050e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eaf367443034b0e847c3aadf978c3ea', 'request_id': 'req-68c1ac31-0c83-488e-b4d0-d7738964050e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:18.577281 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-68c1ac31-0c83-488e-b4d0-d7738964050e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eaf367443034b0e847c3aadf978c3ea', 'request_id': 'req-68c1ac31-0c83-488e-b4d0-d7738964050e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:18.589208 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b92b0571-186f-40c6-bb55-6967eb02650d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac3321e708f43989a4644133dc788e0'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:18.590011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b92b0571-186f-40c6-bb55-6967eb02650d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac3321e708f43989a4644133dc788e0'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:18.604230 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b92b0571-186f-40c6-bb55-6967eb02650d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac3321e708f43989a4644133dc788e0'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:18.616705 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 902/1815] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:18 2022] DELETE /identity/v3/users/7ac3321e708f43989a4644133dc788e0 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:56:18.617476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560205f-999c-4da6-9ab3-80ef51b9e868 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:18.620522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560205f-999c-4da6-9ab3-80ef51b9e868 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:18.620522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560205f-999c-4da6-9ab3-80ef51b9e868 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:18.620522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 903/1816] 10.222.0.44 () {54 vars in 921 bytes} [Mon Jun 27 14:56:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:56:18.643669 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889968f0-ca3b-4e56-8c1f-6b98a227961b None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:18.644290 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889968f0-ca3b-4e56-8c1f-6b98a227961b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:18.644695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889968f0-ca3b-4e56-8c1f-6b98a227961b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:18.666629 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-889968f0-ca3b-4e56-8c1f-6b98a227961b None None] MFA Rules not processed for user `08529776af224c36ab560c13f5941e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:18.668153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-889968f0-ca3b-4e56-8c1f-6b98a227961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:18.686958 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-68c1ac31-0c83-488e-b4d0-d7738964050e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eaf367443034b0e847c3aadf978c3ea', 'request_id': 'req-68c1ac31-0c83-488e-b4d0-d7738964050e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:18.702632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-68c1ac31-0c83-488e-b4d0-d7738964050e admin admin] The token cache is being invalidate because project 2eaf367443034b0e847c3aadf978c3ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:18.703209 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-68c1ac31-0c83-488e-b4d0-d7738964050e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:18.704154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-68c1ac31-0c83-488e-b4d0-d7738964050e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:18.722069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 914/1817] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:18 2022] DELETE /identity/v3/projects/2eaf367443034b0e847c3aadf978c3ea => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:56:18.726288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1ac31-0c83-488e-b4d0-d7738964050e admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:18.731651 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-68c1ac31-0c83-488e-b4d0-d7738964050e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:18.761675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 904/1818] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Jun 27 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:18.777663 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889968f0-ca3b-4e56-8c1f-6b98a227961b None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:18.779696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-889968f0-ca3b-4e56-8c1f-6b98a227961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:18.800170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889968f0-ca3b-4e56-8c1f-6b98a227961b None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:18.806909 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5f0fa-e6cc-4a6b-adf4-ea783c719289 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:18.807681 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5f0fa-e6cc-4a6b-adf4-ea783c719289 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:18.808042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5f0fa-e6cc-4a6b-adf4-ea783c719289 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:18.808394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5f0fa-e6cc-4a6b-adf4-ea783c719289 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:18.822725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5f0fa-e6cc-4a6b-adf4-ea783c719289 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:18.826168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5f0fa-e6cc-4a6b-adf4-ea783c719289 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:18.839364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1ac31-0c83-488e-b4d0-d7738964050e admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:18.839822 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 905/1819] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:18.967173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f4e36-b66e-4d6f-9a82-c03b3ec6a5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:18.968556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f4e36-b66e-4d6f-9a82-c03b3ec6a5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:18.968937 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f4e36-b66e-4d6f-9a82-c03b3ec6a5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:18.969286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f4e36-b66e-4d6f-9a82-c03b3ec6a5b3 admin admin] PATH_INFO: `/v3/users/7e6a5435673441a3abee1f8c4728b881` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:18.972528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f4e36-b66e-4d6f-9a82-c03b3ec6a5b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6a5435673441a3abee1f8c4728b881)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:18.976005 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f4e36-b66e-4d6f-9a82-c03b3ec6a5b3 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:19.208634 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-8e6f4e36-b66e-4d6f-9a82-c03b3ec6a5b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6a5435673441a3abee1f8c4728b881'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:19.227298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-8e6f4e36-b66e-4d6f-9a82-c03b3ec6a5b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6a5435673441a3abee1f8c4728b881'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:19.332446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-8e6f4e36-b66e-4d6f-9a82-c03b3ec6a5b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6a5435673441a3abee1f8c4728b881'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:19.333192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-8e6f4e36-b66e-4d6f-9a82-c03b3ec6a5b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6a5435673441a3abee1f8c4728b881'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:19.361246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-8e6f4e36-b66e-4d6f-9a82-c03b3ec6a5b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6a5435673441a3abee1f8c4728b881'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:19.371263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 915/1820] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:18 2022] DELETE /identity/v3/users/7e6a5435673441a3abee1f8c4728b881 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:19.581623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5f0fa-e6cc-4a6b-adf4-ea783c719289 service nova] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:19.583944 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8ea5f0fa-e6cc-4a6b-adf4-ea783c719289 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:19.603759 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5f0fa-e6cc-4a6b-adf4-ea783c719289 service nova] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:19.608788 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7354f3-00e7-4730-aa0e-518f09f4e80d None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:19.609446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7354f3-00e7-4730-aa0e-518f09f4e80d None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:19.609907 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7354f3-00e7-4730-aa0e-518f09f4e80d None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:19.612159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 916/1821] 10.222.0.44 () {54 vars in 921 bytes} [Mon Jun 27 14:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:56:19.627947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3d9a2-7fc3-4e57-8578-95169f92a89e None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:19.631986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3d9a2-7fc3-4e57-8578-95169f92a89e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:19.632466 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3d9a2-7fc3-4e57-8578-95169f92a89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:19.693316 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-7aa3d9a2-7fc3-4e57-8578-95169f92a89e None None] MFA Rules not processed for user `08529776af224c36ab560c13f5941e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:19.699518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7aa3d9a2-7fc3-4e57-8578-95169f92a89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:19.715470 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1caa87b-4a59-4acf-ab1b-1e29a2ec2499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:19.717236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caa87b-4a59-4acf-ab1b-1e29a2ec2499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:19.717629 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caa87b-4a59-4acf-ab1b-1e29a2ec2499 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:19.718004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caa87b-4a59-4acf-ab1b-1e29a2ec2499 admin admin] PATH_INFO: `/v3/projects/f8ae1fd2cf044f28b30a0b3f9517e339` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:19.720614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1caa87b-4a59-4acf-ab1b-1e29a2ec2499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ae1fd2cf044f28b30a0b3f9517e339)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:19.722861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1caa87b-4a59-4acf-ab1b-1e29a2ec2499 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:19.802488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:19.889016 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 917/1822] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Jun 27 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:19.894139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d1caa87b-4a59-4acf-ab1b-1e29a2ec2499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ae1fd2cf044f28b30a0b3f9517e339', 'request_id': 'req-d1caa87b-4a59-4acf-ab1b-1e29a2ec2499'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:19.926568 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3d9a2-7fc3-4e57-8578-95169f92a89e None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:19.928509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7aa3d9a2-7fc3-4e57-8578-95169f92a89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:19.942787 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3d9a2-7fc3-4e57-8578-95169f92a89e None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:19.949872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d1caa87b-4a59-4acf-ab1b-1e29a2ec2499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ae1fd2cf044f28b30a0b3f9517e339', 'request_id': 'req-d1caa87b-4a59-4acf-ab1b-1e29a2ec2499'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:19.959204 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d1caa87b-4a59-4acf-ab1b-1e29a2ec2499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ae1fd2cf044f28b30a0b3f9517e339', 'request_id': 'req-d1caa87b-4a59-4acf-ab1b-1e29a2ec2499'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:19.984780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d1caa87b-4a59-4acf-ab1b-1e29a2ec2499 admin admin] The token cache is being invalidate because project f8ae1fd2cf044f28b30a0b3f9517e339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:19.985090 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d1caa87b-4a59-4acf-ab1b-1e29a2ec2499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:19.985807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d1caa87b-4a59-4acf-ab1b-1e29a2ec2499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:19.996134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 906/1823] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:19 2022] DELETE /identity/v3/projects/f8ae1fd2cf044f28b30a0b3f9517e339 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:19.998173 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1bc75-f7d4-47c4-aa1b-f6ee6511dcc9 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:19.998469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1bc75-f7d4-47c4-aa1b-f6ee6511dcc9 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:19.998751 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1bc75-f7d4-47c4-aa1b-f6ee6511dcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.031658 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f2d1bc75-f7d4-47c4-aa1b-f6ee6511dcc9 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:20.033149 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f2d1bc75-f7d4-47c4-aa1b-f6ee6511dcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:20.071654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d4527-10d0-4f13-9a56-f356c8864119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:20.072719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d4527-10d0-4f13-9a56-f356c8864119 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.073321 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d4527-10d0-4f13-9a56-f356c8864119 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.073750 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d4527-10d0-4f13-9a56-f356c8864119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.075672 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-253d4527-10d0-4f13-9a56-f356c8864119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:20.089741 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d4527-10d0-4f13-9a56-f356c8864119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:20.091911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d4527-10d0-4f13-9a56-f356c8864119 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:20.104111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 918/1824] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:20.119742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 907/1825] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:20.128493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a3e73-49b3-47ea-b397-89d16290b22c None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.128843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a3e73-49b3-47ea-b397-89d16290b22c None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.129128 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a3e73-49b3-47ea-b397-89d16290b22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.150232 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-ed8a3e73-49b3-47ea-b397-89d16290b22c None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:20.183156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-ed8a3e73-49b3-47ea-b397-89d16290b22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:20.183156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 919/1826] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:20.185052 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1bc75-f7d4-47c4-aa1b-f6ee6511dcc9 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:20.185052 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1bc75-f7d4-47c4-aa1b-f6ee6511dcc9 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:20.185052 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aaeed-6df2-4438-967f-a7a33ab69f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:20.185744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aaeed-6df2-4438-967f-a7a33ab69f07 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.188532 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aaeed-6df2-4438-967f-a7a33ab69f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.191756 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aaeed-6df2-4438-967f-a7a33ab69f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.192673 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aaeed-6df2-4438-967f-a7a33ab69f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:56:20.193151 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aaeed-6df2-4438-967f-a7a33ab69f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:20.194810 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aaeed-6df2-4438-967f-a7a33ab69f07 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:20.211959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 908/1827] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:56:20.217908 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a3e73-49b3-47ea-b397-89d16290b22c None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:20.230395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a3e73-49b3-47ea-b397-89d16290b22c None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:20.242444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d881f-e0ee-4a4e-92ad-acb700f0be06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:20.242444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d881f-e0ee-4a4e-92ad-acb700f0be06 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.242444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d881f-e0ee-4a4e-92ad-acb700f0be06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.242444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d881f-e0ee-4a4e-92ad-acb700f0be06 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.242797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d881f-e0ee-4a4e-92ad-acb700f0be06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:20.242797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d881f-e0ee-4a4e-92ad-acb700f0be06 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:20.288047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aaeed-6df2-4438-967f-a7a33ab69f07 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:20.292944 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-843aaeed-6df2-4438-967f-a7a33ab69f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:20.306584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aaeed-6df2-4438-967f-a7a33ab69f07 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:20.320972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 920/1828] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:20 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:56:20.321321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf81ba-8387-4526-af8d-9989ecc821d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:20.321433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d881f-e0ee-4a4e-92ad-acb700f0be06 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:20.321793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf81ba-8387-4526-af8d-9989ecc821d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.322083 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf81ba-8387-4526-af8d-9989ecc821d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.322387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf81ba-8387-4526-af8d-9989ecc821d5 admin admin] PATH_INFO: `/v3/projects/73ff905040f2415e9e4a7d5eb6f1d81b` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.323665 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf81ba-8387-4526-af8d-9989ecc821d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ff905040f2415e9e4a7d5eb6f1d81b)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:20.326307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf81ba-8387-4526-af8d-9989ecc821d5 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:20.386120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d881f-e0ee-4a4e-92ad-acb700f0be06 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:20.391427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea9c6f-ec1d-4ecb-b073-dd03cd9babf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:20.392102 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea9c6f-ec1d-4ecb-b073-dd03cd9babf7 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.392389 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea9c6f-ec1d-4ecb-b073-dd03cd9babf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.392696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea9c6f-ec1d-4ecb-b073-dd03cd9babf7 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.393395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea9c6f-ec1d-4ecb-b073-dd03cd9babf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:20.395343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea9c6f-ec1d-4ecb-b073-dd03cd9babf7 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:20.423003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c4cf81ba-8387-4526-af8d-9989ecc821d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ff905040f2415e9e4a7d5eb6f1d81b', 'request_id': 'req-c4cf81ba-8387-4526-af8d-9989ecc821d5'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:20.512910 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 921/1829] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:20 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:56:20.514001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea9c6f-ec1d-4ecb-b073-dd03cd9babf7 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:20.523826 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea9c6f-ec1d-4ecb-b073-dd03cd9babf7 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:20.533049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c4cf81ba-8387-4526-af8d-9989ecc821d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ff905040f2415e9e4a7d5eb6f1d81b', 'request_id': 'req-c4cf81ba-8387-4526-af8d-9989ecc821d5'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:20.535860 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:20.544771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c4cf81ba-8387-4526-af8d-9989ecc821d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ff905040f2415e9e4a7d5eb6f1d81b', 'request_id': 'req-c4cf81ba-8387-4526-af8d-9989ecc821d5'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:20.570142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c4cf81ba-8387-4526-af8d-9989ecc821d5 admin admin] The token cache is being invalidate because project 73ff905040f2415e9e4a7d5eb6f1d81b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:20.570510 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c4cf81ba-8387-4526-af8d-9989ecc821d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:20.571439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c4cf81ba-8387-4526-af8d-9989ecc821d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:20.573475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 909/1830] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:20 2022] DELETE /identity/v3/projects/73ff905040f2415e9e4a7d5eb6f1d81b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:56:20.578483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191af8c-4e32-430b-be98-3f4451218fc6 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.578776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191af8c-4e32-430b-be98-3f4451218fc6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.579059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191af8c-4e32-430b-be98-3f4451218fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.605825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-0191af8c-4e32-430b-be98-3f4451218fc6 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:20.607635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0191af8c-4e32-430b-be98-3f4451218fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:20.607886 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e6106-0387-4ee6-9694-fbc13fc635c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:20.608626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e6106-0387-4ee6-9694-fbc13fc635c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.609027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e6106-0387-4ee6-9694-fbc13fc635c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.609372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e6106-0387-4ee6-9694-fbc13fc635c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.610177 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e6106-0387-4ee6-9694-fbc13fc635c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:20.611942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e6106-0387-4ee6-9694-fbc13fc635c5 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:20.616887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 910/1831] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:20.624695 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 922/1832] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:20.625043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e196d-e307-418e-8497-daffea7bf73f None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.625531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e196d-e307-418e-8497-daffea7bf73f None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.625829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e196d-e307-418e-8497-daffea7bf73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.627089 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e6106-0387-4ee6-9694-fbc13fc635c5 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:20.629078 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d43e6106-0387-4ee6-9694-fbc13fc635c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:20.642310 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e6106-0387-4ee6-9694-fbc13fc635c5 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:20.644469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-e88e196d-e307-418e-8497-daffea7bf73f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:20.645695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-e88e196d-e307-418e-8497-daffea7bf73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:20.649051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969c2a8-34eb-422f-80ab-87b67ceb6cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:20.649718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969c2a8-34eb-422f-80ab-87b67ceb6cdd admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.650326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969c2a8-34eb-422f-80ab-87b67ceb6cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.650326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969c2a8-34eb-422f-80ab-87b67ceb6cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.651038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969c2a8-34eb-422f-80ab-87b67ceb6cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:20.652616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969c2a8-34eb-422f-80ab-87b67ceb6cdd admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:20.655095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 911/1833] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:20.659302 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e196d-e307-418e-8497-daffea7bf73f None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:20.667407 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 923/1834] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:20.672151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969c2a8-34eb-422f-80ab-87b67ceb6cdd admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:20.672447 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e196d-e307-418e-8497-daffea7bf73f None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:20.679827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7aca20-bdd4-4e8d-803f-2c41c165eaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:20.680670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7aca20-bdd4-4e8d-803f-2c41c165eaac admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.680973 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7aca20-bdd4-4e8d-803f-2c41c165eaac admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.681240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7aca20-bdd4-4e8d-803f-2c41c165eaac admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.681968 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7aca20-bdd4-4e8d-803f-2c41c165eaac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:56:20.682271 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7aca20-bdd4-4e8d-803f-2c41c165eaac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:20.682550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969c2a8-34eb-422f-80ab-87b67ceb6cdd admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:20.684045 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7aca20-bdd4-4e8d-803f-2c41c165eaac admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:20.687808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c484a-8232-426a-9f0d-456fca7aed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:20.688695 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c484a-8232-426a-9f0d-456fca7aed31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.689012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c484a-8232-426a-9f0d-456fca7aed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.689286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c484a-8232-426a-9f0d-456fca7aed31 admin admin] PATH_INFO: `/v3/projects/7494a11f3a76497bb52ab02c2c7139ce/users/51394b16db014b86b1eecae0be74ad4d/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.700696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 912/1835] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:56:20.702436 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7aca20-bdd4-4e8d-803f-2c41c165eaac admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:20.708925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c484a-8232-426a-9f0d-456fca7aed31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7494a11f3a76497bb52ab02c2c7139ce, user_id=51394b16db014b86b1eecae0be74ad4d, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:20.719974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c484a-8232-426a-9f0d-456fca7aed31 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:20.720131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7aca20-bdd4-4e8d-803f-2c41c165eaac admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:20.724655 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895787b-fcae-404b-b657-ce37b536bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:20.727646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895787b-fcae-404b-b657-ce37b536bcc3 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.727646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895787b-fcae-404b-b657-ce37b536bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.727646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895787b-fcae-404b-b657-ce37b536bcc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.727646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895787b-fcae-404b-b657-ce37b536bcc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:20.728467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895787b-fcae-404b-b657-ce37b536bcc3 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:20.761267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 924/1836] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:20 2022] PUT /identity/v3/projects/7494a11f3a76497bb52ab02c2c7139ce/users/51394b16db014b86b1eecae0be74ad4d/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:56:20.772480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6af44-952c-4586-b373-ad6cf3f4a062 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.773645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6af44-952c-4586-b373-ad6cf3f4a062 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.773645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6af44-952c-4586-b373-ad6cf3f4a062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.799273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-11b6af44-952c-4586-b373-ad6cf3f4a062 None None] MFA Rules not processed for user `51394b16db014b86b1eecae0be74ad4d`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:20.800485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-11b6af44-952c-4586-b373-ad6cf3f4a062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:20.808571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 913/1837] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:20 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:20.812706 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895787b-fcae-404b-b657-ce37b536bcc3 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:20.872577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 925/1838] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:20.877544 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6af44-952c-4586-b373-ad6cf3f4a062 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:20.886571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895787b-fcae-404b-b657-ce37b536bcc3 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:20.892189 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cadfc-31e7-43c0-b2a4-4382fd6c6945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:20.893316 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cadfc-31e7-43c0-b2a4-4382fd6c6945 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.899888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cadfc-31e7-43c0-b2a4-4382fd6c6945 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.899888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cadfc-31e7-43c0-b2a4-4382fd6c6945 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.899888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cadfc-31e7-43c0-b2a4-4382fd6c6945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:20.899888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cadfc-31e7-43c0-b2a4-4382fd6c6945 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:20.962385 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6af44-952c-4586-b373-ad6cf3f4a062 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:20.973602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db250cb-8fd6-4ac6-9a63-2bcc7363bdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:20.974387 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db250cb-8fd6-4ac6-9a63-2bcc7363bdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:20.974743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db250cb-8fd6-4ac6-9a63-2bcc7363bdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:20.976616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db250cb-8fd6-4ac6-9a63-2bcc7363bdb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:20.976616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db250cb-8fd6-4ac6-9a63-2bcc7363bdb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:20.978705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db250cb-8fd6-4ac6-9a63-2bcc7363bdb9 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:21.012035 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 914/1839] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:20 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:21.014342 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cadfc-31e7-43c0-b2a4-4382fd6c6945 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:21.039043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cadfc-31e7-43c0-b2a4-4382fd6c6945 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:21.064407 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2c2ef-5260-45f4-a197-441724058084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:21.065138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2c2ef-5260-45f4-a197-441724058084 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:21.065424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2c2ef-5260-45f4-a197-441724058084 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:21.065707 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2c2ef-5260-45f4-a197-441724058084 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:21.066784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2c2ef-5260-45f4-a197-441724058084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:21.068463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2c2ef-5260-45f4-a197-441724058084 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:21.082884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 915/1840] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:56:21.097131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2c2ef-5260-45f4-a197-441724058084 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:21.103217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 926/1841] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:20 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:21.112472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db250cb-8fd6-4ac6-9a63-2bcc7363bdb9 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:21.120951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2c2ef-5260-45f4-a197-441724058084 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:21.154553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:21.217990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db250cb-8fd6-4ac6-9a63-2bcc7363bdb9 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:21.225281 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443381ec-dd53-4e81-bb5c-c4335a16e48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:21.225999 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443381ec-dd53-4e81-bb5c-c4335a16e48f admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:21.226297 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443381ec-dd53-4e81-bb5c-c4335a16e48f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:21.226545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443381ec-dd53-4e81-bb5c-c4335a16e48f admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:21.227267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443381ec-dd53-4e81-bb5c-c4335a16e48f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:21.229390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443381ec-dd53-4e81-bb5c-c4335a16e48f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:21.245142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f776b9-49b0-42ed-9287-7028c1a49452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:21.245830 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f776b9-49b0-42ed-9287-7028c1a49452 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:21.246112 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f776b9-49b0-42ed-9287-7028c1a49452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:21.246385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f776b9-49b0-42ed-9287-7028c1a49452 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:21.247548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f776b9-49b0-42ed-9287-7028c1a49452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:21.249206 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f776b9-49b0-42ed-9287-7028c1a49452 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:21.265222 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 916/1842] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:21.266159 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f776b9-49b0-42ed-9287-7028c1a49452 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:21.276731 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f776b9-49b0-42ed-9287-7028c1a49452 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:21.282872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ee8b9-fed9-44da-9c83-6861e6a6d377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:21.283815 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ee8b9-fed9-44da-9c83-6861e6a6d377 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:21.284104 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ee8b9-fed9-44da-9c83-6861e6a6d377 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:21.284372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ee8b9-fed9-44da-9c83-6861e6a6d377 admin admin] PATH_INFO: `/v3/projects/bd78930b743340888dd13480d29cea87/users/4076daef857a4b7393724deb0bdc0c0b/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:21.316513 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ee8b9-fed9-44da-9c83-6861e6a6d377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd78930b743340888dd13480d29cea87, user_id=4076daef857a4b7393724deb0bdc0c0b, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:21.319512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ee8b9-fed9-44da-9c83-6861e6a6d377 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:21.360348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 927/1843] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:21 2022] POST /identity/v3/users => generated 299 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:21.361309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443381ec-dd53-4e81-bb5c-c4335a16e48f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:21.391459 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443381ec-dd53-4e81-bb5c-c4335a16e48f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:21.405168 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc8c4e-d34a-4d1e-98ad-abbc867889a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:21.412219 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc8c4e-d34a-4d1e-98ad-abbc867889a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:21.412219 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc8c4e-d34a-4d1e-98ad-abbc867889a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:21.412219 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc8c4e-d34a-4d1e-98ad-abbc867889a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:21.412219 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc8c4e-d34a-4d1e-98ad-abbc867889a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:21.412219 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc8c4e-d34a-4d1e-98ad-abbc867889a7 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:21.429331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 928/1844] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:21.433247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc8c4e-d34a-4d1e-98ad-abbc867889a7 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:21.444494 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 917/1845] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:21 2022] PUT /identity/v3/projects/bd78930b743340888dd13480d29cea87/users/4076daef857a4b7393724deb0bdc0c0b/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:21.451085 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc8c4e-d34a-4d1e-98ad-abbc867889a7 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:21.457610 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3260b-d3ad-4e9a-9bb9-73a0a6191264 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:21.458048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3260b-d3ad-4e9a-9bb9-73a0a6191264 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:21.458430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3260b-d3ad-4e9a-9bb9-73a0a6191264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:21.503071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-36a3260b-d3ad-4e9a-9bb9-73a0a6191264 None None] MFA Rules not processed for user `4076daef857a4b7393724deb0bdc0c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:21.505117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-36a3260b-d3ad-4e9a-9bb9-73a0a6191264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:21.568692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de502bae-9889-4ae2-a081-fe0f5dd09d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:21.570180 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502bae-9889-4ae2-a081-fe0f5dd09d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:21.570557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502bae-9889-4ae2-a081-fe0f5dd09d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:21.570934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502bae-9889-4ae2-a081-fe0f5dd09d1b admin admin] PATH_INFO: `/v3/projects/5f346582e9714786a8276af7062569f9/users/0b988739f1bd4c9098bd6272df433308/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:21.579734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:21.601562 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de502bae-9889-4ae2-a081-fe0f5dd09d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f346582e9714786a8276af7062569f9, user_id=0b988739f1bd4c9098bd6272df433308, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:21.604848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 918/1846] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:21.604973 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de502bae-9889-4ae2-a081-fe0f5dd09d1b admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:21.610080 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3260b-d3ad-4e9a-9bb9-73a0a6191264 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:21.625532 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3260b-d3ad-4e9a-9bb9-73a0a6191264 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:21.630427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d867802-8022-48cf-b19e-61f74911b47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:21.631322 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d867802-8022-48cf-b19e-61f74911b47f admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:21.631592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d867802-8022-48cf-b19e-61f74911b47f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:21.631869 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d867802-8022-48cf-b19e-61f74911b47f admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:21.632567 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d867802-8022-48cf-b19e-61f74911b47f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:21.634488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d867802-8022-48cf-b19e-61f74911b47f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:21.700673 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 929/1847] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:21 2022] PUT /identity/v3/projects/5f346582e9714786a8276af7062569f9/users/0b988739f1bd4c9098bd6272df433308/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:21.704782 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de502bae-9889-4ae2-a081-fe0f5dd09d1b admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:21.807541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 919/1848] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:21 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:21.808615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d867802-8022-48cf-b19e-61f74911b47f admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:21.815404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de502bae-9889-4ae2-a081-fe0f5dd09d1b admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:21.902083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b6ce4-dbdc-4704-912b-6dc1b9f0c582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:21.903123 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b6ce4-dbdc-4704-912b-6dc1b9f0c582 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:21.903550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b6ce4-dbdc-4704-912b-6dc1b9f0c582 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:21.905810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b6ce4-dbdc-4704-912b-6dc1b9f0c582 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:21.906863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b6ce4-dbdc-4704-912b-6dc1b9f0c582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:21.909428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b6ce4-dbdc-4704-912b-6dc1b9f0c582 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:21.930268 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 930/1849] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:21.944210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b6ce4-dbdc-4704-912b-6dc1b9f0c582 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:21.959923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b6ce4-dbdc-4704-912b-6dc1b9f0c582 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:21.962365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d867802-8022-48cf-b19e-61f74911b47f admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:21.971857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769402a-3de9-4471-a06b-65b0962be726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:21.972971 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbfb67-8305-46be-96d4-80baf06b89e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:21.974104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbfb67-8305-46be-96d4-80baf06b89e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:21.974458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbfb67-8305-46be-96d4-80baf06b89e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:21.975017 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769402a-3de9-4471-a06b-65b0962be726 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:21.975364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbfb67-8305-46be-96d4-80baf06b89e2 admin admin] PATH_INFO: `/v3/projects/5f346582e9714786a8276af7062569f9/users/0b988739f1bd4c9098bd6272df433308/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:21.976395 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769402a-3de9-4471-a06b-65b0962be726 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:21.976765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769402a-3de9-4471-a06b-65b0962be726 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:21.978079 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769402a-3de9-4471-a06b-65b0962be726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:21.979030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbfb67-8305-46be-96d4-80baf06b89e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f346582e9714786a8276af7062569f9, user_id=0b988739f1bd4c9098bd6272df433308, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:21.984113 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769402a-3de9-4471-a06b-65b0962be726 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:21.986154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbfb67-8305-46be-96d4-80baf06b89e2 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:22.007692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 931/1850] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:21 2022] PUT /identity/v3/projects/5f346582e9714786a8276af7062569f9/users/0b988739f1bd4c9098bd6272df433308/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:22.019518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fe2ed-5998-4b55-908f-dde14500a7db None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:22.019813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fe2ed-5998-4b55-908f-dde14500a7db None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:22.022500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fe2ed-5998-4b55-908f-dde14500a7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:22.064298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-ad7fe2ed-5998-4b55-908f-dde14500a7db None None] MFA Rules not processed for user `0b988739f1bd4c9098bd6272df433308`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:22.066217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-ad7fe2ed-5998-4b55-908f-dde14500a7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:22.104931 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 920/1851] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:21 2022] POST /identity/v3/users => generated 297 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:22.106702 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769402a-3de9-4471-a06b-65b0962be726 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:22.130033 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769402a-3de9-4471-a06b-65b0962be726 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:22.190713 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 932/1852] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:22.205130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fe2ed-5998-4b55-908f-dde14500a7db None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:22.206761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-ad7fe2ed-5998-4b55-908f-dde14500a7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:22.271265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882c608-34fa-4ca6-b0f2-0c1e8b4f0139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:22.272445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882c608-34fa-4ca6-b0f2-0c1e8b4f0139 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:22.273434 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882c608-34fa-4ca6-b0f2-0c1e8b4f0139 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:22.273932 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882c608-34fa-4ca6-b0f2-0c1e8b4f0139 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:22.275180 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882c608-34fa-4ca6-b0f2-0c1e8b4f0139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:22.277090 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882c608-34fa-4ca6-b0f2-0c1e8b4f0139 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:22.289032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:22.295756 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 921/1853] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:22.305955 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882c608-34fa-4ca6-b0f2-0c1e8b4f0139 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:22.319221 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882c608-34fa-4ca6-b0f2-0c1e8b4f0139 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:22.327521 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82efe2-a61f-477c-b685-c365a40f6af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:22.328724 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82efe2-a61f-477c-b685-c365a40f6af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:22.334722 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82efe2-a61f-477c-b685-c365a40f6af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:22.334722 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82efe2-a61f-477c-b685-c365a40f6af5 admin admin] PATH_INFO: `/v3/projects/2549eb47e9d44e5f8cd9d95f5338cddf/users/b20462aa83204bceb6e7b7a36ad784fe/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:22.349252 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fe2ed-5998-4b55-908f-dde14500a7db None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:22.358426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8f0da-9372-441e-8a1d-8fe98d739369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:22.365920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8f0da-9372-441e-8a1d-8fe98d739369 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:22.365920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8f0da-9372-441e-8a1d-8fe98d739369 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:22.366165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82efe2-a61f-477c-b685-c365a40f6af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2549eb47e9d44e5f8cd9d95f5338cddf, user_id=b20462aa83204bceb6e7b7a36ad784fe, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:22.366254 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8f0da-9372-441e-8a1d-8fe98d739369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:22.366366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82efe2-a61f-477c-b685-c365a40f6af5 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:22.438583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8f0da-9372-441e-8a1d-8fe98d739369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:22.440192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8f0da-9372-441e-8a1d-8fe98d739369 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:22.455132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 933/1854] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:22.475896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 922/1855] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:22 2022] PUT /identity/v3/projects/2549eb47e9d44e5f8cd9d95f5338cddf/users/b20462aa83204bceb6e7b7a36ad784fe/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:22.480001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8f0da-9372-441e-8a1d-8fe98d739369 service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:22.492325 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8f0da-9372-441e-8a1d-8fe98d739369 service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:22.633140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089b072-326d-4d4a-b061-bbf1a146b46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:22.634009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089b072-326d-4d4a-b061-bbf1a146b46e admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:22.634346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089b072-326d-4d4a-b061-bbf1a146b46e admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:22.634639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089b072-326d-4d4a-b061-bbf1a146b46e admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:22.646515 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089b072-326d-4d4a-b061-bbf1a146b46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:22.646985 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089b072-326d-4d4a-b061-bbf1a146b46e admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:22.686641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 934/1856] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:22.691311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82efe2-a61f-477c-b685-c365a40f6af5 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:22.710733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:22.723612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82efe2-a61f-477c-b685-c365a40f6af5 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:22.728665 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca07be-e5a9-4667-9e30-de872c54c7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:22.729772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca07be-e5a9-4667-9e30-de872c54c7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:22.730158 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca07be-e5a9-4667-9e30-de872c54c7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:22.730545 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca07be-e5a9-4667-9e30-de872c54c7a9 admin admin] PATH_INFO: `/v3/projects/2549eb47e9d44e5f8cd9d95f5338cddf/users/b20462aa83204bceb6e7b7a36ad784fe/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:22.742443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca07be-e5a9-4667-9e30-de872c54c7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2549eb47e9d44e5f8cd9d95f5338cddf, user_id=b20462aa83204bceb6e7b7a36ad784fe, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:22.748220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca07be-e5a9-4667-9e30-de872c54c7a9 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:22.781060 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 923/1857] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:22 2022] PUT /identity/v3/projects/2549eb47e9d44e5f8cd9d95f5338cddf/users/b20462aa83204bceb6e7b7a36ad784fe/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:22.791133 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53bfdb-f0e5-4020-9205-4d473f18cf5b None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:22.791425 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53bfdb-f0e5-4020-9205-4d473f18cf5b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:22.791710 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53bfdb-f0e5-4020-9205-4d473f18cf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:22.829181 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-0f53bfdb-f0e5-4020-9205-4d473f18cf5b None None] MFA Rules not processed for user `b20462aa83204bceb6e7b7a36ad784fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:22.830714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-0f53bfdb-f0e5-4020-9205-4d473f18cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:22.943946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 935/1858] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:22.951575 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca07be-e5a9-4667-9e30-de872c54c7a9 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:22.971130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:23.051453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca07be-e5a9-4667-9e30-de872c54c7a9 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:23.055692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c96c03-2531-4fb6-a823-082da52aa537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:23.057490 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c96c03-2531-4fb6-a823-082da52aa537 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:23.057490 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c96c03-2531-4fb6-a823-082da52aa537 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:23.057490 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c96c03-2531-4fb6-a823-082da52aa537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:23.070478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c96c03-2531-4fb6-a823-082da52aa537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:23.072385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c96c03-2531-4fb6-a823-082da52aa537 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:23.096961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 924/1859] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:56:23.333446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53bfdb-f0e5-4020-9205-4d473f18cf5b None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:23.344008 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53bfdb-f0e5-4020-9205-4d473f18cf5b None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:23.348007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782384e8-eb41-4e91-bce7-79b9fe922aa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:23.348662 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782384e8-eb41-4e91-bce7-79b9fe922aa3 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:23.349070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782384e8-eb41-4e91-bce7-79b9fe922aa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:23.349324 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782384e8-eb41-4e91-bce7-79b9fe922aa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:23.454113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782384e8-eb41-4e91-bce7-79b9fe922aa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:23.455578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782384e8-eb41-4e91-bce7-79b9fe922aa3 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:23.478564 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 936/1860] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:23.945268 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:23.984657 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:25.367755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c96c03-2531-4fb6-a823-082da52aa537 service cinder] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:25.454160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c96c03-2531-4fb6-a823-082da52aa537 service cinder] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:25.458737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756aa26-8df6-461b-a6e4-a89dcf9c84df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:25.459603 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756aa26-8df6-461b-a6e4-a89dcf9c84df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:25.459878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756aa26-8df6-461b-a6e4-a89dcf9c84df admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:25.460143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756aa26-8df6-461b-a6e4-a89dcf9c84df admin admin] PATH_INFO: `/v3/users/4076daef857a4b7393724deb0bdc0c0b` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:25.461407 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756aa26-8df6-461b-a6e4-a89dcf9c84df admin admin] RBAC: Authorizing `identity:delete_user(user_id=4076daef857a4b7393724deb0bdc0c0b)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:25.463416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756aa26-8df6-461b-a6e4-a89dcf9c84df admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:25.661065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5756aa26-8df6-461b-a6e4-a89dcf9c84df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4076daef857a4b7393724deb0bdc0c0b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:25.675055 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5756aa26-8df6-461b-a6e4-a89dcf9c84df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4076daef857a4b7393724deb0bdc0c0b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:25.742762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5756aa26-8df6-461b-a6e4-a89dcf9c84df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4076daef857a4b7393724deb0bdc0c0b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:25.742998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:25.743491 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5756aa26-8df6-461b-a6e4-a89dcf9c84df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4076daef857a4b7393724deb0bdc0c0b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:25.751492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5756aa26-8df6-461b-a6e4-a89dcf9c84df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4076daef857a4b7393724deb0bdc0c0b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:25.758284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 925/1861] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:25 2022] DELETE /identity/v3/users/4076daef857a4b7393724deb0bdc0c0b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:25.763819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eda6ca-afa9-4647-8435-f7eb4a87b608 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:25.764072 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eda6ca-afa9-4647-8435-f7eb4a87b608 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:25.764334 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eda6ca-afa9-4647-8435-f7eb4a87b608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:25.782798 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-91eda6ca-afa9-4647-8435-f7eb4a87b608 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:25.783998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-91eda6ca-afa9-4647-8435-f7eb4a87b608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:25.817508 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:25.851093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 937/1862] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:25.861385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756aa26-8df6-461b-a6e4-a89dcf9c84df admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:25.862878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-5756aa26-8df6-461b-a6e4-a89dcf9c84df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:25.951134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756aa26-8df6-461b-a6e4-a89dcf9c84df admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:25.955431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c72b04-16f0-498a-a01b-f2c1c701cf80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:25.960104 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c72b04-16f0-498a-a01b-f2c1c701cf80 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:25.960104 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c72b04-16f0-498a-a01b-f2c1c701cf80 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:25.960104 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c72b04-16f0-498a-a01b-f2c1c701cf80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:25.967589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c72b04-16f0-498a-a01b-f2c1c701cf80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:25.979263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c72b04-16f0-498a-a01b-f2c1c701cf80 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:25.982884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 926/1863] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:26.655638 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eda6ca-afa9-4647-8435-f7eb4a87b608 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:26.657320 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-91eda6ca-afa9-4647-8435-f7eb4a87b608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:26.683871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eda6ca-afa9-4647-8435-f7eb4a87b608 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:26.692128 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fddbbc-3013-49b5-a898-301bb546cd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:26.693249 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fddbbc-3013-49b5-a898-301bb546cd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:26.693596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fddbbc-3013-49b5-a898-301bb546cd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:26.693939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fddbbc-3013-49b5-a898-301bb546cd4b admin admin] PATH_INFO: `/v3/projects/bd78930b743340888dd13480d29cea87` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:26.695306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fddbbc-3013-49b5-a898-301bb546cd4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd78930b743340888dd13480d29cea87)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:26.697359 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fddbbc-3013-49b5-a898-301bb546cd4b admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:26.791253 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:26.808146 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-31fddbbc-3013-49b5-a898-301bb546cd4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd78930b743340888dd13480d29cea87', 'request_id': 'req-31fddbbc-3013-49b5-a898-301bb546cd4b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:26.816255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-31fddbbc-3013-49b5-a898-301bb546cd4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd78930b743340888dd13480d29cea87', 'request_id': 'req-31fddbbc-3013-49b5-a898-301bb546cd4b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:26.909656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-31fddbbc-3013-49b5-a898-301bb546cd4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd78930b743340888dd13480d29cea87', 'request_id': 'req-31fddbbc-3013-49b5-a898-301bb546cd4b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:26.920711 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-31fddbbc-3013-49b5-a898-301bb546cd4b admin admin] The token cache is being invalidate because project bd78930b743340888dd13480d29cea87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:26.922414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-31fddbbc-3013-49b5-a898-301bb546cd4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:26.922414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-31fddbbc-3013-49b5-a898-301bb546cd4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:26.923344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 938/1864] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:26 2022] DELETE /identity/v3/projects/bd78930b743340888dd13480d29cea87 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:26.927425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c72b04-16f0-498a-a01b-f2c1c701cf80 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:26.937825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c72b04-16f0-498a-a01b-f2c1c701cf80 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:26.995636 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57df90c-1080-45d8-a73c-41b2883af114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:26.996504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57df90c-1080-45d8-a73c-41b2883af114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:26.996814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57df90c-1080-45d8-a73c-41b2883af114 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:26.997090 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57df90c-1080-45d8-a73c-41b2883af114 admin admin] PATH_INFO: `/v3/users/b20462aa83204bceb6e7b7a36ad784fe` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:26.998812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57df90c-1080-45d8-a73c-41b2883af114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20462aa83204bceb6e7b7a36ad784fe)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:27.000784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57df90c-1080-45d8-a73c-41b2883af114 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:27.212457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e57df90c-1080-45d8-a73c-41b2883af114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20462aa83204bceb6e7b7a36ad784fe'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:27.224334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:27.226503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e57df90c-1080-45d8-a73c-41b2883af114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20462aa83204bceb6e7b7a36ad784fe'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:27.292683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e57df90c-1080-45d8-a73c-41b2883af114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20462aa83204bceb6e7b7a36ad784fe'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:27.293360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e57df90c-1080-45d8-a73c-41b2883af114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20462aa83204bceb6e7b7a36ad784fe'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:27.301397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e57df90c-1080-45d8-a73c-41b2883af114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20462aa83204bceb6e7b7a36ad784fe'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:27.307142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 927/1865] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:26 2022] DELETE /identity/v3/users/b20462aa83204bceb6e7b7a36ad784fe => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:27.878605 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fddbbc-3013-49b5-a898-301bb546cd4b admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:27.881396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-31fddbbc-3013-49b5-a898-301bb546cd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:27.909175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fddbbc-3013-49b5-a898-301bb546cd4b admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:27.982563 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac4d70-5c90-46ab-bd7c-dfe668e7de44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:27.983945 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac4d70-5c90-46ab-bd7c-dfe668e7de44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:27.984234 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac4d70-5c90-46ab-bd7c-dfe668e7de44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:27.984513 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac4d70-5c90-46ab-bd7c-dfe668e7de44 admin admin] PATH_INFO: `/v3/projects/2549eb47e9d44e5f8cd9d95f5338cddf` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:27.985754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac4d70-5c90-46ab-bd7c-dfe668e7de44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2549eb47e9d44e5f8cd9d95f5338cddf)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:27.987653 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac4d70-5c90-46ab-bd7c-dfe668e7de44 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:28.076118 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c7ac4d70-5c90-46ab-bd7c-dfe668e7de44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2549eb47e9d44e5f8cd9d95f5338cddf', 'request_id': 'req-c7ac4d70-5c90-46ab-bd7c-dfe668e7de44'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:28.083081 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c7ac4d70-5c90-46ab-bd7c-dfe668e7de44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2549eb47e9d44e5f8cd9d95f5338cddf', 'request_id': 'req-c7ac4d70-5c90-46ab-bd7c-dfe668e7de44'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:28.155887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c7ac4d70-5c90-46ab-bd7c-dfe668e7de44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2549eb47e9d44e5f8cd9d95f5338cddf', 'request_id': 'req-c7ac4d70-5c90-46ab-bd7c-dfe668e7de44'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:28.168102 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c7ac4d70-5c90-46ab-bd7c-dfe668e7de44 admin admin] The token cache is being invalidate because project 2549eb47e9d44e5f8cd9d95f5338cddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:28.168392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c7ac4d70-5c90-46ab-bd7c-dfe668e7de44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:28.169080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c7ac4d70-5c90-46ab-bd7c-dfe668e7de44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:28.170803 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 939/1866] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:27 2022] DELETE /identity/v3/projects/2549eb47e9d44e5f8cd9d95f5338cddf => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:28.176025 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98612d7c-ce57-49ab-b63e-e18e5cf77e5d None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:28.176983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98612d7c-ce57-49ab-b63e-e18e5cf77e5d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:28.176983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98612d7c-ce57-49ab-b63e-e18e5cf77e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:28.198062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-98612d7c-ce57-49ab-b63e-e18e5cf77e5d None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:28.199329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-98612d7c-ce57-49ab-b63e-e18e5cf77e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:28.265892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 928/1867] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:28.273605 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d4b43-861b-4e52-a8bb-4f6530af704b None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:28.273985 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d4b43-861b-4e52-a8bb-4f6530af704b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:28.274362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d4b43-861b-4e52-a8bb-4f6530af704b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:28.295223 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-e96d4b43-861b-4e52-a8bb-4f6530af704b None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:28.296942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e96d4b43-861b-4e52-a8bb-4f6530af704b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:28.304965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 940/1868] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:28.309223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98612d7c-ce57-49ab-b63e-e18e5cf77e5d None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:28.319728 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98612d7c-ce57-49ab-b63e-e18e5cf77e5d None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:28.324271 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e16d16-352b-4f7c-942a-7d4fc39121bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:28.324953 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e16d16-352b-4f7c-942a-7d4fc39121bc admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:28.325241 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e16d16-352b-4f7c-942a-7d4fc39121bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:28.325527 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e16d16-352b-4f7c-942a-7d4fc39121bc admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:28.326253 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e16d16-352b-4f7c-942a-7d4fc39121bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:56:28.326579 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e16d16-352b-4f7c-942a-7d4fc39121bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:28.328794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e16d16-352b-4f7c-942a-7d4fc39121bc admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:28.340116 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 929/1869] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:56:28.344796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d4b43-861b-4e52-a8bb-4f6530af704b None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:28.354038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d4b43-861b-4e52-a8bb-4f6530af704b None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:28.359196 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c94787-eeaa-4393-86ab-7b5843094946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:28.359841 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c94787-eeaa-4393-86ab-7b5843094946 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:28.360129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c94787-eeaa-4393-86ab-7b5843094946 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:28.360411 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c94787-eeaa-4393-86ab-7b5843094946 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:28.361146 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c94787-eeaa-4393-86ab-7b5843094946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:28.363035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c94787-eeaa-4393-86ab-7b5843094946 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:28.437156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 941/1870] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:28 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:28.441345 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e16d16-352b-4f7c-942a-7d4fc39121bc admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:28.452393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e16d16-352b-4f7c-942a-7d4fc39121bc admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:28.541233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16c05d-098f-4cb9-9f45-14bf46c866ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:28.543996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16c05d-098f-4cb9-9f45-14bf46c866ae admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:28.543996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16c05d-098f-4cb9-9f45-14bf46c866ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:28.543996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16c05d-098f-4cb9-9f45-14bf46c866ae admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:28.543996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16c05d-098f-4cb9-9f45-14bf46c866ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:28.546002 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16c05d-098f-4cb9-9f45-14bf46c866ae admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:28.630963 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 930/1871] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:28 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:28.634960 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c94787-eeaa-4393-86ab-7b5843094946 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:28.645147 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c94787-eeaa-4393-86ab-7b5843094946 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:28.649789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6f28e-2ccc-4823-ae1b-6650bbd7114c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:28.650461 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6f28e-2ccc-4823-ae1b-6650bbd7114c admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:28.650719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6f28e-2ccc-4823-ae1b-6650bbd7114c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:28.650998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6f28e-2ccc-4823-ae1b-6650bbd7114c admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:28.651785 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6f28e-2ccc-4823-ae1b-6650bbd7114c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:28.653424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6f28e-2ccc-4823-ae1b-6650bbd7114c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:28.674480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 942/1872] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:28.675734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16c05d-098f-4cb9-9f45-14bf46c866ae admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:28.692551 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16c05d-098f-4cb9-9f45-14bf46c866ae admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:28.701331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a733c-7019-4619-bd89-e892d8bb77df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:28.702155 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a733c-7019-4619-bd89-e892d8bb77df admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:28.702501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a733c-7019-4619-bd89-e892d8bb77df admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:28.702839 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a733c-7019-4619-bd89-e892d8bb77df admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:28.703695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a733c-7019-4619-bd89-e892d8bb77df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:28.705340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a733c-7019-4619-bd89-e892d8bb77df admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:28.718350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 931/1873] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:28.722368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6f28e-2ccc-4823-ae1b-6650bbd7114c admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:28.730806 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:28.735055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6f28e-2ccc-4823-ae1b-6650bbd7114c admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:28.740528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2acc6a-2ad2-4d65-b20a-9cd9676a737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:28.744948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2acc6a-2ad2-4d65-b20a-9cd9676a737f admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:28.744948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2acc6a-2ad2-4d65-b20a-9cd9676a737f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:28.744948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2acc6a-2ad2-4d65-b20a-9cd9676a737f admin admin] PATH_INFO: `/v3/projects/351d6519a67549d0a6e307fcdbb56d02/users/a30eb464312040fdafce34a106a6e718/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:28.764707 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2acc6a-2ad2-4d65-b20a-9cd9676a737f admin admin] RBAC: Authorizing `identity:create_grant(project_id=351d6519a67549d0a6e307fcdbb56d02, user_id=a30eb464312040fdafce34a106a6e718, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:28.765515 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2acc6a-2ad2-4d65-b20a-9cd9676a737f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:28.857736 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 943/1874] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:28 2022] PUT /identity/v3/projects/351d6519a67549d0a6e307fcdbb56d02/users/a30eb464312040fdafce34a106a6e718/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:56:28.869809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33556557-b6a4-4d01-b81a-476938752086 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:28.870098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33556557-b6a4-4d01-b81a-476938752086 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:28.870378 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33556557-b6a4-4d01-b81a-476938752086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:28.904435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-33556557-b6a4-4d01-b81a-476938752086 None None] MFA Rules not processed for user `a30eb464312040fdafce34a106a6e718`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:28.906268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-33556557-b6a4-4d01-b81a-476938752086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:28.946432 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:28.980695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 932/1875] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:28.994751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2acc6a-2ad2-4d65-b20a-9cd9676a737f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:28.996564 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-8d2acc6a-2ad2-4d65-b20a-9cd9676a737f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:29.071730 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2acc6a-2ad2-4d65-b20a-9cd9676a737f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:29.075623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84bb58-5875-4f17-ade8-bf750cbc2116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:29.076277 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84bb58-5875-4f17-ade8-bf750cbc2116 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:29.076627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84bb58-5875-4f17-ade8-bf750cbc2116 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:29.077060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84bb58-5875-4f17-ade8-bf750cbc2116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:29.093419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84bb58-5875-4f17-ade8-bf750cbc2116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:29.096543 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84bb58-5875-4f17-ade8-bf750cbc2116 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:29.110243 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 944/1876] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:29.135516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33556557-b6a4-4d01-b81a-476938752086 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:29.203870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33556557-b6a4-4d01-b81a-476938752086 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:29.209135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cbaae-4c88-4d6b-98f9-fcc2150d4c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:29.210001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cbaae-4c88-4d6b-98f9-fcc2150d4c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:29.210286 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cbaae-4c88-4d6b-98f9-fcc2150d4c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:29.210621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cbaae-4c88-4d6b-98f9-fcc2150d4c95 admin admin] PATH_INFO: `/v3/users/a30eb464312040fdafce34a106a6e718` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:29.211864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cbaae-4c88-4d6b-98f9-fcc2150d4c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a30eb464312040fdafce34a106a6e718)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:29.213783 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cbaae-4c88-4d6b-98f9-fcc2150d4c95 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:29.383859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-533cbaae-4c88-4d6b-98f9-fcc2150d4c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a30eb464312040fdafce34a106a6e718'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:29.395808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-533cbaae-4c88-4d6b-98f9-fcc2150d4c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a30eb464312040fdafce34a106a6e718'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:29.468556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-533cbaae-4c88-4d6b-98f9-fcc2150d4c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a30eb464312040fdafce34a106a6e718'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:29.469182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-533cbaae-4c88-4d6b-98f9-fcc2150d4c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a30eb464312040fdafce34a106a6e718'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:29.476205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-533cbaae-4c88-4d6b-98f9-fcc2150d4c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a30eb464312040fdafce34a106a6e718'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:29.482183 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 933/1877] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:29 2022] DELETE /identity/v3/users/a30eb464312040fdafce34a106a6e718 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:29.486873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953e32f-4814-4090-b275-f22ac5a4cf06 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:29.494728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953e32f-4814-4090-b275-f22ac5a4cf06 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:29.494728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953e32f-4814-4090-b275-f22ac5a4cf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:29.504915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-6953e32f-4814-4090-b275-f22ac5a4cf06 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:29.506392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-6953e32f-4814-4090-b275-f22ac5a4cf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:29.567819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 945/1878] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:29.577883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cbaae-4c88-4d6b-98f9-fcc2150d4c95 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:29.579291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-533cbaae-4c88-4d6b-98f9-fcc2150d4c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:29.636008 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cbaae-4c88-4d6b-98f9-fcc2150d4c95 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:29.640073 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a751129-d5b0-4b62-97be-524a89926e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:29.640731 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a751129-d5b0-4b62-97be-524a89926e35 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:29.641010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a751129-d5b0-4b62-97be-524a89926e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:29.641277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a751129-d5b0-4b62-97be-524a89926e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:29.648001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:29.650203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a751129-d5b0-4b62-97be-524a89926e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:29.651605 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a751129-d5b0-4b62-97be-524a89926e35 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:29.660905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 934/1879] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:30.084366 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953e32f-4814-4090-b275-f22ac5a4cf06 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:30.087379 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-6953e32f-4814-4090-b275-f22ac5a4cf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:30.100258 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953e32f-4814-4090-b275-f22ac5a4cf06 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:30.114491 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63c9e8-bfd4-4daa-ac64-26ac6a4f4f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:30.115599 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63c9e8-bfd4-4daa-ac64-26ac6a4f4f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:30.116086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63c9e8-bfd4-4daa-ac64-26ac6a4f4f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:30.116637 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63c9e8-bfd4-4daa-ac64-26ac6a4f4f25 admin admin] PATH_INFO: `/v3/projects/351d6519a67549d0a6e307fcdbb56d02` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:30.118105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63c9e8-bfd4-4daa-ac64-26ac6a4f4f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=351d6519a67549d0a6e307fcdbb56d02)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:30.120218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63c9e8-bfd4-4daa-ac64-26ac6a4f4f25 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:30.212398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ab63c9e8-bfd4-4daa-ac64-26ac6a4f4f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351d6519a67549d0a6e307fcdbb56d02', 'request_id': 'req-ab63c9e8-bfd4-4daa-ac64-26ac6a4f4f25'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:30.219314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ab63c9e8-bfd4-4daa-ac64-26ac6a4f4f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351d6519a67549d0a6e307fcdbb56d02', 'request_id': 'req-ab63c9e8-bfd4-4daa-ac64-26ac6a4f4f25'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:30.275339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ab63c9e8-bfd4-4daa-ac64-26ac6a4f4f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351d6519a67549d0a6e307fcdbb56d02', 'request_id': 'req-ab63c9e8-bfd4-4daa-ac64-26ac6a4f4f25'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:30.291184 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ab63c9e8-bfd4-4daa-ac64-26ac6a4f4f25 admin admin] The token cache is being invalidate because project 351d6519a67549d0a6e307fcdbb56d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:30.291480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ab63c9e8-bfd4-4daa-ac64-26ac6a4f4f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:30.292211 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ab63c9e8-bfd4-4daa-ac64-26ac6a4f4f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:30.294380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 946/1880] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:30 2022] DELETE /identity/v3/projects/351d6519a67549d0a6e307fcdbb56d02 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:56:30.303630 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13190618-c062-4243-8773-f04111a5d43f None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:30.304142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13190618-c062-4243-8773-f04111a5d43f None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:30.304240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13190618-c062-4243-8773-f04111a5d43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:30.323149 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-13190618-c062-4243-8773-f04111a5d43f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:30.324360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-13190618-c062-4243-8773-f04111a5d43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:30.387905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 935/1881] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:30.395744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be223f-18d4-4e7b-945d-64d09f5acb20 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:30.396035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be223f-18d4-4e7b-945d-64d09f5acb20 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:30.396314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be223f-18d4-4e7b-945d-64d09f5acb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:30.410160 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:30.415577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-81be223f-18d4-4e7b-945d-64d09f5acb20 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:30.416804 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-81be223f-18d4-4e7b-945d-64d09f5acb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:30.425539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 947/1882] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:30.429756 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13190618-c062-4243-8773-f04111a5d43f None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:30.439415 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13190618-c062-4243-8773-f04111a5d43f None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:30.444182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a9349-1111-43ad-8e84-27714c464c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:30.444859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a9349-1111-43ad-8e84-27714c464c97 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:30.445142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a9349-1111-43ad-8e84-27714c464c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:30.445418 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a9349-1111-43ad-8e84-27714c464c97 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:30.446144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a9349-1111-43ad-8e84-27714c464c97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:56:30.446455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a9349-1111-43ad-8e84-27714c464c97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:30.448031 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a9349-1111-43ad-8e84-27714c464c97 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:30.459542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 936/1883] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:56:30.464585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be223f-18d4-4e7b-945d-64d09f5acb20 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:30.473560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be223f-18d4-4e7b-945d-64d09f5acb20 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:30.478166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df524ff-a72d-4978-a67e-078ab2f54475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:30.478803 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df524ff-a72d-4978-a67e-078ab2f54475 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:30.479113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df524ff-a72d-4978-a67e-078ab2f54475 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:30.479395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df524ff-a72d-4978-a67e-078ab2f54475 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:30.480451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df524ff-a72d-4978-a67e-078ab2f54475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:30.483484 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df524ff-a72d-4978-a67e-078ab2f54475 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:30.569188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 948/1884] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:30 2022] POST /identity/v3/projects => generated 361 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:30.573175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a9349-1111-43ad-8e84-27714c464c97 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:30.584283 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a9349-1111-43ad-8e84-27714c464c97 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:30.639793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5199d-4652-4a25-98db-a96e7738753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:30.640485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5199d-4652-4a25-98db-a96e7738753e admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:30.640803 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5199d-4652-4a25-98db-a96e7738753e admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:30.641079 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5199d-4652-4a25-98db-a96e7738753e admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:30.641801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5199d-4652-4a25-98db-a96e7738753e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:30.643742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5199d-4652-4a25-98db-a96e7738753e admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:30.745299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 937/1885] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:30 2022] POST /identity/v3/users => generated 281 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:30.749843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df524ff-a72d-4978-a67e-078ab2f54475 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:30.760663 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df524ff-a72d-4978-a67e-078ab2f54475 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:30.765546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb79fb-1310-4bee-96fb-d14d3a6c0794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:30.766884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb79fb-1310-4bee-96fb-d14d3a6c0794 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:30.767175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb79fb-1310-4bee-96fb-d14d3a6c0794 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:30.767453 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb79fb-1310-4bee-96fb-d14d3a6c0794 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:30.768185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb79fb-1310-4bee-96fb-d14d3a6c0794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:30.769797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb79fb-1310-4bee-96fb-d14d3a6c0794 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:30.780519 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 949/1886] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:56:30.784573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5199d-4652-4a25-98db-a96e7738753e admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:30.794872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5199d-4652-4a25-98db-a96e7738753e admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:30.800116 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1007a-c7bf-442e-b721-f58bd6dfc008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:30.800610 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1007a-c7bf-442e-b721-f58bd6dfc008 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:30.800921 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1007a-c7bf-442e-b721-f58bd6dfc008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:30.801214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1007a-c7bf-442e-b721-f58bd6dfc008 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:30.801933 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1007a-c7bf-442e-b721-f58bd6dfc008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:30.803493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1007a-c7bf-442e-b721-f58bd6dfc008 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:30.820726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 938/1887] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:30.822156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb79fb-1310-4bee-96fb-d14d3a6c0794 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:30.832828 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb79fb-1310-4bee-96fb-d14d3a6c0794 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:30.839040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b0ac3-693e-4f09-8681-68d190192232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:30.839933 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b0ac3-693e-4f09-8681-68d190192232 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:30.840215 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b0ac3-693e-4f09-8681-68d190192232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:30.840494 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b0ac3-693e-4f09-8681-68d190192232 admin admin] PATH_INFO: `/v3/projects/758a6329b8404878a1c8d30a3b055c9a/users/5c1a6785a5b04d768c88ae25e8d50265/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:30.858398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b0ac3-693e-4f09-8681-68d190192232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758a6329b8404878a1c8d30a3b055c9a, user_id=5c1a6785a5b04d768c88ae25e8d50265, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:30.861096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b0ac3-693e-4f09-8681-68d190192232 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:30.931937 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 950/1888] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:30 2022] PUT /identity/v3/projects/758a6329b8404878a1c8d30a3b055c9a/users/5c1a6785a5b04d768c88ae25e8d50265/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:30.943216 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd72949-aa2e-45cf-baac-22cc8fbe3c0f None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:30.943516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd72949-aa2e-45cf-baac-22cc8fbe3c0f None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:30.943797 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd72949-aa2e-45cf-baac-22cc8fbe3c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:30.970757 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-abd72949-aa2e-45cf-baac-22cc8fbe3c0f None None] MFA Rules not processed for user `5c1a6785a5b04d768c88ae25e8d50265`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:30.971923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-abd72949-aa2e-45cf-baac-22cc8fbe3c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:31.020798 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:31.037671 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 939/1889] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:31.073664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b0ac3-693e-4f09-8681-68d190192232 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:31.075380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e90b0ac3-693e-4f09-8681-68d190192232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:31.135346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b0ac3-693e-4f09-8681-68d190192232 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:31.138986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38705310-4081-4255-bea6-bbb0f5cc951d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:31.139820 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38705310-4081-4255-bea6-bbb0f5cc951d service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:31.140094 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38705310-4081-4255-bea6-bbb0f5cc951d service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:31.140370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38705310-4081-4255-bea6-bbb0f5cc951d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:31.148632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38705310-4081-4255-bea6-bbb0f5cc951d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:31.150069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38705310-4081-4255-bea6-bbb0f5cc951d service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:31.159336 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 951/1890] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:31.174045 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd72949-aa2e-45cf-baac-22cc8fbe3c0f None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:31.240897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd72949-aa2e-45cf-baac-22cc8fbe3c0f None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:31.245424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be59636-f6c3-4bde-93cd-0bc01dc4474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:31.246284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be59636-f6c3-4bde-93cd-0bc01dc4474b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:31.246891 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be59636-f6c3-4bde-93cd-0bc01dc4474b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:31.246891 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be59636-f6c3-4bde-93cd-0bc01dc4474b admin admin] PATH_INFO: `/v3/users/5c1a6785a5b04d768c88ae25e8d50265` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:31.248081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be59636-f6c3-4bde-93cd-0bc01dc4474b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1a6785a5b04d768c88ae25e8d50265)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:31.250039 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be59636-f6c3-4bde-93cd-0bc01dc4474b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:31.477260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1be59636-f6c3-4bde-93cd-0bc01dc4474b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1a6785a5b04d768c88ae25e8d50265'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:31.490435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1be59636-f6c3-4bde-93cd-0bc01dc4474b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1a6785a5b04d768c88ae25e8d50265'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:31.555875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1be59636-f6c3-4bde-93cd-0bc01dc4474b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1a6785a5b04d768c88ae25e8d50265'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:31.556661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1be59636-f6c3-4bde-93cd-0bc01dc4474b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1a6785a5b04d768c88ae25e8d50265'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:31.567296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1be59636-f6c3-4bde-93cd-0bc01dc4474b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1a6785a5b04d768c88ae25e8d50265'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:31.585192 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 940/1891] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:31 2022] DELETE /identity/v3/users/5c1a6785a5b04d768c88ae25e8d50265 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:31.586600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f46cf-5c20-4c55-bf81-1b2e62112ccb None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:31.586914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f46cf-5c20-4c55-bf81-1b2e62112ccb None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:31.587214 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f46cf-5c20-4c55-bf81-1b2e62112ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:31.604341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-fd1f46cf-5c20-4c55-bf81-1b2e62112ccb None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:31.605628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-fd1f46cf-5c20-4c55-bf81-1b2e62112ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:31.669979 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 952/1892] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:31.680375 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be59636-f6c3-4bde-93cd-0bc01dc4474b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:31.681868 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-1be59636-f6c3-4bde-93cd-0bc01dc4474b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:31.744808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be59636-f6c3-4bde-93cd-0bc01dc4474b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:31.749232 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb46a88-3efa-48d5-8652-6235cb769d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:31.750141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb46a88-3efa-48d5-8652-6235cb769d09 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:31.750428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb46a88-3efa-48d5-8652-6235cb769d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:31.750698 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb46a88-3efa-48d5-8652-6235cb769d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:31.765109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb46a88-3efa-48d5-8652-6235cb769d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:31.766636 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb46a88-3efa-48d5-8652-6235cb769d09 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:31.778478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 941/1893] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:32.693263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f46cf-5c20-4c55-bf81-1b2e62112ccb None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:32.694968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-fd1f46cf-5c20-4c55-bf81-1b2e62112ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:32.725521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f46cf-5c20-4c55-bf81-1b2e62112ccb None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:32.751115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10fab6-b2bc-4244-b8bb-9c6f234ab45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:32.752594 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10fab6-b2bc-4244-b8bb-9c6f234ab45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:32.753142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10fab6-b2bc-4244-b8bb-9c6f234ab45a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:32.754348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10fab6-b2bc-4244-b8bb-9c6f234ab45a admin admin] PATH_INFO: `/v3/projects/758a6329b8404878a1c8d30a3b055c9a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:32.763822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10fab6-b2bc-4244-b8bb-9c6f234ab45a admin admin] RBAC: Authorizing `identity:delete_project(project_id=758a6329b8404878a1c8d30a3b055c9a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:32.767579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10fab6-b2bc-4244-b8bb-9c6f234ab45a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:32.911791 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:32.919901 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-bb10fab6-b2bc-4244-b8bb-9c6f234ab45a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758a6329b8404878a1c8d30a3b055c9a', 'request_id': 'req-bb10fab6-b2bc-4244-b8bb-9c6f234ab45a'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:32.929139 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-bb10fab6-b2bc-4244-b8bb-9c6f234ab45a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758a6329b8404878a1c8d30a3b055c9a', 'request_id': 'req-bb10fab6-b2bc-4244-b8bb-9c6f234ab45a'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:33.019138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-bb10fab6-b2bc-4244-b8bb-9c6f234ab45a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758a6329b8404878a1c8d30a3b055c9a', 'request_id': 'req-bb10fab6-b2bc-4244-b8bb-9c6f234ab45a'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:33.039579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-bb10fab6-b2bc-4244-b8bb-9c6f234ab45a admin admin] The token cache is being invalidate because project 758a6329b8404878a1c8d30a3b055c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:33.039879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-bb10fab6-b2bc-4244-b8bb-9c6f234ab45a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:33.040570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-bb10fab6-b2bc-4244-b8bb-9c6f234ab45a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:33.046458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 953/1894] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:32 2022] DELETE /identity/v3/projects/758a6329b8404878a1c8d30a3b055c9a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:33.052814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b751992-a1d2-4a7d-8453-8bb9bf713222 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:33.056371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b751992-a1d2-4a7d-8453-8bb9bf713222 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:33.056371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b751992-a1d2-4a7d-8453-8bb9bf713222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:33.097718 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-5b751992-a1d2-4a7d-8453-8bb9bf713222 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:33.100666 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-5b751992-a1d2-4a7d-8453-8bb9bf713222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:33.119441 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:33.206019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 942/1895] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:33.214992 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00603341-9d97-4559-ae24-e6a10c982734 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:33.217779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00603341-9d97-4559-ae24-e6a10c982734 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:33.218082 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00603341-9d97-4559-ae24-e6a10c982734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:33.242511 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-00603341-9d97-4559-ae24-e6a10c982734 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:33.243758 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-00603341-9d97-4559-ae24-e6a10c982734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:33.253807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 954/1896] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:33.258535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b751992-a1d2-4a7d-8453-8bb9bf713222 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:33.271697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b751992-a1d2-4a7d-8453-8bb9bf713222 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:33.279485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf903d8-0a8b-400b-a8e3-fa2ea840f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:33.280840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf903d8-0a8b-400b-a8e3-fa2ea840f659 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:33.281201 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf903d8-0a8b-400b-a8e3-fa2ea840f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:33.281590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf903d8-0a8b-400b-a8e3-fa2ea840f659 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:33.282487 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf903d8-0a8b-400b-a8e3-fa2ea840f659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:56:33.282959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf903d8-0a8b-400b-a8e3-fa2ea840f659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:33.284740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf903d8-0a8b-400b-a8e3-fa2ea840f659 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:33.306972 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 943/1897] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:56:33.311697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00603341-9d97-4559-ae24-e6a10c982734 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:33.329414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00603341-9d97-4559-ae24-e6a10c982734 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:33.348224 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3c1a8-58b0-41ee-9f26-44603b163fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:33.349281 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3c1a8-58b0-41ee-9f26-44603b163fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:33.350185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3c1a8-58b0-41ee-9f26-44603b163fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:33.350632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3c1a8-58b0-41ee-9f26-44603b163fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:33.351378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3c1a8-58b0-41ee-9f26-44603b163fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:33.354156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3c1a8-58b0-41ee-9f26-44603b163fc4 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:33.439743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 955/1898] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:33 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:33.445502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf903d8-0a8b-400b-a8e3-fa2ea840f659 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:33.459700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf903d8-0a8b-400b-a8e3-fa2ea840f659 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:33.553269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ac0ce-d02d-4f8d-8be7-4efd0ab3c147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:33.553980 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ac0ce-d02d-4f8d-8be7-4efd0ab3c147 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:33.554267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ac0ce-d02d-4f8d-8be7-4efd0ab3c147 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:33.556081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ac0ce-d02d-4f8d-8be7-4efd0ab3c147 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:33.556081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ac0ce-d02d-4f8d-8be7-4efd0ab3c147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:33.557541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ac0ce-d02d-4f8d-8be7-4efd0ab3c147 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:33.676544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 944/1899] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:33 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:33.681946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3c1a8-58b0-41ee-9f26-44603b163fc4 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:33.707742 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3c1a8-58b0-41ee-9f26-44603b163fc4 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:33.721093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5730920-255d-4ecb-93ab-aba21b122b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:33.721853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5730920-255d-4ecb-93ab-aba21b122b54 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:33.722213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5730920-255d-4ecb-93ab-aba21b122b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:33.723394 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5730920-255d-4ecb-93ab-aba21b122b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:33.724232 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5730920-255d-4ecb-93ab-aba21b122b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:33.725948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5730920-255d-4ecb-93ab-aba21b122b54 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:33.738534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 956/1900] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:33.742571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ac0ce-d02d-4f8d-8be7-4efd0ab3c147 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:33.753128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ac0ce-d02d-4f8d-8be7-4efd0ab3c147 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:33.757888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88c9ea-c70d-4857-acb2-bb3a755e3d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:33.758555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88c9ea-c70d-4857-acb2-bb3a755e3d12 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:33.758840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88c9ea-c70d-4857-acb2-bb3a755e3d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:33.759139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88c9ea-c70d-4857-acb2-bb3a755e3d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:33.759877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88c9ea-c70d-4857-acb2-bb3a755e3d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:33.761504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88c9ea-c70d-4857-acb2-bb3a755e3d12 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:33.776907 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 945/1901] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:33.777509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5730920-255d-4ecb-93ab-aba21b122b54 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:33.789057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5730920-255d-4ecb-93ab-aba21b122b54 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:33.795507 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d591a-b84b-48df-9080-01c119513d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:33.796676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d591a-b84b-48df-9080-01c119513d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:33.797260 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d591a-b84b-48df-9080-01c119513d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:33.798443 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d591a-b84b-48df-9080-01c119513d01 admin admin] PATH_INFO: `/v3/projects/8fbfa11528fc4a6f8846288771973cb0/users/7cbdd943123b4ac78620be75b9915bd2/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:33.833856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d591a-b84b-48df-9080-01c119513d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fbfa11528fc4a6f8846288771973cb0, user_id=7cbdd943123b4ac78620be75b9915bd2, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:33.837675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d591a-b84b-48df-9080-01c119513d01 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:33.941956 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 957/1902] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:33 2022] PUT /identity/v3/projects/8fbfa11528fc4a6f8846288771973cb0/users/7cbdd943123b4ac78620be75b9915bd2/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:33.952697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b2143-08a5-4d09-bbc5-1e9ba9f3f540 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:33.952982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b2143-08a5-4d09-bbc5-1e9ba9f3f540 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:33.953266 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b2143-08a5-4d09-bbc5-1e9ba9f3f540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:34.007557 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-074b2143-08a5-4d09-bbc5-1e9ba9f3f540 None None] MFA Rules not processed for user `7cbdd943123b4ac78620be75b9915bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:34.010738 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-074b2143-08a5-4d09-bbc5-1e9ba9f3f540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:34.138561 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 946/1903] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:34.236060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d591a-b84b-48df-9080-01c119513d01 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:34.237845 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-de1d591a-b84b-48df-9080-01c119513d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:34.355010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d591a-b84b-48df-9080-01c119513d01 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:34.365252 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5336ea8-d2e6-4491-a813-d75a2470a318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:34.365913 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5336ea8-d2e6-4491-a813-d75a2470a318 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:34.366203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5336ea8-d2e6-4491-a813-d75a2470a318 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:34.366486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5336ea8-d2e6-4491-a813-d75a2470a318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:34.377921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5336ea8-d2e6-4491-a813-d75a2470a318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:34.379404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5336ea8-d2e6-4491-a813-d75a2470a318 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:34.390183 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 958/1904] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:34.414610 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b2143-08a5-4d09-bbc5-1e9ba9f3f540 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:34.429397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:34.502506 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b2143-08a5-4d09-bbc5-1e9ba9f3f540 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:34.507067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a414dc-c0ea-4e59-86fb-7bc3b7e2b6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:34.507998 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a414dc-c0ea-4e59-86fb-7bc3b7e2b6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:34.508343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a414dc-c0ea-4e59-86fb-7bc3b7e2b6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:34.508734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a414dc-c0ea-4e59-86fb-7bc3b7e2b6d8 admin admin] PATH_INFO: `/v3/users/7cbdd943123b4ac78620be75b9915bd2` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:34.509985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a414dc-c0ea-4e59-86fb-7bc3b7e2b6d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cbdd943123b4ac78620be75b9915bd2)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:34.512259 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a414dc-c0ea-4e59-86fb-7bc3b7e2b6d8 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:34.740273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-80a414dc-c0ea-4e59-86fb-7bc3b7e2b6d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cbdd943123b4ac78620be75b9915bd2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:34.752205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-80a414dc-c0ea-4e59-86fb-7bc3b7e2b6d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cbdd943123b4ac78620be75b9915bd2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:34.863601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-80a414dc-c0ea-4e59-86fb-7bc3b7e2b6d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cbdd943123b4ac78620be75b9915bd2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:34.864442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-80a414dc-c0ea-4e59-86fb-7bc3b7e2b6d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cbdd943123b4ac78620be75b9915bd2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:34.876612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-80a414dc-c0ea-4e59-86fb-7bc3b7e2b6d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cbdd943123b4ac78620be75b9915bd2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:34.896990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 947/1905] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:34 2022] DELETE /identity/v3/users/7cbdd943123b4ac78620be75b9915bd2 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:34.901661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649de46-6cdf-4a09-a019-5d0b42b1a294 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:34.902182 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649de46-6cdf-4a09-a019-5d0b42b1a294 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:34.902516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649de46-6cdf-4a09-a019-5d0b42b1a294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:34.922867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-0649de46-6cdf-4a09-a019-5d0b42b1a294 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:34.924378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-0649de46-6cdf-4a09-a019-5d0b42b1a294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:34.990267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 959/1906] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:35.001000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a414dc-c0ea-4e59-86fb-7bc3b7e2b6d8 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:35.009778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-80a414dc-c0ea-4e59-86fb-7bc3b7e2b6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:35.071378 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a414dc-c0ea-4e59-86fb-7bc3b7e2b6d8 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:35.075888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c665f-76e9-4d63-b5ee-1979fbb33385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:35.077288 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c665f-76e9-4d63-b5ee-1979fbb33385 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:35.077556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c665f-76e9-4d63-b5ee-1979fbb33385 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:35.077837 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c665f-76e9-4d63-b5ee-1979fbb33385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:35.087598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c665f-76e9-4d63-b5ee-1979fbb33385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:35.089481 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c665f-76e9-4d63-b5ee-1979fbb33385 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:35.100090 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 948/1907] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:35.597419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649de46-6cdf-4a09-a019-5d0b42b1a294 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:35.600081 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-0649de46-6cdf-4a09-a019-5d0b42b1a294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:35.619070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649de46-6cdf-4a09-a019-5d0b42b1a294 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:35.628849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4f76f-62b6-4d1d-9344-f1997c15af4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:35.629733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4f76f-62b6-4d1d-9344-f1997c15af4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:35.630024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4f76f-62b6-4d1d-9344-f1997c15af4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:35.632022 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4f76f-62b6-4d1d-9344-f1997c15af4b admin admin] PATH_INFO: `/v3/projects/8fbfa11528fc4a6f8846288771973cb0` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:35.633472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4f76f-62b6-4d1d-9344-f1997c15af4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fbfa11528fc4a6f8846288771973cb0)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:35.636241 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4f76f-62b6-4d1d-9344-f1997c15af4b admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:35.640617 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:35.746991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b6e4f76f-62b6-4d1d-9344-f1997c15af4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fbfa11528fc4a6f8846288771973cb0', 'request_id': 'req-b6e4f76f-62b6-4d1d-9344-f1997c15af4b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:35.755592 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b6e4f76f-62b6-4d1d-9344-f1997c15af4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fbfa11528fc4a6f8846288771973cb0', 'request_id': 'req-b6e4f76f-62b6-4d1d-9344-f1997c15af4b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:35.822580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b6e4f76f-62b6-4d1d-9344-f1997c15af4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fbfa11528fc4a6f8846288771973cb0', 'request_id': 'req-b6e4f76f-62b6-4d1d-9344-f1997c15af4b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:35.835898 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b6e4f76f-62b6-4d1d-9344-f1997c15af4b admin admin] The token cache is being invalidate because project 8fbfa11528fc4a6f8846288771973cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:35.836285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b6e4f76f-62b6-4d1d-9344-f1997c15af4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:35.836968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b6e4f76f-62b6-4d1d-9344-f1997c15af4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:35.838513 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 960/1908] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:35 2022] DELETE /identity/v3/projects/8fbfa11528fc4a6f8846288771973cb0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:35.844053 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f541ff8-c0a0-4fec-88a4-64a0893d5242 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:35.844510 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f541ff8-c0a0-4fec-88a4-64a0893d5242 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:35.844635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f541ff8-c0a0-4fec-88a4-64a0893d5242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:35.862590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-8f541ff8-c0a0-4fec-88a4-64a0893d5242 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:35.863781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8f541ff8-c0a0-4fec-88a4-64a0893d5242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:35.889221 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:35.924933 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 949/1909] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:35.933959 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6388eee-d235-4292-aa03-90980552dc15 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:35.934417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6388eee-d235-4292-aa03-90980552dc15 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:35.934562 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6388eee-d235-4292-aa03-90980552dc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:35.954193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a6388eee-d235-4292-aa03-90980552dc15 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:35.955412 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a6388eee-d235-4292-aa03-90980552dc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:35.965217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 961/1910] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:35.970945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f541ff8-c0a0-4fec-88a4-64a0893d5242 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:35.984502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f541ff8-c0a0-4fec-88a4-64a0893d5242 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:35.989561 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a88ede-4bac-437b-bedb-39347d275d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:35.990260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a88ede-4bac-437b-bedb-39347d275d33 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:35.990543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a88ede-4bac-437b-bedb-39347d275d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:35.990818 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a88ede-4bac-437b-bedb-39347d275d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:35.991555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a88ede-4bac-437b-bedb-39347d275d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:56:35.991951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a88ede-4bac-437b-bedb-39347d275d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:35.994020 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a88ede-4bac-437b-bedb-39347d275d33 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:36.007923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 950/1911] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:56:36.014794 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6388eee-d235-4292-aa03-90980552dc15 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:36.024275 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6388eee-d235-4292-aa03-90980552dc15 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:36.028941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00227c98-46ba-4971-8d04-104ca25a44aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:36.030155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00227c98-46ba-4971-8d04-104ca25a44aa admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:36.030440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00227c98-46ba-4971-8d04-104ca25a44aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:36.030718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00227c98-46ba-4971-8d04-104ca25a44aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:36.031415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00227c98-46ba-4971-8d04-104ca25a44aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:36.033345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00227c98-46ba-4971-8d04-104ca25a44aa admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:36.151130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 962/1912] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:36 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:36.155303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a88ede-4bac-437b-bedb-39347d275d33 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:36.165493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a88ede-4bac-437b-bedb-39347d275d33 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:36.222285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b81a0-7b41-4200-9cf0-32c7072a6cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:36.223011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b81a0-7b41-4200-9cf0-32c7072a6cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:36.223291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b81a0-7b41-4200-9cf0-32c7072a6cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:36.223587 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b81a0-7b41-4200-9cf0-32c7072a6cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:36.224269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b81a0-7b41-4200-9cf0-32c7072a6cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:36.226297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b81a0-7b41-4200-9cf0-32c7072a6cd3 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:36.298066 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 951/1913] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:36 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:36.302629 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00227c98-46ba-4971-8d04-104ca25a44aa admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:36.313893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00227c98-46ba-4971-8d04-104ca25a44aa admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:36.318739 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d427d-e913-4fd0-afab-02f8b5d86a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:36.319388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d427d-e913-4fd0-afab-02f8b5d86a72 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:36.319666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d427d-e913-4fd0-afab-02f8b5d86a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:36.319939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d427d-e913-4fd0-afab-02f8b5d86a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:36.320893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d427d-e913-4fd0-afab-02f8b5d86a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:36.322470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d427d-e913-4fd0-afab-02f8b5d86a72 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:36.333149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 963/1914] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:36.337041 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b81a0-7b41-4200-9cf0-32c7072a6cd3 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:36.347551 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b81a0-7b41-4200-9cf0-32c7072a6cd3 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:36.352132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3300343-a1d2-46a9-acd8-7c8421d8cd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:36.352884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3300343-a1d2-46a9-acd8-7c8421d8cd9b admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:36.353170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3300343-a1d2-46a9-acd8-7c8421d8cd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:36.353445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3300343-a1d2-46a9-acd8-7c8421d8cd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:36.354164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3300343-a1d2-46a9-acd8-7c8421d8cd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:36.355724 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3300343-a1d2-46a9-acd8-7c8421d8cd9b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:36.366055 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 952/1915] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:36.369874 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d427d-e913-4fd0-afab-02f8b5d86a72 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:36.380505 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d427d-e913-4fd0-afab-02f8b5d86a72 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:36.385379 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a604623-a99b-489c-8c8a-6cad0a53aed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:36.386252 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a604623-a99b-489c-8c8a-6cad0a53aed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:36.386535 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a604623-a99b-489c-8c8a-6cad0a53aed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:36.386808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a604623-a99b-489c-8c8a-6cad0a53aed3 admin admin] PATH_INFO: `/v3/projects/88f69fa608db4724a066a8dde7efe38a/users/e7c4678d1aa9425db97adc6cce76e74f/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:36.401287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a604623-a99b-489c-8c8a-6cad0a53aed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f69fa608db4724a066a8dde7efe38a, user_id=e7c4678d1aa9425db97adc6cce76e74f, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:36.403935 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a604623-a99b-489c-8c8a-6cad0a53aed3 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:36.469989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 964/1916] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:36 2022] PUT /identity/v3/projects/88f69fa608db4724a066a8dde7efe38a/users/e7c4678d1aa9425db97adc6cce76e74f/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:36.475204 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445a58a-90ec-4918-9078-eba5f5590263 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:36.475489 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445a58a-90ec-4918-9078-eba5f5590263 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:36.475787 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445a58a-90ec-4918-9078-eba5f5590263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:36.493917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b445a58a-90ec-4918-9078-eba5f5590263 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:36.495096 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b445a58a-90ec-4918-9078-eba5f5590263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:36.559348 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 953/1917] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:36.569791 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a604623-a99b-489c-8c8a-6cad0a53aed3 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:36.571675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4a604623-a99b-489c-8c8a-6cad0a53aed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:36.636397 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a604623-a99b-489c-8c8a-6cad0a53aed3 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:36.641443 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd27996-ba16-4c68-9d8c-cf7869996826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:36.642250 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd27996-ba16-4c68-9d8c-cf7869996826 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:36.642611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd27996-ba16-4c68-9d8c-cf7869996826 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:36.642953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd27996-ba16-4c68-9d8c-cf7869996826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:36.655555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd27996-ba16-4c68-9d8c-cf7869996826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:36.657152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd27996-ba16-4c68-9d8c-cf7869996826 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:36.667896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 965/1918] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:37.975062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de276db-553c-4a37-876f-7181602a3d7d None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:37.975581 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de276db-553c-4a37-876f-7181602a3d7d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:37.975879 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de276db-553c-4a37-876f-7181602a3d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:38.004223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-4de276db-553c-4a37-876f-7181602a3d7d None None] MFA Rules not processed for user `e7c4678d1aa9425db97adc6cce76e74f`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:38.005727 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-4de276db-553c-4a37-876f-7181602a3d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:38.041670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:38.100633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 954/1919] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:38.108528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd27996-ba16-4c68-9d8c-cf7869996826 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:38.110624 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4dd27996-ba16-4c68-9d8c-cf7869996826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:38.157633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:38.179761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd27996-ba16-4c68-9d8c-cf7869996826 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:38.186362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e4857-ecd0-40a1-a355-c46b286b2ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:38.186362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e4857-ecd0-40a1-a355-c46b286b2ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:38.186362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e4857-ecd0-40a1-a355-c46b286b2ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:38.186362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e4857-ecd0-40a1-a355-c46b286b2ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:38.194719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e4857-ecd0-40a1-a355-c46b286b2ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:38.196192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e4857-ecd0-40a1-a355-c46b286b2ca4 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:38.206781 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 966/1920] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:41.364464 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de276db-553c-4a37-876f-7181602a3d7d None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:41.376818 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de276db-553c-4a37-876f-7181602a3d7d None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:41.381214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08dfc8-f402-413f-8548-3ac4206b0f49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:41.382198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08dfc8-f402-413f-8548-3ac4206b0f49 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:41.382619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08dfc8-f402-413f-8548-3ac4206b0f49 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:41.382900 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08dfc8-f402-413f-8548-3ac4206b0f49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:41.384912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2f08dfc8-f402-413f-8548-3ac4206b0f49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:41.468946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08dfc8-f402-413f-8548-3ac4206b0f49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:41.470400 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08dfc8-f402-413f-8548-3ac4206b0f49 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:41.480309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 955/1921] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:42.086432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32358ac-c41f-4e3d-9d00-cd28ef327476 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:42.086991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32358ac-c41f-4e3d-9d00-cd28ef327476 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:42.086991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32358ac-c41f-4e3d-9d00-cd28ef327476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:42.106813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a32358ac-c41f-4e3d-9d00-cd28ef327476 None None] MFA Rules not processed for user `e7c4678d1aa9425db97adc6cce76e74f`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:42.108064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a32358ac-c41f-4e3d-9d00-cd28ef327476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:42.115131 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 967/1922] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:45.419202 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462d588-a66d-447e-a4b7-95d35ce4d6f6 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:45.424463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462d588-a66d-447e-a4b7-95d35ce4d6f6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:45.425275 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462d588-a66d-447e-a4b7-95d35ce4d6f6 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:45.429282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 956/1923] 10.222.0.44 () {54 vars in 921 bytes} [Mon Jun 27 14:56:45 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 14:56:45.445236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c169a3-3ec0-4435-8f57-8f8ccf657e2a None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:45.446122 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c169a3-3ec0-4435-8f57-8f8ccf657e2a None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:45.446575 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c169a3-3ec0-4435-8f57-8f8ccf657e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:45.475371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d9c169a3-3ec0-4435-8f57-8f8ccf657e2a None None] MFA Rules not processed for user `08529776af224c36ab560c13f5941e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:45.480266 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d9c169a3-3ec0-4435-8f57-8f8ccf657e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:45.596395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 968/1924] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Jun 27 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:45.614188 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462d588-a66d-447e-a4b7-95d35ce4d6f6 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:45.616189 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-e462d588-a66d-447e-a4b7-95d35ce4d6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:45.635614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462d588-a66d-447e-a4b7-95d35ce4d6f6 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:45.642025 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6c8db-99cc-4d89-9e5f-219201478f0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:45.642784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c8db-99cc-4d89-9e5f-219201478f0f service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:45.643100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c8db-99cc-4d89-9e5f-219201478f0f service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:45.643383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c8db-99cc-4d89-9e5f-219201478f0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:45.652999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6c8db-99cc-4d89-9e5f-219201478f0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:45.654591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6c8db-99cc-4d89-9e5f-219201478f0f service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:45.665176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 957/1925] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:45.736086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c169a3-3ec0-4435-8f57-8f8ccf657e2a None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:45.737734 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d9c169a3-3ec0-4435-8f57-8f8ccf657e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:45.751796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c169a3-3ec0-4435-8f57-8f8ccf657e2a None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:45.756278 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7ab35-e666-4f9c-bd11-a373b8270fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:45.757175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7ab35-e666-4f9c-bd11-a373b8270fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:45.757457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7ab35-e666-4f9c-bd11-a373b8270fed admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:45.757928 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7ab35-e666-4f9c-bd11-a373b8270fed admin admin] PATH_INFO: `/v3/users/d41430b026454b62a0761971c006d870` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:45.759219 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7ab35-e666-4f9c-bd11-a373b8270fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41430b026454b62a0761971c006d870)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:45.761265 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7ab35-e666-4f9c-bd11-a373b8270fed admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:45.983162 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d0c7ab35-e666-4f9c-bd11-a373b8270fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41430b026454b62a0761971c006d870'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:46.008304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d0c7ab35-e666-4f9c-bd11-a373b8270fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41430b026454b62a0761971c006d870'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:46.075793 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d0c7ab35-e666-4f9c-bd11-a373b8270fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41430b026454b62a0761971c006d870'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:46.076783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d0c7ab35-e666-4f9c-bd11-a373b8270fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41430b026454b62a0761971c006d870'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:46.091618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d0c7ab35-e666-4f9c-bd11-a373b8270fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41430b026454b62a0761971c006d870'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:46.109561 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 969/1926] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:45 2022] DELETE /identity/v3/users/d41430b026454b62a0761971c006d870 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:46.114307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacb4fc-0117-474a-9a07-9e2d1fe80870 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:46.114652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacb4fc-0117-474a-9a07-9e2d1fe80870 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:46.114938 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacb4fc-0117-474a-9a07-9e2d1fe80870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:46.144358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-2bacb4fc-0117-474a-9a07-9e2d1fe80870 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:46.145658 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2bacb4fc-0117-474a-9a07-9e2d1fe80870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:46.219440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 958/1927] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:46.229288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7ab35-e666-4f9c-bd11-a373b8270fed admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:46.230834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d0c7ab35-e666-4f9c-bd11-a373b8270fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:46.280137 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:46.302570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7ab35-e666-4f9c-bd11-a373b8270fed admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:46.306296 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023926bd-1bc2-4576-8f65-f5d9d760dd5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:46.306937 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023926bd-1bc2-4576-8f65-f5d9d760dd5e service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:46.307222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023926bd-1bc2-4576-8f65-f5d9d760dd5e service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:46.307501 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023926bd-1bc2-4576-8f65-f5d9d760dd5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:46.317594 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023926bd-1bc2-4576-8f65-f5d9d760dd5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:46.319200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023926bd-1bc2-4576-8f65-f5d9d760dd5e service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:46.329323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 970/1928] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:46.752653 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacb4fc-0117-474a-9a07-9e2d1fe80870 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:46.754355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2bacb4fc-0117-474a-9a07-9e2d1fe80870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:46.767406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacb4fc-0117-474a-9a07-9e2d1fe80870 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:46.775497 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752a554-03d9-40e5-8d04-38ede0f59cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:46.776435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752a554-03d9-40e5-8d04-38ede0f59cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:46.776817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752a554-03d9-40e5-8d04-38ede0f59cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:46.777241 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752a554-03d9-40e5-8d04-38ede0f59cdf admin admin] PATH_INFO: `/v3/projects/0cd6cd7219c44cc08060d5a80ed874a0` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:46.779955 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752a554-03d9-40e5-8d04-38ede0f59cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd6cd7219c44cc08060d5a80ed874a0)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:46.782408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752a554-03d9-40e5-8d04-38ede0f59cdf admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:46.890648 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:46.894131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-7752a554-03d9-40e5-8d04-38ede0f59cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd6cd7219c44cc08060d5a80ed874a0', 'request_id': 'req-7752a554-03d9-40e5-8d04-38ede0f59cdf'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:46.983948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-7752a554-03d9-40e5-8d04-38ede0f59cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd6cd7219c44cc08060d5a80ed874a0', 'request_id': 'req-7752a554-03d9-40e5-8d04-38ede0f59cdf'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:46.991079 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-7752a554-03d9-40e5-8d04-38ede0f59cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd6cd7219c44cc08060d5a80ed874a0', 'request_id': 'req-7752a554-03d9-40e5-8d04-38ede0f59cdf'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:47.002083 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-7752a554-03d9-40e5-8d04-38ede0f59cdf admin admin] The token cache is being invalidate because project 0cd6cd7219c44cc08060d5a80ed874a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:47.002502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-7752a554-03d9-40e5-8d04-38ede0f59cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:47.003194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-7752a554-03d9-40e5-8d04-38ede0f59cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:47.004812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 959/1929] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:46 2022] DELETE /identity/v3/projects/0cd6cd7219c44cc08060d5a80ed874a0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:47.008887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023926bd-1bc2-4576-8f65-f5d9d760dd5e service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:47.019439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023926bd-1bc2-4576-8f65-f5d9d760dd5e service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:47.077548 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574b187-db6e-4539-b41a-1f8765cce004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:47.078430 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574b187-db6e-4539-b41a-1f8765cce004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:47.078716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574b187-db6e-4539-b41a-1f8765cce004 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:47.078993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574b187-db6e-4539-b41a-1f8765cce004 admin admin] PATH_INFO: `/v3/users/058efe3d813740b1a6aeb79affc7f399` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:47.080250 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574b187-db6e-4539-b41a-1f8765cce004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=058efe3d813740b1a6aeb79affc7f399)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:47.082237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574b187-db6e-4539-b41a-1f8765cce004 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:47.308433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-8574b187-db6e-4539-b41a-1f8765cce004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '058efe3d813740b1a6aeb79affc7f399'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:47.325753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-8574b187-db6e-4539-b41a-1f8765cce004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '058efe3d813740b1a6aeb79affc7f399'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:47.433504 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-8574b187-db6e-4539-b41a-1f8765cce004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '058efe3d813740b1a6aeb79affc7f399'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:47.443271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-8574b187-db6e-4539-b41a-1f8765cce004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '058efe3d813740b1a6aeb79affc7f399'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:47.443271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-8574b187-db6e-4539-b41a-1f8765cce004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '058efe3d813740b1a6aeb79affc7f399'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:47.448707 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 971/1930] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:47 2022] DELETE /identity/v3/users/058efe3d813740b1a6aeb79affc7f399 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:47.860258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752a554-03d9-40e5-8d04-38ede0f59cdf admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:47.861964 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7752a554-03d9-40e5-8d04-38ede0f59cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:47.878947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752a554-03d9-40e5-8d04-38ede0f59cdf admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:47.947546 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06961613-fce0-4c84-a58f-5d888b4138ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:47.948408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06961613-fce0-4c84-a58f-5d888b4138ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:47.948717 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06961613-fce0-4c84-a58f-5d888b4138ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:47.948995 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06961613-fce0-4c84-a58f-5d888b4138ff admin admin] PATH_INFO: `/v3/projects/49e9fc1b76274fa79e19bc3220fd9cbd` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:47.950180 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06961613-fce0-4c84-a58f-5d888b4138ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e9fc1b76274fa79e19bc3220fd9cbd)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:47.955075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06961613-fce0-4c84-a58f-5d888b4138ff admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:48.069727 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-06961613-fce0-4c84-a58f-5d888b4138ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e9fc1b76274fa79e19bc3220fd9cbd', 'request_id': 'req-06961613-fce0-4c84-a58f-5d888b4138ff'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:48.137926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-06961613-fce0-4c84-a58f-5d888b4138ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e9fc1b76274fa79e19bc3220fd9cbd', 'request_id': 'req-06961613-fce0-4c84-a58f-5d888b4138ff'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:48.145325 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-06961613-fce0-4c84-a58f-5d888b4138ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e9fc1b76274fa79e19bc3220fd9cbd', 'request_id': 'req-06961613-fce0-4c84-a58f-5d888b4138ff'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:48.156077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-06961613-fce0-4c84-a58f-5d888b4138ff admin admin] The token cache is being invalidate because project 49e9fc1b76274fa79e19bc3220fd9cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:48.156356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-06961613-fce0-4c84-a58f-5d888b4138ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:48.156997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-06961613-fce0-4c84-a58f-5d888b4138ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:48.158515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 960/1931] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:47 2022] DELETE /identity/v3/projects/49e9fc1b76274fa79e19bc3220fd9cbd => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:48.163472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08f419-aba8-41d7-8d4a-22146d837241 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:48.163945 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08f419-aba8-41d7-8d4a-22146d837241 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:48.164030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08f419-aba8-41d7-8d4a-22146d837241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:48.182580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-6d08f419-aba8-41d7-8d4a-22146d837241 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:48.183809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-6d08f419-aba8-41d7-8d4a-22146d837241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:48.230566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:48.242380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 972/1932] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:48.250431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c319717-2776-417a-a225-4787132da48e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:48.250755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c319717-2776-417a-a225-4787132da48e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:48.251039 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c319717-2776-417a-a225-4787132da48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:48.270044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-0c319717-2776-417a-a225-4787132da48e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:48.271493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0c319717-2776-417a-a225-4787132da48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:48.281577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 961/1933] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:48.285512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08f419-aba8-41d7-8d4a-22146d837241 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:48.295770 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08f419-aba8-41d7-8d4a-22146d837241 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:48.300412 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8aaa9-6601-4c4f-ad5f-2434c1cd0be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:48.301095 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8aaa9-6601-4c4f-ad5f-2434c1cd0be9 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:48.301376 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8aaa9-6601-4c4f-ad5f-2434c1cd0be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:48.305631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8aaa9-6601-4c4f-ad5f-2434c1cd0be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:48.305631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8aaa9-6601-4c4f-ad5f-2434c1cd0be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:56:48.305631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8aaa9-6601-4c4f-ad5f-2434c1cd0be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:48.305631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8aaa9-6601-4c4f-ad5f-2434c1cd0be9 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:48.316347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 973/1934] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:56:48.320635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c319717-2776-417a-a225-4787132da48e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:48.330845 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c319717-2776-417a-a225-4787132da48e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:48.335454 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b48b6b-13e1-47bb-b092-4e2e25bb4b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:48.336098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b48b6b-13e1-47bb-b092-4e2e25bb4b7d admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:48.336377 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b48b6b-13e1-47bb-b092-4e2e25bb4b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:48.336741 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b48b6b-13e1-47bb-b092-4e2e25bb4b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:48.337551 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b48b6b-13e1-47bb-b092-4e2e25bb4b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:48.339425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b48b6b-13e1-47bb-b092-4e2e25bb4b7d admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:48.425786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 962/1935] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:48 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:48.431903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8aaa9-6601-4c4f-ad5f-2434c1cd0be9 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:48.442885 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8aaa9-6601-4c4f-ad5f-2434c1cd0be9 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:48.504276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42006eb1-6081-4ed3-a181-d33116dcf0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:48.504896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42006eb1-6081-4ed3-a181-d33116dcf0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:48.505181 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42006eb1-6081-4ed3-a181-d33116dcf0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:48.505457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42006eb1-6081-4ed3-a181-d33116dcf0c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:48.506151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42006eb1-6081-4ed3-a181-d33116dcf0c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:48.508129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42006eb1-6081-4ed3-a181-d33116dcf0c1 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:48.598543 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 974/1936] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:48 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:48.604387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b48b6b-13e1-47bb-b092-4e2e25bb4b7d admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:48.614597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b48b6b-13e1-47bb-b092-4e2e25bb4b7d admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:48.619262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398a780-a7b4-4c4f-8264-987f1224dc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:48.619917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a780-a7b4-4c4f-8264-987f1224dc3b admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:48.620323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a780-a7b4-4c4f-8264-987f1224dc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:48.620606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a780-a7b4-4c4f-8264-987f1224dc3b admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:48.621373 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398a780-a7b4-4c4f-8264-987f1224dc3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:48.623580 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398a780-a7b4-4c4f-8264-987f1224dc3b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:48.634552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 963/1937] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:56:48.639218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42006eb1-6081-4ed3-a181-d33116dcf0c1 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:48.649464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42006eb1-6081-4ed3-a181-d33116dcf0c1 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:48.654359 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e68639-7dbe-4d2b-a5c1-ebc753cb933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:48.655027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e68639-7dbe-4d2b-a5c1-ebc753cb933a admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:48.655306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e68639-7dbe-4d2b-a5c1-ebc753cb933a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:48.655582 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e68639-7dbe-4d2b-a5c1-ebc753cb933a admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:48.656342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e68639-7dbe-4d2b-a5c1-ebc753cb933a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:48.657970 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e68639-7dbe-4d2b-a5c1-ebc753cb933a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:48.667988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 975/1938] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:48.672052 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398a780-a7b4-4c4f-8264-987f1224dc3b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:48.681839 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398a780-a7b4-4c4f-8264-987f1224dc3b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:48.686887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9088a3-d50f-4bce-adc5-c950a46ca672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:48.687754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9088a3-d50f-4bce-adc5-c950a46ca672 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:48.688036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9088a3-d50f-4bce-adc5-c950a46ca672 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:48.688310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9088a3-d50f-4bce-adc5-c950a46ca672 admin admin] PATH_INFO: `/v3/projects/1b9403f2d8d643138319d6bc8acbc719/users/e39857b799254b9789e9a7b68650b78b/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:48.703442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9088a3-d50f-4bce-adc5-c950a46ca672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9403f2d8d643138319d6bc8acbc719, user_id=e39857b799254b9789e9a7b68650b78b, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:48.706113 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9088a3-d50f-4bce-adc5-c950a46ca672 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:48.784243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:48.789491 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 964/1939] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:48 2022] PUT /identity/v3/projects/1b9403f2d8d643138319d6bc8acbc719/users/e39857b799254b9789e9a7b68650b78b/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:48.801056 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2017b5-c134-42b3-96e0-6042643797ee None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:48.801351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2017b5-c134-42b3-96e0-6042643797ee None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:48.801634 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2017b5-c134-42b3-96e0-6042643797ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:48.829163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-af2017b5-c134-42b3-96e0-6042643797ee None None] MFA Rules not processed for user `e39857b799254b9789e9a7b68650b78b`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:48.830370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-af2017b5-c134-42b3-96e0-6042643797ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:48.896485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 976/1940] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:48.901210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9088a3-d50f-4bce-adc5-c950a46ca672 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:48.970063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9088a3-d50f-4bce-adc5-c950a46ca672 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:48.974869 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada27476-26bd-4e4f-b468-efba036925d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:48.975525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada27476-26bd-4e4f-b468-efba036925d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:48.975805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada27476-26bd-4e4f-b468-efba036925d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:48.976084 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada27476-26bd-4e4f-b468-efba036925d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:48.976816 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada27476-26bd-4e4f-b468-efba036925d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:48.978972 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada27476-26bd-4e4f-b468-efba036925d4 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:49.071188 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 965/1941] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:48 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:56:49.075673 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2017b5-c134-42b3-96e0-6042643797ee None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:49.086801 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2017b5-c134-42b3-96e0-6042643797ee None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:49.135057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:49.147095 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d59d3-8f8a-4a34-bbee-417ae4b553d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:49.147805 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d59d3-8f8a-4a34-bbee-417ae4b553d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:49.148172 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d59d3-8f8a-4a34-bbee-417ae4b553d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:49.148453 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d59d3-8f8a-4a34-bbee-417ae4b553d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:49.149193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d59d3-8f8a-4a34-bbee-417ae4b553d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:49.151110 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d59d3-8f8a-4a34-bbee-417ae4b553d1 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:49.239998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 977/1942] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:49 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:49.243895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada27476-26bd-4e4f-b468-efba036925d4 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:49.254369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada27476-26bd-4e4f-b468-efba036925d4 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:49.258901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03daa5c-13c6-46bb-b4e6-d391fe66f22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:49.259661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03daa5c-13c6-46bb-b4e6-d391fe66f22f admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:49.259938 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03daa5c-13c6-46bb-b4e6-d391fe66f22f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:49.260212 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03daa5c-13c6-46bb-b4e6-d391fe66f22f admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:49.260973 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03daa5c-13c6-46bb-b4e6-d391fe66f22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:49.262544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03daa5c-13c6-46bb-b4e6-d391fe66f22f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:49.272906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 966/1943] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:49.276733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d59d3-8f8a-4a34-bbee-417ae4b553d1 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:49.287416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d59d3-8f8a-4a34-bbee-417ae4b553d1 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:49.291942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcd191-9037-4561-8556-cd73526b1278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:49.292589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcd191-9037-4561-8556-cd73526b1278 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:49.292904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcd191-9037-4561-8556-cd73526b1278 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:49.293177 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcd191-9037-4561-8556-cd73526b1278 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:49.293897 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcd191-9037-4561-8556-cd73526b1278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:49.296205 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcd191-9037-4561-8556-cd73526b1278 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:49.305865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 978/1944] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:49.309786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03daa5c-13c6-46bb-b4e6-d391fe66f22f admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:49.320339 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03daa5c-13c6-46bb-b4e6-d391fe66f22f admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:49.324957 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481f56c-230c-4834-9350-ec21837a8f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:49.325822 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481f56c-230c-4834-9350-ec21837a8f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:49.326120 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481f56c-230c-4834-9350-ec21837a8f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:49.326637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481f56c-230c-4834-9350-ec21837a8f47 admin admin] PATH_INFO: `/v3/projects/91c74c9b879c4498b1479dbe4376f013/users/f68dc82530d941f1aedaf14043cb9c65/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:49.341061 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481f56c-230c-4834-9350-ec21837a8f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c74c9b879c4498b1479dbe4376f013, user_id=f68dc82530d941f1aedaf14043cb9c65, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:49.344312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481f56c-230c-4834-9350-ec21837a8f47 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:49.446012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 967/1945] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:49 2022] PUT /identity/v3/projects/91c74c9b879c4498b1479dbe4376f013/users/f68dc82530d941f1aedaf14043cb9c65/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:49.456991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fb98d-4aee-4e0b-a6fe-3cd0f34a9ae4 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:49.457287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fb98d-4aee-4e0b-a6fe-3cd0f34a9ae4 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:49.457760 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fb98d-4aee-4e0b-a6fe-3cd0f34a9ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:49.486600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-e04fb98d-4aee-4e0b-a6fe-3cd0f34a9ae4 None None] MFA Rules not processed for user `f68dc82530d941f1aedaf14043cb9c65`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:49.487794 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e04fb98d-4aee-4e0b-a6fe-3cd0f34a9ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:49.553306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 979/1946] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:49.557945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481f56c-230c-4834-9350-ec21837a8f47 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:49.624464 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481f56c-230c-4834-9350-ec21837a8f47 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:49.629398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab5fcb-851d-4a5f-bfec-f6a6e8c4fd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:49.630042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab5fcb-851d-4a5f-bfec-f6a6e8c4fd34 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:49.630387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab5fcb-851d-4a5f-bfec-f6a6e8c4fd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:49.630597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab5fcb-851d-4a5f-bfec-f6a6e8c4fd34 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:49.631387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab5fcb-851d-4a5f-bfec-f6a6e8c4fd34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:49.633490 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab5fcb-851d-4a5f-bfec-f6a6e8c4fd34 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:49.752865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 968/1947] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:49 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:49.754052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fb98d-4aee-4e0b-a6fe-3cd0f34a9ae4 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:49.765007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fb98d-4aee-4e0b-a6fe-3cd0f34a9ae4 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:49.824562 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d081f0f-a788-48c9-a26c-0639e6962427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:49.825198 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d081f0f-a788-48c9-a26c-0639e6962427 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:49.825485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d081f0f-a788-48c9-a26c-0639e6962427 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:49.825761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d081f0f-a788-48c9-a26c-0639e6962427 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:49.826515 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d081f0f-a788-48c9-a26c-0639e6962427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:49.828431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d081f0f-a788-48c9-a26c-0639e6962427 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:49.930138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 980/1948] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:49 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:56:49.934316 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab5fcb-851d-4a5f-bfec-f6a6e8c4fd34 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:49.945314 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab5fcb-851d-4a5f-bfec-f6a6e8c4fd34 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:49.949958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3925e8-c68b-4a6f-b936-45df1d0b0810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:49.950611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3925e8-c68b-4a6f-b936-45df1d0b0810 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:49.950895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3925e8-c68b-4a6f-b936-45df1d0b0810 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:49.951182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3925e8-c68b-4a6f-b936-45df1d0b0810 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:49.952009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3925e8-c68b-4a6f-b936-45df1d0b0810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:49.953631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3925e8-c68b-4a6f-b936-45df1d0b0810 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:49.964040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 969/1949] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:49.968832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d081f0f-a788-48c9-a26c-0639e6962427 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:49.978543 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d081f0f-a788-48c9-a26c-0639e6962427 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:49.983761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c0927-4adc-4bb2-a6d3-fda83370d8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:49.984627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c0927-4adc-4bb2-a6d3-fda83370d8b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:49.984941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c0927-4adc-4bb2-a6d3-fda83370d8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:49.985216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c0927-4adc-4bb2-a6d3-fda83370d8b6 admin admin] PATH_INFO: `/v3/projects/197dcb487cb5470b8fe76435a1d4d238/users/44fb4e49b6024ac0be04af97585a7ba8/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:49.999602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c0927-4adc-4bb2-a6d3-fda83370d8b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197dcb487cb5470b8fe76435a1d4d238, user_id=44fb4e49b6024ac0be04af97585a7ba8, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:50.002265 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c0927-4adc-4bb2-a6d3-fda83370d8b6 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:50.077406 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 981/1950] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:49 2022] PUT /identity/v3/projects/197dcb487cb5470b8fe76435a1d4d238/users/44fb4e49b6024ac0be04af97585a7ba8/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:50.081932 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3925e8-c68b-4a6f-b936-45df1d0b0810 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:50.101015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3925e8-c68b-4a6f-b936-45df1d0b0810 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:50.122170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:50.162311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d1c52-0b31-4291-bba6-3669588c8d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:50.163032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d1c52-0b31-4291-bba6-3669588c8d9f admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:50.163317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d1c52-0b31-4291-bba6-3669588c8d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:50.163591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d1c52-0b31-4291-bba6-3669588c8d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:50.164314 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d1c52-0b31-4291-bba6-3669588c8d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:50.166128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d1c52-0b31-4291-bba6-3669588c8d9f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:50.177353 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 970/1951] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:50.181622 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c0927-4adc-4bb2-a6d3-fda83370d8b6 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:50.192841 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c0927-4adc-4bb2-a6d3-fda83370d8b6 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:50.197417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dbff6-6360-40c4-9dba-fdaee2d2d4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:50.198293 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dbff6-6360-40c4-9dba-fdaee2d2d4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:50.198566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dbff6-6360-40c4-9dba-fdaee2d2d4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:50.198838 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dbff6-6360-40c4-9dba-fdaee2d2d4b9 admin admin] PATH_INFO: `/v3/projects/197dcb487cb5470b8fe76435a1d4d238/users/44fb4e49b6024ac0be04af97585a7ba8/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:50.200828 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dbff6-6360-40c4-9dba-fdaee2d2d4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197dcb487cb5470b8fe76435a1d4d238, user_id=44fb4e49b6024ac0be04af97585a7ba8, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:50.203615 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dbff6-6360-40c4-9dba-fdaee2d2d4b9 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:50.224666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 982/1952] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:50 2022] PUT /identity/v3/projects/197dcb487cb5470b8fe76435a1d4d238/users/44fb4e49b6024ac0be04af97585a7ba8/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:50.227855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739076a-62f8-4e9c-b051-b260498eb6b9 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:50.228144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739076a-62f8-4e9c-b051-b260498eb6b9 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:50.228537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739076a-62f8-4e9c-b051-b260498eb6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:50.255670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-0739076a-62f8-4e9c-b051-b260498eb6b9 None None] MFA Rules not processed for user `44fb4e49b6024ac0be04af97585a7ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:50.257147 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0739076a-62f8-4e9c-b051-b260498eb6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:50.326869 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 971/1953] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:50.337903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dbff6-6360-40c4-9dba-fdaee2d2d4b9 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:50.339687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-395dbff6-6360-40c4-9dba-fdaee2d2d4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:50.351617 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:50.399755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dbff6-6360-40c4-9dba-fdaee2d2d4b9 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:50.403492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728fcd0-ffd8-4616-b069-f8106ee3be52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:50.404795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728fcd0-ffd8-4616-b069-f8106ee3be52 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:50.405090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728fcd0-ffd8-4616-b069-f8106ee3be52 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:50.405368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728fcd0-ffd8-4616-b069-f8106ee3be52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:50.414556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728fcd0-ffd8-4616-b069-f8106ee3be52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:50.415973 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728fcd0-ffd8-4616-b069-f8106ee3be52 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:50.426910 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 983/1954] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:50.550121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739076a-62f8-4e9c-b051-b260498eb6b9 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:50.551472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0739076a-62f8-4e9c-b051-b260498eb6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:50.563051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739076a-62f8-4e9c-b051-b260498eb6b9 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:50.566829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdddf3-5337-491c-b794-a941e709b8b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:50.567457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdddf3-5337-491c-b794-a941e709b8b2 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:50.567741 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdddf3-5337-491c-b794-a941e709b8b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:50.568010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdddf3-5337-491c-b794-a941e709b8b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:50.626516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdddf3-5337-491c-b794-a941e709b8b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:50.628013 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdddf3-5337-491c-b794-a941e709b8b2 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:50.637009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 972/1955] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:51.754433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728fcd0-ffd8-4616-b069-f8106ee3be52 service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:51.755824 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-8728fcd0-ffd8-4616-b069-f8106ee3be52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:51.824248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728fcd0-ffd8-4616-b069-f8106ee3be52 service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:51.829314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb55dd7-4a5c-4d1d-9c05-016f3d116cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:51.830200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb55dd7-4a5c-4d1d-9c05-016f3d116cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:51.830484 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb55dd7-4a5c-4d1d-9c05-016f3d116cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:51.830759 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb55dd7-4a5c-4d1d-9c05-016f3d116cc9 admin admin] PATH_INFO: `/v3/users/51394b16db014b86b1eecae0be74ad4d` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:51.832033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb55dd7-4a5c-4d1d-9c05-016f3d116cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51394b16db014b86b1eecae0be74ad4d)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:51.834009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb55dd7-4a5c-4d1d-9c05-016f3d116cc9 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:52.050248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1bb55dd7-4a5c-4d1d-9c05-016f3d116cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51394b16db014b86b1eecae0be74ad4d'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:52.063903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1bb55dd7-4a5c-4d1d-9c05-016f3d116cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51394b16db014b86b1eecae0be74ad4d'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:52.141926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1bb55dd7-4a5c-4d1d-9c05-016f3d116cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51394b16db014b86b1eecae0be74ad4d'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:52.142574 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1bb55dd7-4a5c-4d1d-9c05-016f3d116cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51394b16db014b86b1eecae0be74ad4d'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:52.150190 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1bb55dd7-4a5c-4d1d-9c05-016f3d116cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51394b16db014b86b1eecae0be74ad4d'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:52.156981 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 984/1956] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:51 2022] DELETE /identity/v3/users/51394b16db014b86b1eecae0be74ad4d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:52.164335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d37755-9e6e-442b-9aaa-fe55871c75d4 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:52.164754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d37755-9e6e-442b-9aaa-fe55871c75d4 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:52.165016 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d37755-9e6e-442b-9aaa-fe55871c75d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:52.182606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-87d37755-9e6e-442b-9aaa-fe55871c75d4 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:52.183796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-87d37755-9e6e-442b-9aaa-fe55871c75d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:52.222047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:52.243340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 973/1957] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:56:52.253038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb55dd7-4a5c-4d1d-9c05-016f3d116cc9 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:52.254442 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1bb55dd7-4a5c-4d1d-9c05-016f3d116cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:52.290206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:52.313798 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb55dd7-4a5c-4d1d-9c05-016f3d116cc9 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:52.317683 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29a9fd-5a90-4d8e-9215-c8809571d868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:52.318327 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29a9fd-5a90-4d8e-9215-c8809571d868 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:52.318611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29a9fd-5a90-4d8e-9215-c8809571d868 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:52.318888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29a9fd-5a90-4d8e-9215-c8809571d868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:52.328129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29a9fd-5a90-4d8e-9215-c8809571d868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:52.329579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29a9fd-5a90-4d8e-9215-c8809571d868 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:52.339611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 985/1958] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:56:52.840728 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d37755-9e6e-442b-9aaa-fe55871c75d4 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:52.842727 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-87d37755-9e6e-442b-9aaa-fe55871c75d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:52.855801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d37755-9e6e-442b-9aaa-fe55871c75d4 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:52.860861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4951a8-6fcf-44d0-a47d-611b6c768d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:52.861718 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4951a8-6fcf-44d0-a47d-611b6c768d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:52.862049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4951a8-6fcf-44d0-a47d-611b6c768d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:52.862315 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4951a8-6fcf-44d0-a47d-611b6c768d49 admin admin] PATH_INFO: `/v3/projects/7494a11f3a76497bb52ab02c2c7139ce` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:52.863559 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4951a8-6fcf-44d0-a47d-611b6c768d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7494a11f3a76497bb52ab02c2c7139ce)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:52.865413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4951a8-6fcf-44d0-a47d-611b6c768d49 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:52.951489 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3d4951a8-6fcf-44d0-a47d-611b6c768d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7494a11f3a76497bb52ab02c2c7139ce', 'request_id': 'req-3d4951a8-6fcf-44d0-a47d-611b6c768d49'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:53.012247 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3d4951a8-6fcf-44d0-a47d-611b6c768d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7494a11f3a76497bb52ab02c2c7139ce', 'request_id': 'req-3d4951a8-6fcf-44d0-a47d-611b6c768d49'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:53.022933 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3d4951a8-6fcf-44d0-a47d-611b6c768d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7494a11f3a76497bb52ab02c2c7139ce', 'request_id': 'req-3d4951a8-6fcf-44d0-a47d-611b6c768d49'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:53.031923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3d4951a8-6fcf-44d0-a47d-611b6c768d49 admin admin] The token cache is being invalidate because project 7494a11f3a76497bb52ab02c2c7139ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:53.032211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3d4951a8-6fcf-44d0-a47d-611b6c768d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:53.032888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3d4951a8-6fcf-44d0-a47d-611b6c768d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:53.034495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 974/1959] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:52 2022] DELETE /identity/v3/projects/7494a11f3a76497bb52ab02c2c7139ce => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:56:53.038521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29a9fd-5a90-4d8e-9215-c8809571d868 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:53.048761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29a9fd-5a90-4d8e-9215-c8809571d868 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:53.109602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478ed31-581b-43d1-af97-205fde76c3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:53.115474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478ed31-581b-43d1-af97-205fde76c3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:53.115474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478ed31-581b-43d1-af97-205fde76c3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:53.115474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478ed31-581b-43d1-af97-205fde76c3fc admin admin] PATH_INFO: `/v3/users/0b988739f1bd4c9098bd6272df433308` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:53.115474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478ed31-581b-43d1-af97-205fde76c3fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b988739f1bd4c9098bd6272df433308)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:53.115474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478ed31-581b-43d1-af97-205fde76c3fc admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:53.362823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6478ed31-581b-43d1-af97-205fde76c3fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b988739f1bd4c9098bd6272df433308'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:53.376600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6478ed31-581b-43d1-af97-205fde76c3fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b988739f1bd4c9098bd6272df433308'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:53.450719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6478ed31-581b-43d1-af97-205fde76c3fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b988739f1bd4c9098bd6272df433308'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:53.451821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6478ed31-581b-43d1-af97-205fde76c3fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b988739f1bd4c9098bd6272df433308'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:53.459278 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6478ed31-581b-43d1-af97-205fde76c3fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b988739f1bd4c9098bd6272df433308'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:53.465472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 986/1960] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:56:53 2022] DELETE /identity/v3/users/0b988739f1bd4c9098bd6272df433308 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:56:53.878609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4951a8-6fcf-44d0-a47d-611b6c768d49 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:53.880178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-3d4951a8-6fcf-44d0-a47d-611b6c768d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:53.895229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4951a8-6fcf-44d0-a47d-611b6c768d49 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:53.960293 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cba164-b96a-4e18-909f-1f4ed1072c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:53.961424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cba164-b96a-4e18-909f-1f4ed1072c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:53.961708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cba164-b96a-4e18-909f-1f4ed1072c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:53.961985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cba164-b96a-4e18-909f-1f4ed1072c99 admin admin] PATH_INFO: `/v3/projects/5f346582e9714786a8276af7062569f9` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:53.963312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cba164-b96a-4e18-909f-1f4ed1072c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f346582e9714786a8276af7062569f9)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:53.965085 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cba164-b96a-4e18-909f-1f4ed1072c99 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:54.064875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a3cba164-b96a-4e18-909f-1f4ed1072c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f346582e9714786a8276af7062569f9', 'request_id': 'req-a3cba164-b96a-4e18-909f-1f4ed1072c99'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:54.120712 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a3cba164-b96a-4e18-909f-1f4ed1072c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f346582e9714786a8276af7062569f9', 'request_id': 'req-a3cba164-b96a-4e18-909f-1f4ed1072c99'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:54.128582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a3cba164-b96a-4e18-909f-1f4ed1072c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f346582e9714786a8276af7062569f9', 'request_id': 'req-a3cba164-b96a-4e18-909f-1f4ed1072c99'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:54.133786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:54.140153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a3cba164-b96a-4e18-909f-1f4ed1072c99 admin admin] The token cache is being invalidate because project 5f346582e9714786a8276af7062569f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:56:54.140447 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a3cba164-b96a-4e18-909f-1f4ed1072c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:54.141150 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a3cba164-b96a-4e18-909f-1f4ed1072c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:56:54.142791 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 975/1961] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:56:53 2022] DELETE /identity/v3/projects/5f346582e9714786a8276af7062569f9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:56:54.148892 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685fb8e-b9ec-439c-998a-2a76fc9b58ac None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:54.149344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685fb8e-b9ec-439c-998a-2a76fc9b58ac None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:54.149457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685fb8e-b9ec-439c-998a-2a76fc9b58ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:54.168632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1685fb8e-b9ec-439c-998a-2a76fc9b58ac None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:54.170976 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1685fb8e-b9ec-439c-998a-2a76fc9b58ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:54.221110 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:56:54.233873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 987/1962] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:54.242853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3808879-7b88-436b-8e36-ef4195d2132c None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:54.243227 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3808879-7b88-436b-8e36-ef4195d2132c None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:54.243584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3808879-7b88-436b-8e36-ef4195d2132c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:54.262652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f3808879-7b88-436b-8e36-ef4195d2132c None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:54.264063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f3808879-7b88-436b-8e36-ef4195d2132c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:54.272346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 976/1963] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:54.276495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685fb8e-b9ec-439c-998a-2a76fc9b58ac None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:54.286301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685fb8e-b9ec-439c-998a-2a76fc9b58ac None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:54.290848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b66b6-771d-4d8c-b817-fcf510678cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:54.292154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b66b6-771d-4d8c-b817-fcf510678cba admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:54.292154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b66b6-771d-4d8c-b817-fcf510678cba admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:54.292154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b66b6-771d-4d8c-b817-fcf510678cba admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:54.292881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b66b6-771d-4d8c-b817-fcf510678cba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:56:54.293186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b66b6-771d-4d8c-b817-fcf510678cba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:54.295438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b66b6-771d-4d8c-b817-fcf510678cba admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:54.307602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 988/1964] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:56:54.312965 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3808879-7b88-436b-8e36-ef4195d2132c None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:54.322569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3808879-7b88-436b-8e36-ef4195d2132c None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:54.327254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628360a7-1809-4c55-b765-5e8040d1d63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:54.327903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628360a7-1809-4c55-b765-5e8040d1d63c admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:54.328183 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628360a7-1809-4c55-b765-5e8040d1d63c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:54.328455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628360a7-1809-4c55-b765-5e8040d1d63c admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:54.329218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628360a7-1809-4c55-b765-5e8040d1d63c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:54.331175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628360a7-1809-4c55-b765-5e8040d1d63c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:54.434037 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 977/1965] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:56:54 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:56:54.437869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b66b6-771d-4d8c-b817-fcf510678cba admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:54.449166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b66b6-771d-4d8c-b817-fcf510678cba admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:54.510237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c5d68-670e-41d5-9bdc-0f2f0bd86712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:54.510909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c5d68-670e-41d5-9bdc-0f2f0bd86712 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:54.511231 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c5d68-670e-41d5-9bdc-0f2f0bd86712 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:54.511510 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c5d68-670e-41d5-9bdc-0f2f0bd86712 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:54.512273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c5d68-670e-41d5-9bdc-0f2f0bd86712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:54.514538 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c5d68-670e-41d5-9bdc-0f2f0bd86712 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:54.573024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 989/1966] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:56:54 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:56:54.577949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628360a7-1809-4c55-b765-5e8040d1d63c admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:54.588262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628360a7-1809-4c55-b765-5e8040d1d63c admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:54.593039 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42efcb-c9b9-4ab9-b9bd-37cbeb86eb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:54.593697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42efcb-c9b9-4ab9-b9bd-37cbeb86eb3d admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:54.593975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42efcb-c9b9-4ab9-b9bd-37cbeb86eb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:54.594497 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42efcb-c9b9-4ab9-b9bd-37cbeb86eb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:54.595045 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42efcb-c9b9-4ab9-b9bd-37cbeb86eb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:54.596612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42efcb-c9b9-4ab9-b9bd-37cbeb86eb3d admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:54.607178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 978/1967] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:54.611140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c5d68-670e-41d5-9bdc-0f2f0bd86712 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:54.621021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c5d68-670e-41d5-9bdc-0f2f0bd86712 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:54.626148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817792e-0134-43c2-b8e5-b3e44f6b9773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:54.626793 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817792e-0134-43c2-b8e5-b3e44f6b9773 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:54.627068 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817792e-0134-43c2-b8e5-b3e44f6b9773 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:54.627341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817792e-0134-43c2-b8e5-b3e44f6b9773 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:54.628089 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817792e-0134-43c2-b8e5-b3e44f6b9773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:54.629684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817792e-0134-43c2-b8e5-b3e44f6b9773 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:54.641583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 990/1968] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:56:54.645514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42efcb-c9b9-4ab9-b9bd-37cbeb86eb3d admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:54.655308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42efcb-c9b9-4ab9-b9bd-37cbeb86eb3d admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:54.660038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe0e15-c6bf-47d0-9c61-31020efa7546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:54.660977 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe0e15-c6bf-47d0-9c61-31020efa7546 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:54.661276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe0e15-c6bf-47d0-9c61-31020efa7546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:54.661535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe0e15-c6bf-47d0-9c61-31020efa7546 admin admin] PATH_INFO: `/v3/projects/732be01709f8467db7e0c3cadeac84ec/users/f41c923ea50c46fbb0fe8a891e1bbff2/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:54.675850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe0e15-c6bf-47d0-9c61-31020efa7546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732be01709f8467db7e0c3cadeac84ec, user_id=f41c923ea50c46fbb0fe8a891e1bbff2, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:54.678522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe0e15-c6bf-47d0-9c61-31020efa7546 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:54.743032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 979/1969] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:56:54 2022] PUT /identity/v3/projects/732be01709f8467db7e0c3cadeac84ec/users/f41c923ea50c46fbb0fe8a891e1bbff2/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:56:54.755051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe220ca-c3f4-4d52-9857-5c6ce4f47358 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:54.755421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe220ca-c3f4-4d52-9857-5c6ce4f47358 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:54.755697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe220ca-c3f4-4d52-9857-5c6ce4f47358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:54.781063 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-5fe220ca-c3f4-4d52-9857-5c6ce4f47358 None None] MFA Rules not processed for user `f41c923ea50c46fbb0fe8a891e1bbff2`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:56:54.782312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-5fe220ca-c3f4-4d52-9857-5c6ce4f47358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:54.846607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 991/1970] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:56:54.858013 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe0e15-c6bf-47d0-9c61-31020efa7546 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:56:54.859799 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-86fe0e15-c6bf-47d0-9c61-31020efa7546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:56:54.918768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe0e15-c6bf-47d0-9c61-31020efa7546 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:56:54.923230 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11a223-7304-47dd-aefe-96ba588a0799 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e93d0321eaa4936a55390155d5aab0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:56:54.923878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11a223-7304-47dd-aefe-96ba588a0799 service glance] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:56:54.924161 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11a223-7304-47dd-aefe-96ba588a0799 service glance] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:56:54.924439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11a223-7304-47dd-aefe-96ba588a0799 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:56:54.933220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11a223-7304-47dd-aefe-96ba588a0799 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:56:54.934635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11a223-7304-47dd-aefe-96ba588a0799 service glance] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:56:54.945053 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 980/1971] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:56:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:57:00.288996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe220ca-c3f4-4d52-9857-5c6ce4f47358 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:00.291078 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-5fe220ca-c3f4-4d52-9857-5c6ce4f47358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:00.345612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:00.363648 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe220ca-c3f4-4d52-9857-5c6ce4f47358 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:00.368419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a192900-e82a-465f-9cfa-6f7a6b3b2da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:00.369315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a192900-e82a-465f-9cfa-6f7a6b3b2da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:00.369597 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a192900-e82a-465f-9cfa-6f7a6b3b2da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:00.369902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a192900-e82a-465f-9cfa-6f7a6b3b2da5 admin admin] PATH_INFO: `/v3/users/e39857b799254b9789e9a7b68650b78b` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:00.371392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a192900-e82a-465f-9cfa-6f7a6b3b2da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39857b799254b9789e9a7b68650b78b)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:00.373818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a192900-e82a-465f-9cfa-6f7a6b3b2da5 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:00.546715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-9a192900-e82a-465f-9cfa-6f7a6b3b2da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39857b799254b9789e9a7b68650b78b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:00.559568 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-9a192900-e82a-465f-9cfa-6f7a6b3b2da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39857b799254b9789e9a7b68650b78b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:00.663526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-9a192900-e82a-465f-9cfa-6f7a6b3b2da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39857b799254b9789e9a7b68650b78b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:00.664269 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-9a192900-e82a-465f-9cfa-6f7a6b3b2da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39857b799254b9789e9a7b68650b78b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:00.674617 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-9a192900-e82a-465f-9cfa-6f7a6b3b2da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39857b799254b9789e9a7b68650b78b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:00.681598 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 992/1972] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:57:00 2022] DELETE /identity/v3/users/e39857b799254b9789e9a7b68650b78b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:00.686370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f345a0-4ba0-4911-b633-db2733925b12 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:00.686995 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f345a0-4ba0-4911-b633-db2733925b12 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:00.686995 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f345a0-4ba0-4911-b633-db2733925b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:00.705429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-14f345a0-4ba0-4911-b633-db2733925b12 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:00.706642 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-14f345a0-4ba0-4911-b633-db2733925b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:00.768431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 981/1973] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:00.778221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a192900-e82a-465f-9cfa-6f7a6b3b2da5 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:00.781814 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9a192900-e82a-465f-9cfa-6f7a6b3b2da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:00.843921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a192900-e82a-465f-9cfa-6f7a6b3b2da5 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:00.847929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62188feb-9581-47d9-a59e-191c2a21c608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:00.848580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188feb-9581-47d9-a59e-191c2a21c608 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:00.848896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188feb-9581-47d9-a59e-191c2a21c608 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:00.849173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188feb-9581-47d9-a59e-191c2a21c608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:00.859010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62188feb-9581-47d9-a59e-191c2a21c608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:00.860516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62188feb-9581-47d9-a59e-191c2a21c608 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:00.871220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 993/1974] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:57:01.352687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f345a0-4ba0-4911-b633-db2733925b12 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:01.354262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-14f345a0-4ba0-4911-b633-db2733925b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:01.366945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f345a0-4ba0-4911-b633-db2733925b12 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:01.373080 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b95be-9e82-4a72-81cd-d5c03c483247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:01.376257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b95be-9e82-4a72-81cd-d5c03c483247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:01.376257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b95be-9e82-4a72-81cd-d5c03c483247 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:01.376257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b95be-9e82-4a72-81cd-d5c03c483247 admin admin] PATH_INFO: `/v3/projects/1b9403f2d8d643138319d6bc8acbc719` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:01.376257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b95be-9e82-4a72-81cd-d5c03c483247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b9403f2d8d643138319d6bc8acbc719)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:01.379100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b95be-9e82-4a72-81cd-d5c03c483247 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:01.486299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:01.499925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c79b95be-9e82-4a72-81cd-d5c03c483247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9403f2d8d643138319d6bc8acbc719', 'request_id': 'req-c79b95be-9e82-4a72-81cd-d5c03c483247'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:01.600721 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c79b95be-9e82-4a72-81cd-d5c03c483247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9403f2d8d643138319d6bc8acbc719', 'request_id': 'req-c79b95be-9e82-4a72-81cd-d5c03c483247'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:01.608000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c79b95be-9e82-4a72-81cd-d5c03c483247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9403f2d8d643138319d6bc8acbc719', 'request_id': 'req-c79b95be-9e82-4a72-81cd-d5c03c483247'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:01.618673 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c79b95be-9e82-4a72-81cd-d5c03c483247 admin admin] The token cache is being invalidate because project 1b9403f2d8d643138319d6bc8acbc719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:57:01.618965 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c79b95be-9e82-4a72-81cd-d5c03c483247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:01.619608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c79b95be-9e82-4a72-81cd-d5c03c483247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:01.624936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 982/1975] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:57:01 2022] DELETE /identity/v3/projects/1b9403f2d8d643138319d6bc8acbc719 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:01.628733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62188feb-9581-47d9-a59e-191c2a21c608 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:01.639767 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62188feb-9581-47d9-a59e-191c2a21c608 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:01.702626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f6314-8970-4fa8-8bba-d252a1478f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:01.703868 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f6314-8970-4fa8-8bba-d252a1478f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:01.704208 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f6314-8970-4fa8-8bba-d252a1478f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:01.704450 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f6314-8970-4fa8-8bba-d252a1478f5a admin admin] PATH_INFO: `/v3/users/f68dc82530d941f1aedaf14043cb9c65` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:01.706115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f6314-8970-4fa8-8bba-d252a1478f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68dc82530d941f1aedaf14043cb9c65)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:01.708428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f6314-8970-4fa8-8bba-d252a1478f5a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:01.724442 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:01.968465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b76f6314-8970-4fa8-8bba-d252a1478f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68dc82530d941f1aedaf14043cb9c65'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:01.981099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b76f6314-8970-4fa8-8bba-d252a1478f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68dc82530d941f1aedaf14043cb9c65'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:02.104610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b76f6314-8970-4fa8-8bba-d252a1478f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68dc82530d941f1aedaf14043cb9c65'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:02.105407 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b76f6314-8970-4fa8-8bba-d252a1478f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68dc82530d941f1aedaf14043cb9c65'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:02.116475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b76f6314-8970-4fa8-8bba-d252a1478f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68dc82530d941f1aedaf14043cb9c65'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:02.127121 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 994/1976] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:57:01 2022] DELETE /identity/v3/users/f68dc82530d941f1aedaf14043cb9c65 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:02.606439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b95be-9e82-4a72-81cd-d5c03c483247 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:02.609490 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-c79b95be-9e82-4a72-81cd-d5c03c483247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:02.639639 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b95be-9e82-4a72-81cd-d5c03c483247 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:02.706333 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af09658-1e8a-44f4-a97b-831a93e897a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:02.707334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af09658-1e8a-44f4-a97b-831a93e897a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:02.707677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af09658-1e8a-44f4-a97b-831a93e897a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:02.707961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af09658-1e8a-44f4-a97b-831a93e897a0 admin admin] PATH_INFO: `/v3/projects/91c74c9b879c4498b1479dbe4376f013` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:02.709209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af09658-1e8a-44f4-a97b-831a93e897a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c74c9b879c4498b1479dbe4376f013)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:02.711220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af09658-1e8a-44f4-a97b-831a93e897a0 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:02.887780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-2af09658-1e8a-44f4-a97b-831a93e897a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c74c9b879c4498b1479dbe4376f013', 'request_id': 'req-2af09658-1e8a-44f4-a97b-831a93e897a0'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:02.983896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-2af09658-1e8a-44f4-a97b-831a93e897a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c74c9b879c4498b1479dbe4376f013', 'request_id': 'req-2af09658-1e8a-44f4-a97b-831a93e897a0'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:02.991049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-2af09658-1e8a-44f4-a97b-831a93e897a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c74c9b879c4498b1479dbe4376f013', 'request_id': 'req-2af09658-1e8a-44f4-a97b-831a93e897a0'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:03.004489 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-2af09658-1e8a-44f4-a97b-831a93e897a0 admin admin] The token cache is being invalidate because project 91c74c9b879c4498b1479dbe4376f013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:57:03.004838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-2af09658-1e8a-44f4-a97b-831a93e897a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:03.005647 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-2af09658-1e8a-44f4-a97b-831a93e897a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:03.007252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 983/1977] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:57:02 2022] DELETE /identity/v3/projects/91c74c9b879c4498b1479dbe4376f013 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:03.011388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f6314-8970-4fa8-8bba-d252a1478f5a admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:03.012923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b76f6314-8970-4fa8-8bba-d252a1478f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:03.045441 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f6314-8970-4fa8-8bba-d252a1478f5a admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:03.117471 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb65265-4836-4465-bd48-b8ce25b140b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:03.119413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb65265-4836-4465-bd48-b8ce25b140b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:03.120293 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb65265-4836-4465-bd48-b8ce25b140b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:03.120670 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb65265-4836-4465-bd48-b8ce25b140b3 admin admin] PATH_INFO: `/v3/users/44fb4e49b6024ac0be04af97585a7ba8` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:03.125149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb65265-4836-4465-bd48-b8ce25b140b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44fb4e49b6024ac0be04af97585a7ba8)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:03.130685 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb65265-4836-4465-bd48-b8ce25b140b3 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:03.403406 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-aeb65265-4836-4465-bd48-b8ce25b140b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44fb4e49b6024ac0be04af97585a7ba8'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:03.453347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-aeb65265-4836-4465-bd48-b8ce25b140b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44fb4e49b6024ac0be04af97585a7ba8'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:03.561604 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-aeb65265-4836-4465-bd48-b8ce25b140b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44fb4e49b6024ac0be04af97585a7ba8'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:03.562677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-aeb65265-4836-4465-bd48-b8ce25b140b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44fb4e49b6024ac0be04af97585a7ba8'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:03.572753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-aeb65265-4836-4465-bd48-b8ce25b140b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44fb4e49b6024ac0be04af97585a7ba8'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:03.577864 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 995/1978] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:57:03 2022] DELETE /identity/v3/users/44fb4e49b6024ac0be04af97585a7ba8 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:04.040359 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af09658-1e8a-44f4-a97b-831a93e897a0 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:04.041936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2af09658-1e8a-44f4-a97b-831a93e897a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:04.057574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af09658-1e8a-44f4-a97b-831a93e897a0 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:04.120260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:04.132747 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ed343-df14-4775-9aa3-491a13d7a696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:04.138870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ed343-df14-4775-9aa3-491a13d7a696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:04.138870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ed343-df14-4775-9aa3-491a13d7a696 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:04.138870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ed343-df14-4775-9aa3-491a13d7a696 admin admin] PATH_INFO: `/v3/projects/197dcb487cb5470b8fe76435a1d4d238` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:04.138870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ed343-df14-4775-9aa3-491a13d7a696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=197dcb487cb5470b8fe76435a1d4d238)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:04.138870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ed343-df14-4775-9aa3-491a13d7a696 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:04.264208 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-291ed343-df14-4775-9aa3-491a13d7a696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197dcb487cb5470b8fe76435a1d4d238', 'request_id': 'req-291ed343-df14-4775-9aa3-491a13d7a696'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:04.359094 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-291ed343-df14-4775-9aa3-491a13d7a696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197dcb487cb5470b8fe76435a1d4d238', 'request_id': 'req-291ed343-df14-4775-9aa3-491a13d7a696'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:04.365836 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-291ed343-df14-4775-9aa3-491a13d7a696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197dcb487cb5470b8fe76435a1d4d238', 'request_id': 'req-291ed343-df14-4775-9aa3-491a13d7a696'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:04.376725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-291ed343-df14-4775-9aa3-491a13d7a696 admin admin] The token cache is being invalidate because project 197dcb487cb5470b8fe76435a1d4d238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:57:04.377008 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-291ed343-df14-4775-9aa3-491a13d7a696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:04.377654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-291ed343-df14-4775-9aa3-491a13d7a696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:04.379178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 984/1979] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:57:04 2022] DELETE /identity/v3/projects/197dcb487cb5470b8fe76435a1d4d238 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:04.385380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bdd43-3d94-4a38-bee3-b9832f9defee None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:04.385855 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bdd43-3d94-4a38-bee3-b9832f9defee None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:04.385944 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bdd43-3d94-4a38-bee3-b9832f9defee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:04.406766 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-9f8bdd43-3d94-4a38-bee3-b9832f9defee None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:04.408008 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9f8bdd43-3d94-4a38-bee3-b9832f9defee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:04.412364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:04.469132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 996/1980] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:04.477745 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360f58d-17fe-49cb-9056-c773d3f67149 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:04.478034 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360f58d-17fe-49cb-9056-c773d3f67149 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:04.478384 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360f58d-17fe-49cb-9056-c773d3f67149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:04.502513 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-4360f58d-17fe-49cb-9056-c773d3f67149 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:04.503916 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-4360f58d-17fe-49cb-9056-c773d3f67149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:04.516102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 985/1981] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:04.520234 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bdd43-3d94-4a38-bee3-b9832f9defee None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:04.530596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bdd43-3d94-4a38-bee3-b9832f9defee None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:04.537601 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72757d24-fd33-4e8f-90b3-42565f5c643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:04.538267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72757d24-fd33-4e8f-90b3-42565f5c643f admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:04.538550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72757d24-fd33-4e8f-90b3-42565f5c643f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:04.538828 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72757d24-fd33-4e8f-90b3-42565f5c643f admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:04.539566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72757d24-fd33-4e8f-90b3-42565f5c643f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:57:04.539875 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72757d24-fd33-4e8f-90b3-42565f5c643f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:04.541530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72757d24-fd33-4e8f-90b3-42565f5c643f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:04.557054 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 997/1982] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:57:04.562242 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360f58d-17fe-49cb-9056-c773d3f67149 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:04.573549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360f58d-17fe-49cb-9056-c773d3f67149 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:04.580516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394211b-7d44-4b81-80f7-c72764d647bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:04.582023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394211b-7d44-4b81-80f7-c72764d647bf admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:04.582023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394211b-7d44-4b81-80f7-c72764d647bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:04.582378 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394211b-7d44-4b81-80f7-c72764d647bf admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:04.583012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394211b-7d44-4b81-80f7-c72764d647bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:04.585074 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394211b-7d44-4b81-80f7-c72764d647bf admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:04.735638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 986/1983] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:57:04 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:57:04.742406 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72757d24-fd33-4e8f-90b3-42565f5c643f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:04.753809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72757d24-fd33-4e8f-90b3-42565f5c643f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:04.837456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44854da0-5024-4161-af99-e6cfddd5b38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:04.838139 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44854da0-5024-4161-af99-e6cfddd5b38c admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:04.838424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44854da0-5024-4161-af99-e6cfddd5b38c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:04.838703 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44854da0-5024-4161-af99-e6cfddd5b38c admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:04.839396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44854da0-5024-4161-af99-e6cfddd5b38c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:04.842244 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44854da0-5024-4161-af99-e6cfddd5b38c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:04.944722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 998/1984] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:57:04 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:04.948034 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394211b-7d44-4b81-80f7-c72764d647bf admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:04.963720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394211b-7d44-4b81-80f7-c72764d647bf admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:04.969856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47993caa-c812-482b-b731-c8379dbb8062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:04.970585 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47993caa-c812-482b-b731-c8379dbb8062 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:04.970872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47993caa-c812-482b-b731-c8379dbb8062 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:04.971154 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47993caa-c812-482b-b731-c8379dbb8062 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:04.972753 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47993caa-c812-482b-b731-c8379dbb8062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:04.974565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47993caa-c812-482b-b731-c8379dbb8062 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:04.987138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 987/1985] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:04.991326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44854da0-5024-4161-af99-e6cfddd5b38c admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:05.001942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44854da0-5024-4161-af99-e6cfddd5b38c admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:05.006966 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe60f46-694e-4d4f-ae57-8e9412be45f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:05.007638 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe60f46-694e-4d4f-ae57-8e9412be45f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:05.007926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe60f46-694e-4d4f-ae57-8e9412be45f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:05.008204 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe60f46-694e-4d4f-ae57-8e9412be45f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:05.009011 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe60f46-694e-4d4f-ae57-8e9412be45f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:05.010679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe60f46-694e-4d4f-ae57-8e9412be45f0 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:05.025052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 999/1986] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:05.030796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47993caa-c812-482b-b731-c8379dbb8062 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:05.043318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47993caa-c812-482b-b731-c8379dbb8062 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:05.052515 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2d8fb-f083-483b-8fa1-c9b7d2d2c2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:05.054299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2d8fb-f083-483b-8fa1-c9b7d2d2c2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:05.054299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2d8fb-f083-483b-8fa1-c9b7d2d2c2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:05.054571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2d8fb-f083-483b-8fa1-c9b7d2d2c2a0 admin admin] PATH_INFO: `/v3/projects/24ad308b9c9f46cbabb6d4f8da646b91/users/088c4de2148c4a8cb4285756b27cf50a/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:05.071750 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2d8fb-f083-483b-8fa1-c9b7d2d2c2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ad308b9c9f46cbabb6d4f8da646b91, user_id=088c4de2148c4a8cb4285756b27cf50a, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:05.074765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2d8fb-f083-483b-8fa1-c9b7d2d2c2a0 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:05.187124 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 988/1987] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:05 2022] PUT /identity/v3/projects/24ad308b9c9f46cbabb6d4f8da646b91/users/088c4de2148c4a8cb4285756b27cf50a/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:05.200253 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2305cc7-c87a-4c9d-94ef-0ebc5a14b996 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:05.200593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2305cc7-c87a-4c9d-94ef-0ebc5a14b996 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:05.201066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2305cc7-c87a-4c9d-94ef-0ebc5a14b996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:05.240069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-f2305cc7-c87a-4c9d-94ef-0ebc5a14b996 None None] MFA Rules not processed for user `088c4de2148c4a8cb4285756b27cf50a`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:05.241499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f2305cc7-c87a-4c9d-94ef-0ebc5a14b996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:05.320104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1000/1988] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:05.320193 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2d8fb-f083-483b-8fa1-c9b7d2d2c2a0 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:05.457473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2d8fb-f083-483b-8fa1-c9b7d2d2c2a0 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:05.463439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda340ca-4a54-4f54-8074-3d260146c0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:05.464402 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda340ca-4a54-4f54-8074-3d260146c0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:05.464741 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda340ca-4a54-4f54-8074-3d260146c0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:05.465025 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda340ca-4a54-4f54-8074-3d260146c0a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:05.466088 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda340ca-4a54-4f54-8074-3d260146c0a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:05.468742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda340ca-4a54-4f54-8074-3d260146c0a2 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:05.583795 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:05.591822 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 989/1989] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:57:05 2022] POST /identity/v3/projects => generated 385 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:05.596992 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2305cc7-c87a-4c9d-94ef-0ebc5a14b996 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:05.603696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:05.608489 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2305cc7-c87a-4c9d-94ef-0ebc5a14b996 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:05.668097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e824b88-6f6d-451a-ac6f-e1f2ac95de7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:05.668818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e824b88-6f6d-451a-ac6f-e1f2ac95de7c admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:05.669106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e824b88-6f6d-451a-ac6f-e1f2ac95de7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:05.669516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e824b88-6f6d-451a-ac6f-e1f2ac95de7c admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:05.670324 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e824b88-6f6d-451a-ac6f-e1f2ac95de7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:05.672242 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e824b88-6f6d-451a-ac6f-e1f2ac95de7c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:05.786528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1001/1990] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:57:05 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:05.790561 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda340ca-4a54-4f54-8074-3d260146c0a2 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:05.802615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda340ca-4a54-4f54-8074-3d260146c0a2 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:05.807462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828ad89-8e9e-4865-abc9-a85eb141abb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:05.808139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828ad89-8e9e-4865-abc9-a85eb141abb7 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:05.808424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828ad89-8e9e-4865-abc9-a85eb141abb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:05.808735 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828ad89-8e9e-4865-abc9-a85eb141abb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:05.809473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828ad89-8e9e-4865-abc9-a85eb141abb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:05.812078 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828ad89-8e9e-4865-abc9-a85eb141abb7 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:05.824688 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 990/1991] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:05.829796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e824b88-6f6d-451a-ac6f-e1f2ac95de7c admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:05.840859 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e824b88-6f6d-451a-ac6f-e1f2ac95de7c admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:05.846229 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac7f05-0dba-4f5a-b2ae-ec0cee12ba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:05.847276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac7f05-0dba-4f5a-b2ae-ec0cee12ba2e admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:05.847628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac7f05-0dba-4f5a-b2ae-ec0cee12ba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:05.847962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac7f05-0dba-4f5a-b2ae-ec0cee12ba2e admin admin] PATH_INFO: `/v3/projects/df765635035f418da4884db06c8b51cb/users/ff67f112a38c415cba66a8770781aeaa/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:05.873410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac7f05-0dba-4f5a-b2ae-ec0cee12ba2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df765635035f418da4884db06c8b51cb, user_id=ff67f112a38c415cba66a8770781aeaa, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:05.876706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac7f05-0dba-4f5a-b2ae-ec0cee12ba2e admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:05.939974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1002/1992] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:05 2022] PUT /identity/v3/projects/df765635035f418da4884db06c8b51cb/users/ff67f112a38c415cba66a8770781aeaa/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:05.944316 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828ad89-8e9e-4865-abc9-a85eb141abb7 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:05.955612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828ad89-8e9e-4865-abc9-a85eb141abb7 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:06.052552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb200f3-e8bb-453b-8ce2-c51d83bbecc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:06.053395 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb200f3-e8bb-453b-8ce2-c51d83bbecc4 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:06.053779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb200f3-e8bb-453b-8ce2-c51d83bbecc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:06.054160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb200f3-e8bb-453b-8ce2-c51d83bbecc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:06.054999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb200f3-e8bb-453b-8ce2-c51d83bbecc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:06.057062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb200f3-e8bb-453b-8ce2-c51d83bbecc4 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:06.080949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 991/1993] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:06.085337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac7f05-0dba-4f5a-b2ae-ec0cee12ba2e admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:06.101608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac7f05-0dba-4f5a-b2ae-ec0cee12ba2e admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:06.117573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2318c-8db8-4fb2-a4b0-c1f458c433a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:06.118868 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2318c-8db8-4fb2-a4b0-c1f458c433a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:06.119224 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2318c-8db8-4fb2-a4b0-c1f458c433a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:06.119569 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2318c-8db8-4fb2-a4b0-c1f458c433a6 admin admin] PATH_INFO: `/v3/projects/df765635035f418da4884db06c8b51cb/users/ff67f112a38c415cba66a8770781aeaa/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:06.125240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2318c-8db8-4fb2-a4b0-c1f458c433a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df765635035f418da4884db06c8b51cb, user_id=ff67f112a38c415cba66a8770781aeaa, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:06.127888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2318c-8db8-4fb2-a4b0-c1f458c433a6 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:06.157162 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1003/1994] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:06 2022] PUT /identity/v3/projects/df765635035f418da4884db06c8b51cb/users/ff67f112a38c415cba66a8770781aeaa/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:06.164138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d21d7-fc55-4eb1-996b-0ecb6170a617 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:06.164424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d21d7-fc55-4eb1-996b-0ecb6170a617 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:06.164741 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d21d7-fc55-4eb1-996b-0ecb6170a617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:06.197816 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-fa3d21d7-fc55-4eb1-996b-0ecb6170a617 None None] MFA Rules not processed for user `ff67f112a38c415cba66a8770781aeaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:06.199380 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-fa3d21d7-fc55-4eb1-996b-0ecb6170a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:06.282103 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 992/1995] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:06.293313 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2318c-8db8-4fb2-a4b0-c1f458c433a6 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:06.295693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-bdc2318c-8db8-4fb2-a4b0-c1f458c433a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:06.358804 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2318c-8db8-4fb2-a4b0-c1f458c433a6 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:06.362530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb5a03-a676-4518-955f-70610e8b63f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:06.363176 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb5a03-a676-4518-955f-70610e8b63f7 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:06.363462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb5a03-a676-4518-955f-70610e8b63f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:06.363739 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb5a03-a676-4518-955f-70610e8b63f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:06.373076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb5a03-a676-4518-955f-70610e8b63f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:06.376179 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb5a03-a676-4518-955f-70610e8b63f7 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:06.388565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1004/1996] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:57:08.364788 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d21d7-fc55-4eb1-996b-0ecb6170a617 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:08.480029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d21d7-fc55-4eb1-996b-0ecb6170a617 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:08.487414 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca576e7-2c05-4dee-9334-123f75bdb4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:08.489216 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca576e7-2c05-4dee-9334-123f75bdb4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:08.489644 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca576e7-2c05-4dee-9334-123f75bdb4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:08.490087 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca576e7-2c05-4dee-9334-123f75bdb4f5 admin admin] PATH_INFO: `/v3/users/088c4de2148c4a8cb4285756b27cf50a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:08.491967 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca576e7-2c05-4dee-9334-123f75bdb4f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=088c4de2148c4a8cb4285756b27cf50a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:08.494853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca576e7-2c05-4dee-9334-123f75bdb4f5 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:08.529631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:08.758471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-eca576e7-2c05-4dee-9334-123f75bdb4f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '088c4de2148c4a8cb4285756b27cf50a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:08.771392 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-eca576e7-2c05-4dee-9334-123f75bdb4f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '088c4de2148c4a8cb4285756b27cf50a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:08.858116 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-eca576e7-2c05-4dee-9334-123f75bdb4f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '088c4de2148c4a8cb4285756b27cf50a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:08.858753 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-eca576e7-2c05-4dee-9334-123f75bdb4f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '088c4de2148c4a8cb4285756b27cf50a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:08.866531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-eca576e7-2c05-4dee-9334-123f75bdb4f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '088c4de2148c4a8cb4285756b27cf50a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:08.873521 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 993/1997] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:57:08 2022] DELETE /identity/v3/users/088c4de2148c4a8cb4285756b27cf50a => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:08.878311 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94272-598e-46ee-b666-bba5ee26754b None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:08.878767 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94272-598e-46ee-b666-bba5ee26754b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:08.878958 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94272-598e-46ee-b666-bba5ee26754b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:08.897078 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-b2a94272-598e-46ee-b666-bba5ee26754b None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:08.898291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b2a94272-598e-46ee-b666-bba5ee26754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:08.953097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:08.961927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1005/1998] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:08.972003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca576e7-2c05-4dee-9334-123f75bdb4f5 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:08.973746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-eca576e7-2c05-4dee-9334-123f75bdb4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:09.042744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca576e7-2c05-4dee-9334-123f75bdb4f5 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:09.046956 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b6dfc-9eed-4724-b758-fd7f49524e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:09.047618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b6dfc-9eed-4724-b758-fd7f49524e38 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:09.047940 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b6dfc-9eed-4724-b758-fd7f49524e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:09.048167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b6dfc-9eed-4724-b758-fd7f49524e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:09.058509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b6dfc-9eed-4724-b758-fd7f49524e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:09.059951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b6dfc-9eed-4724-b758-fd7f49524e38 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:09.072248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 994/1999] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:57:09.487203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94272-598e-46ee-b666-bba5ee26754b None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:09.488748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b2a94272-598e-46ee-b666-bba5ee26754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:09.504116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94272-598e-46ee-b666-bba5ee26754b None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:09.518746 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70fee5-bc45-49bc-9146-da533fe6acec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:09.519814 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70fee5-bc45-49bc-9146-da533fe6acec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:09.520162 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70fee5-bc45-49bc-9146-da533fe6acec admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:09.520587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70fee5-bc45-49bc-9146-da533fe6acec admin admin] PATH_INFO: `/v3/projects/24ad308b9c9f46cbabb6d4f8da646b91` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:09.521876 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70fee5-bc45-49bc-9146-da533fe6acec admin admin] RBAC: Authorizing `identity:delete_project(project_id=24ad308b9c9f46cbabb6d4f8da646b91)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:09.523845 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70fee5-bc45-49bc-9146-da533fe6acec admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:09.641608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fa70fee5-bc45-49bc-9146-da533fe6acec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ad308b9c9f46cbabb6d4f8da646b91', 'request_id': 'req-fa70fee5-bc45-49bc-9146-da533fe6acec'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:09.652611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fa70fee5-bc45-49bc-9146-da533fe6acec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ad308b9c9f46cbabb6d4f8da646b91', 'request_id': 'req-fa70fee5-bc45-49bc-9146-da533fe6acec'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:09.735983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fa70fee5-bc45-49bc-9146-da533fe6acec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ad308b9c9f46cbabb6d4f8da646b91', 'request_id': 'req-fa70fee5-bc45-49bc-9146-da533fe6acec'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:09.747282 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fa70fee5-bc45-49bc-9146-da533fe6acec admin admin] The token cache is being invalidate because project 24ad308b9c9f46cbabb6d4f8da646b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:57:09.747572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fa70fee5-bc45-49bc-9146-da533fe6acec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:09.748399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-fa70fee5-bc45-49bc-9146-da533fe6acec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:09.749982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1006/2000] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:57:09 2022] DELETE /identity/v3/projects/24ad308b9c9f46cbabb6d4f8da646b91 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:09.754164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b6dfc-9eed-4724-b758-fd7f49524e38 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:09.764226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b6dfc-9eed-4724-b758-fd7f49524e38 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:09.823145 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa14e9-769a-4577-b7e0-ab68aa0839fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:09.824084 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa14e9-769a-4577-b7e0-ab68aa0839fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:09.824437 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa14e9-769a-4577-b7e0-ab68aa0839fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:09.824813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa14e9-769a-4577-b7e0-ab68aa0839fc admin admin] PATH_INFO: `/v3/users/ff67f112a38c415cba66a8770781aeaa` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:09.827091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa14e9-769a-4577-b7e0-ab68aa0839fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff67f112a38c415cba66a8770781aeaa)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:09.829139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa14e9-769a-4577-b7e0-ab68aa0839fc admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:09.964834 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:09.974650 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-76fa14e9-769a-4577-b7e0-ab68aa0839fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff67f112a38c415cba66a8770781aeaa'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:09.986580 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-76fa14e9-769a-4577-b7e0-ab68aa0839fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff67f112a38c415cba66a8770781aeaa'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:10.057413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-76fa14e9-769a-4577-b7e0-ab68aa0839fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff67f112a38c415cba66a8770781aeaa'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:10.058041 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-76fa14e9-769a-4577-b7e0-ab68aa0839fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff67f112a38c415cba66a8770781aeaa'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:10.065916 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-76fa14e9-769a-4577-b7e0-ab68aa0839fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff67f112a38c415cba66a8770781aeaa'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:10.072532 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 995/2001] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:57:09 2022] DELETE /identity/v3/users/ff67f112a38c415cba66a8770781aeaa => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:10.590386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70fee5-bc45-49bc-9146-da533fe6acec admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:10.591980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-fa70fee5-bc45-49bc-9146-da533fe6acec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:10.607744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70fee5-bc45-49bc-9146-da533fe6acec admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:10.673084 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ca48e-7025-4632-9476-667075195a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:10.675360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ca48e-7025-4632-9476-667075195a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:10.675360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ca48e-7025-4632-9476-667075195a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:10.675360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ca48e-7025-4632-9476-667075195a43 admin admin] PATH_INFO: `/v3/projects/df765635035f418da4884db06c8b51cb` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:10.675708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ca48e-7025-4632-9476-667075195a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df765635035f418da4884db06c8b51cb)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:10.677719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ca48e-7025-4632-9476-667075195a43 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:10.785362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1b3ca48e-7025-4632-9476-667075195a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df765635035f418da4884db06c8b51cb', 'request_id': 'req-1b3ca48e-7025-4632-9476-667075195a43'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:10.792150 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1b3ca48e-7025-4632-9476-667075195a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df765635035f418da4884db06c8b51cb', 'request_id': 'req-1b3ca48e-7025-4632-9476-667075195a43'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:10.874796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1b3ca48e-7025-4632-9476-667075195a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df765635035f418da4884db06c8b51cb', 'request_id': 'req-1b3ca48e-7025-4632-9476-667075195a43'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:10.885531 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1b3ca48e-7025-4632-9476-667075195a43 admin admin] The token cache is being invalidate because project df765635035f418da4884db06c8b51cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:57:10.885817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1b3ca48e-7025-4632-9476-667075195a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:10.886442 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1b3ca48e-7025-4632-9476-667075195a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:10.888015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1007/2002] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:57:10 2022] DELETE /identity/v3/projects/df765635035f418da4884db06c8b51cb => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:10.894667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710f6e5-2623-45cc-8748-bdfa216e5382 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:10.895148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710f6e5-2623-45cc-8748-bdfa216e5382 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:10.895293 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710f6e5-2623-45cc-8748-bdfa216e5382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:10.913937 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-c710f6e5-2623-45cc-8748-bdfa216e5382 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:10.915127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-c710f6e5-2623-45cc-8748-bdfa216e5382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:10.978299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 996/2003] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:10.986196 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c51b09-4865-422f-9a48-0ce168974ae8 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:10.986475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c51b09-4865-422f-9a48-0ce168974ae8 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:10.986755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c51b09-4865-422f-9a48-0ce168974ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:11.006116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-f4c51b09-4865-422f-9a48-0ce168974ae8 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:11.007335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f4c51b09-4865-422f-9a48-0ce168974ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:11.016289 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1008/2004] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:11.020408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710f6e5-2623-45cc-8748-bdfa216e5382 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:11.030650 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710f6e5-2623-45cc-8748-bdfa216e5382 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:11.035349 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0be22-a190-4513-a3e2-3947095e768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:11.035999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0be22-a190-4513-a3e2-3947095e768a admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:11.036281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0be22-a190-4513-a3e2-3947095e768a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:11.036557 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0be22-a190-4513-a3e2-3947095e768a admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:11.037318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0be22-a190-4513-a3e2-3947095e768a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:57:11.037625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0be22-a190-4513-a3e2-3947095e768a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:11.039206 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0be22-a190-4513-a3e2-3947095e768a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:11.050957 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 997/2005] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:57:11.055085 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c51b09-4865-422f-9a48-0ce168974ae8 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:11.064391 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c51b09-4865-422f-9a48-0ce168974ae8 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:11.069533 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075c5b5-2479-4ba9-a1ce-186862e96d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:11.070174 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c5b5-2479-4ba9-a1ce-186862e96d16 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:11.070456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c5b5-2479-4ba9-a1ce-186862e96d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:11.070734 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c5b5-2479-4ba9-a1ce-186862e96d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:11.071431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075c5b5-2479-4ba9-a1ce-186862e96d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:11.073524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075c5b5-2479-4ba9-a1ce-186862e96d16 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:11.077272 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:11.185061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1009/2006] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:57:11 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:11.189325 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0be22-a190-4513-a3e2-3947095e768a admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:11.199608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0be22-a190-4513-a3e2-3947095e768a admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:11.254867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98483c6a-8080-47a2-9346-13a9cbb75986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:11.255524 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98483c6a-8080-47a2-9346-13a9cbb75986 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:11.255849 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98483c6a-8080-47a2-9346-13a9cbb75986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:11.256117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98483c6a-8080-47a2-9346-13a9cbb75986 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:11.256868 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98483c6a-8080-47a2-9346-13a9cbb75986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:11.258761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98483c6a-8080-47a2-9346-13a9cbb75986 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:11.349366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 998/2007] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:57:11 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:11.353552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075c5b5-2479-4ba9-a1ce-186862e96d16 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:11.364487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075c5b5-2479-4ba9-a1ce-186862e96d16 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:11.369207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15445f83-55b6-4f44-9df3-8c3f2f15c520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:11.369862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15445f83-55b6-4f44-9df3-8c3f2f15c520 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:11.370143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15445f83-55b6-4f44-9df3-8c3f2f15c520 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:11.370462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15445f83-55b6-4f44-9df3-8c3f2f15c520 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:11.371186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15445f83-55b6-4f44-9df3-8c3f2f15c520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:11.372779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15445f83-55b6-4f44-9df3-8c3f2f15c520 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:11.383982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1010/2008] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:11.388011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98483c6a-8080-47a2-9346-13a9cbb75986 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:11.399410 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98483c6a-8080-47a2-9346-13a9cbb75986 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:11.404207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef24ef-37cd-426c-ab1b-b0c56b28d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:11.404904 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef24ef-37cd-426c-ab1b-b0c56b28d49f admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:11.405200 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef24ef-37cd-426c-ab1b-b0c56b28d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:11.405475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef24ef-37cd-426c-ab1b-b0c56b28d49f admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:11.406197 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef24ef-37cd-426c-ab1b-b0c56b28d49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:11.407806 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef24ef-37cd-426c-ab1b-b0c56b28d49f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:11.418674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 999/2009] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:11.423312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15445f83-55b6-4f44-9df3-8c3f2f15c520 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:11.433198 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15445f83-55b6-4f44-9df3-8c3f2f15c520 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:11.438335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e23a6-acaf-45ff-a083-9a88bea45f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:11.439209 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e23a6-acaf-45ff-a083-9a88bea45f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:11.439489 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e23a6-acaf-45ff-a083-9a88bea45f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:11.439764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e23a6-acaf-45ff-a083-9a88bea45f63 admin admin] PATH_INFO: `/v3/projects/9f583ae86f384fb2ac0f9430796f23ae/users/0d9566c63c80411489fb6927834301a7/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:11.459474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e23a6-acaf-45ff-a083-9a88bea45f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f583ae86f384fb2ac0f9430796f23ae, user_id=0d9566c63c80411489fb6927834301a7, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:11.462272 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e23a6-acaf-45ff-a083-9a88bea45f63 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:11.571096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1011/2010] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:11 2022] PUT /identity/v3/projects/9f583ae86f384fb2ac0f9430796f23ae/users/0d9566c63c80411489fb6927834301a7/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:11.581489 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e714e-d9be-480a-a5cd-d15ea6ea9df9 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:11.581730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e714e-d9be-480a-a5cd-d15ea6ea9df9 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:11.582011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e714e-d9be-480a-a5cd-d15ea6ea9df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:11.609615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-643e714e-d9be-480a-a5cd-d15ea6ea9df9 None None] MFA Rules not processed for user `0d9566c63c80411489fb6927834301a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:11.610810 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-643e714e-d9be-480a-a5cd-d15ea6ea9df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:11.615740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:11.673696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1000/2011] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:11.685129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e23a6-acaf-45ff-a083-9a88bea45f63 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:11.687096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a15e23a6-acaf-45ff-a083-9a88bea45f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:11.745129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e23a6-acaf-45ff-a083-9a88bea45f63 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:11.748685 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1c20b-070a-4124-a252-09d6973eb091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:11.749526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1c20b-070a-4124-a252-09d6973eb091 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:11.749807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1c20b-070a-4124-a252-09d6973eb091 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:11.750082 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1c20b-070a-4124-a252-09d6973eb091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:11.758220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1c20b-070a-4124-a252-09d6973eb091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:11.759619 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1c20b-070a-4124-a252-09d6973eb091 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:11.768859 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1012/2012] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:57:21.713139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=24 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:21.764213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:22.446089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e714e-d9be-480a-a5cd-d15ea6ea9df9 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:22.447579 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-643e714e-d9be-480a-a5cd-d15ea6ea9df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:22.513761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e714e-d9be-480a-a5cd-d15ea6ea9df9 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:22.519086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e61f45-adf5-4c8c-8a06-96b2db9c445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:22.519982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e61f45-adf5-4c8c-8a06-96b2db9c445b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:22.522180 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e61f45-adf5-4c8c-8a06-96b2db9c445b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:22.522180 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e61f45-adf5-4c8c-8a06-96b2db9c445b admin admin] PATH_INFO: `/v3/users/5cab57c09c334f3bb23f86d9ebfe1346` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:22.522180 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e61f45-adf5-4c8c-8a06-96b2db9c445b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cab57c09c334f3bb23f86d9ebfe1346)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:22.523753 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e61f45-adf5-4c8c-8a06-96b2db9c445b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:22.674432 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-26e61f45-adf5-4c8c-8a06-96b2db9c445b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cab57c09c334f3bb23f86d9ebfe1346'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:22.686252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-26e61f45-adf5-4c8c-8a06-96b2db9c445b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cab57c09c334f3bb23f86d9ebfe1346'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:22.747172 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-26e61f45-adf5-4c8c-8a06-96b2db9c445b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cab57c09c334f3bb23f86d9ebfe1346'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:22.747842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-26e61f45-adf5-4c8c-8a06-96b2db9c445b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cab57c09c334f3bb23f86d9ebfe1346'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:22.756720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-26e61f45-adf5-4c8c-8a06-96b2db9c445b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cab57c09c334f3bb23f86d9ebfe1346'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:22.763684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1001/2013] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:57:22 2022] DELETE /identity/v3/users/5cab57c09c334f3bb23f86d9ebfe1346 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:22.768976 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34bdd8-da79-4f91-a7a4-921653c388ca None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:22.769475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34bdd8-da79-4f91-a7a4-921653c388ca None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:22.769588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34bdd8-da79-4f91-a7a4-921653c388ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:22.787939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-dd34bdd8-da79-4f91-a7a4-921653c388ca None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:22.789241 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-dd34bdd8-da79-4f91-a7a4-921653c388ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:22.855167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1013/2014] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:22.865155 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e61f45-adf5-4c8c-8a06-96b2db9c445b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:22.866580 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-26e61f45-adf5-4c8c-8a06-96b2db9c445b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:22.924661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e61f45-adf5-4c8c-8a06-96b2db9c445b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:22.928331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2b686-f90a-498d-86bf-9a9c394fb8ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:22.929009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2b686-f90a-498d-86bf-9a9c394fb8ed service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:22.929294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2b686-f90a-498d-86bf-9a9c394fb8ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:22.929621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2b686-f90a-498d-86bf-9a9c394fb8ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:22.939389 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2b686-f90a-498d-86bf-9a9c394fb8ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:22.941127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2b686-f90a-498d-86bf-9a9c394fb8ed service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:22.950593 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1002/2015] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:57:23.378895 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34bdd8-da79-4f91-a7a4-921653c388ca None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:23.381165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-dd34bdd8-da79-4f91-a7a4-921653c388ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:23.392891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34bdd8-da79-4f91-a7a4-921653c388ca None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:23.399011 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:23.399884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:23.400263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:23.400435 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae admin admin] PATH_INFO: `/v3/projects/d9159b1023604de185a0a2400d24e2af` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:23.401669 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9159b1023604de185a0a2400d24e2af)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:23.403547 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:23.520317 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9159b1023604de185a0a2400d24e2af', 'request_id': 'req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:23.527094 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9159b1023604de185a0a2400d24e2af', 'request_id': 'req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:23.592635 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9159b1023604de185a0a2400d24e2af', 'request_id': 'req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:23.603684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae admin admin] The token cache is being invalidate because project d9159b1023604de185a0a2400d24e2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:57:23.603965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:23.604582 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:23.606143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1014/2016] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:57:23 2022] DELETE /identity/v3/projects/d9159b1023604de185a0a2400d24e2af => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:23.610833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2b686-f90a-498d-86bf-9a9c394fb8ed service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:23.620763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2b686-f90a-498d-86bf-9a9c394fb8ed service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:23.638991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:23.676261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40998c-e626-4302-9305-b8e04d4d80dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:23.677195 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40998c-e626-4302-9305-b8e04d4d80dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:23.677680 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40998c-e626-4302-9305-b8e04d4d80dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:23.678279 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40998c-e626-4302-9305-b8e04d4d80dd admin admin] PATH_INFO: `/v3/users/884b3b1df1314231ab0dde0c267f410e` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:23.679778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40998c-e626-4302-9305-b8e04d4d80dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=884b3b1df1314231ab0dde0c267f410e)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:23.681799 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40998c-e626-4302-9305-b8e04d4d80dd admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:23.875846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4f40998c-e626-4302-9305-b8e04d4d80dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884b3b1df1314231ab0dde0c267f410e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:23.888533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4f40998c-e626-4302-9305-b8e04d4d80dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884b3b1df1314231ab0dde0c267f410e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:24.006456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4f40998c-e626-4302-9305-b8e04d4d80dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884b3b1df1314231ab0dde0c267f410e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:24.007655 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4f40998c-e626-4302-9305-b8e04d4d80dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884b3b1df1314231ab0dde0c267f410e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:24.017329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4f40998c-e626-4302-9305-b8e04d4d80dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884b3b1df1314231ab0dde0c267f410e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:24.024535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1003/2017] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:57:23 2022] DELETE /identity/v3/users/884b3b1df1314231ab0dde0c267f410e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:24.475428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:24.477030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:24.492977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf9c6d-2d9e-43d8-b1f1-b586512fa5ae admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:24.558990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c468e1d-f54a-461d-aeae-f5b988a8d22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:24.559890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c468e1d-f54a-461d-aeae-f5b988a8d22c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:24.560174 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c468e1d-f54a-461d-aeae-f5b988a8d22c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:24.560508 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c468e1d-f54a-461d-aeae-f5b988a8d22c admin admin] PATH_INFO: `/v3/projects/d00da6583a6c4c09808e287b922e8bd8` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:24.561807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c468e1d-f54a-461d-aeae-f5b988a8d22c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00da6583a6c4c09808e287b922e8bd8)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:24.568921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c468e1d-f54a-461d-aeae-f5b988a8d22c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:24.674798 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:24.693481 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3c468e1d-f54a-461d-aeae-f5b988a8d22c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00da6583a6c4c09808e287b922e8bd8', 'request_id': 'req-3c468e1d-f54a-461d-aeae-f5b988a8d22c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:24.700063 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3c468e1d-f54a-461d-aeae-f5b988a8d22c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00da6583a6c4c09808e287b922e8bd8', 'request_id': 'req-3c468e1d-f54a-461d-aeae-f5b988a8d22c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:24.782587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3c468e1d-f54a-461d-aeae-f5b988a8d22c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00da6583a6c4c09808e287b922e8bd8', 'request_id': 'req-3c468e1d-f54a-461d-aeae-f5b988a8d22c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:24.797346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3c468e1d-f54a-461d-aeae-f5b988a8d22c admin admin] The token cache is being invalidate because project d00da6583a6c4c09808e287b922e8bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:57:24.798144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3c468e1d-f54a-461d-aeae-f5b988a8d22c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:24.798493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3c468e1d-f54a-461d-aeae-f5b988a8d22c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:24.803380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1015/2018] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:57:24 2022] DELETE /identity/v3/projects/d00da6583a6c4c09808e287b922e8bd8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:24.805192 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f9376-f284-4da8-859b-c7d4c3fc88a8 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:24.805558 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f9376-f284-4da8-859b-c7d4c3fc88a8 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:24.805905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f9376-f284-4da8-859b-c7d4c3fc88a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:24.825476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-6c9f9376-f284-4da8-859b-c7d4c3fc88a8 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:24.826678 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6c9f9376-f284-4da8-859b-c7d4c3fc88a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:24.899285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1004/2019] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:24.908132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f9bbb-b526-4f67-b6d1-217755cbb2b4 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:24.908421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f9bbb-b526-4f67-b6d1-217755cbb2b4 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:24.908731 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f9bbb-b526-4f67-b6d1-217755cbb2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:24.927457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1d5f9bbb-b526-4f67-b6d1-217755cbb2b4 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:24.928731 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1d5f9bbb-b526-4f67-b6d1-217755cbb2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:24.936635 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1016/2020] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:24.941977 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f9376-f284-4da8-859b-c7d4c3fc88a8 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:24.952170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f9376-f284-4da8-859b-c7d4c3fc88a8 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:24.957539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6779799-fe1b-45ec-8d52-8c8d5b5330e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:24.962220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6779799-fe1b-45ec-8d52-8c8d5b5330e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:24.962220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6779799-fe1b-45ec-8d52-8c8d5b5330e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:24.962220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6779799-fe1b-45ec-8d52-8c8d5b5330e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:24.962220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6779799-fe1b-45ec-8d52-8c8d5b5330e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:57:24.962220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6779799-fe1b-45ec-8d52-8c8d5b5330e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:24.962220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6779799-fe1b-45ec-8d52-8c8d5b5330e5 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:24.973269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1005/2021] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:57:24.977696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f9bbb-b526-4f67-b6d1-217755cbb2b4 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:24.987549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f9bbb-b526-4f67-b6d1-217755cbb2b4 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:24.992471 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe66d9-6c40-49f3-82b1-b9973d30a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:24.993083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe66d9-6c40-49f3-82b1-b9973d30a436 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:24.993368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe66d9-6c40-49f3-82b1-b9973d30a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:24.993646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe66d9-6c40-49f3-82b1-b9973d30a436 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:24.994344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe66d9-6c40-49f3-82b1-b9973d30a436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:24.996243 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe66d9-6c40-49f3-82b1-b9973d30a436 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:25.114079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1017/2022] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:57:24 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:57:25.118485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6779799-fe1b-45ec-8d52-8c8d5b5330e5 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:25.131039 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6779799-fe1b-45ec-8d52-8c8d5b5330e5 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:25.165156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:25.198789 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e40fb-61aa-49e6-a4ab-b1553e356ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:25.199469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e40fb-61aa-49e6-a4ab-b1553e356ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:25.199758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e40fb-61aa-49e6-a4ab-b1553e356ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:25.200106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e40fb-61aa-49e6-a4ab-b1553e356ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:25.200852 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e40fb-61aa-49e6-a4ab-b1553e356ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:25.202800 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e40fb-61aa-49e6-a4ab-b1553e356ea8 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:25.278397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1006/2023] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:57:25 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:57:25.282430 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe66d9-6c40-49f3-82b1-b9973d30a436 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:25.292720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe66d9-6c40-49f3-82b1-b9973d30a436 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:25.297816 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cbfb4-f7ad-4d01-9688-1cb50ace3922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:25.298471 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cbfb4-f7ad-4d01-9688-1cb50ace3922 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:25.298753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cbfb4-f7ad-4d01-9688-1cb50ace3922 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:25.299027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cbfb4-f7ad-4d01-9688-1cb50ace3922 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:25.299752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cbfb4-f7ad-4d01-9688-1cb50ace3922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:25.301413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cbfb4-f7ad-4d01-9688-1cb50ace3922 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:25.311732 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1018/2024] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:25.316286 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e40fb-61aa-49e6-a4ab-b1553e356ea8 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:25.325957 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e40fb-61aa-49e6-a4ab-b1553e356ea8 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:25.330435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e638a-5830-48b7-b5f0-460bc99a025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:25.331080 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e638a-5830-48b7-b5f0-460bc99a025d admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:25.331360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e638a-5830-48b7-b5f0-460bc99a025d admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:25.331631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e638a-5830-48b7-b5f0-460bc99a025d admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:25.332349 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e638a-5830-48b7-b5f0-460bc99a025d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:25.333982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e638a-5830-48b7-b5f0-460bc99a025d admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:25.344041 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1007/2025] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:25.347784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cbfb4-f7ad-4d01-9688-1cb50ace3922 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:25.358131 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cbfb4-f7ad-4d01-9688-1cb50ace3922 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:25.363533 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44ed17-6594-4983-9a27-8c6e0afabff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:25.364412 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44ed17-6594-4983-9a27-8c6e0afabff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:25.364721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44ed17-6594-4983-9a27-8c6e0afabff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:25.365003 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44ed17-6594-4983-9a27-8c6e0afabff4 admin admin] PATH_INFO: `/v3/projects/f434d424186d4b2a920cda0e9c1def7f/users/9894ffb887784678954d3988054012a1/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:25.380539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44ed17-6594-4983-9a27-8c6e0afabff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f434d424186d4b2a920cda0e9c1def7f, user_id=9894ffb887784678954d3988054012a1, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:25.383212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44ed17-6594-4983-9a27-8c6e0afabff4 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:25.450201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1019/2026] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:25 2022] PUT /identity/v3/projects/f434d424186d4b2a920cda0e9c1def7f/users/9894ffb887784678954d3988054012a1/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:25.460532 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e2aec-cd33-4b7b-85ed-03a009f52cbb None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:25.460869 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e2aec-cd33-4b7b-85ed-03a009f52cbb None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:25.461145 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e2aec-cd33-4b7b-85ed-03a009f52cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:25.487642 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-955e2aec-cd33-4b7b-85ed-03a009f52cbb None None] MFA Rules not processed for user `9894ffb887784678954d3988054012a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:25.488866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-955e2aec-cd33-4b7b-85ed-03a009f52cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:25.552914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1008/2027] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:25.557308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44ed17-6594-4983-9a27-8c6e0afabff4 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:25.622369 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44ed17-6594-4983-9a27-8c6e0afabff4 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:25.627440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af850656-8ae6-4604-85c6-c764cfd14522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:25.628105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af850656-8ae6-4604-85c6-c764cfd14522 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:25.628390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af850656-8ae6-4604-85c6-c764cfd14522 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:25.628690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af850656-8ae6-4604-85c6-c764cfd14522 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:25.629391 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af850656-8ae6-4604-85c6-c764cfd14522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:25.631292 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af850656-8ae6-4604-85c6-c764cfd14522 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:25.711240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1020/2028] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:57:25 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:25.715097 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e2aec-cd33-4b7b-85ed-03a009f52cbb None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:25.726913 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e2aec-cd33-4b7b-85ed-03a009f52cbb None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:25.790636 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e1fad-8a07-4de5-afe2-e868022ad01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:25.791420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e1fad-8a07-4de5-afe2-e868022ad01c admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:25.791938 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e1fad-8a07-4de5-afe2-e868022ad01c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:25.792286 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e1fad-8a07-4de5-afe2-e868022ad01c admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:25.793160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e1fad-8a07-4de5-afe2-e868022ad01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:25.795125 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e1fad-8a07-4de5-afe2-e868022ad01c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:25.898328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1009/2029] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:57:25 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:25.902322 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af850656-8ae6-4604-85c6-c764cfd14522 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:25.913795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af850656-8ae6-4604-85c6-c764cfd14522 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:25.922469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236ee6a-0755-4c7c-8742-19a88790febe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:25.923135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236ee6a-0755-4c7c-8742-19a88790febe admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:25.923413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236ee6a-0755-4c7c-8742-19a88790febe admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:25.923686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236ee6a-0755-4c7c-8742-19a88790febe admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:25.924410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236ee6a-0755-4c7c-8742-19a88790febe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:25.926010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236ee6a-0755-4c7c-8742-19a88790febe admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:25.936817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1021/2030] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:25.941213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e1fad-8a07-4de5-afe2-e868022ad01c admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:25.951074 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e1fad-8a07-4de5-afe2-e868022ad01c admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:25.956622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12f722-467b-4598-8e05-a41956c7d395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:25.957523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12f722-467b-4598-8e05-a41956c7d395 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:25.957802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12f722-467b-4598-8e05-a41956c7d395 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:25.958076 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12f722-467b-4598-8e05-a41956c7d395 admin admin] PATH_INFO: `/v3/projects/fa5822821e7b43888482cf15d213f719/users/44533d628a7b4fc8b313e57b6887eb1d/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:25.973028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12f722-467b-4598-8e05-a41956c7d395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5822821e7b43888482cf15d213f719, user_id=44533d628a7b4fc8b313e57b6887eb1d, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:25.975658 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12f722-467b-4598-8e05-a41956c7d395 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:26.034959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1010/2031] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:25 2022] PUT /identity/v3/projects/fa5822821e7b43888482cf15d213f719/users/44533d628a7b4fc8b313e57b6887eb1d/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:26.038871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236ee6a-0755-4c7c-8742-19a88790febe admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:26.049832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236ee6a-0755-4c7c-8742-19a88790febe admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:26.070403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:26.106442 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0ec98-2fda-4f3d-b848-66549a1e14be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:26.107423 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0ec98-2fda-4f3d-b848-66549a1e14be admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:26.108085 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0ec98-2fda-4f3d-b848-66549a1e14be admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:26.109552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0ec98-2fda-4f3d-b848-66549a1e14be admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:26.110310 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0ec98-2fda-4f3d-b848-66549a1e14be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:26.111910 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0ec98-2fda-4f3d-b848-66549a1e14be admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:26.121896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1022/2032] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:26.126852 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12f722-467b-4598-8e05-a41956c7d395 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:26.132320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:26.137659 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12f722-467b-4598-8e05-a41956c7d395 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:26.142210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc4823-36b4-40f8-8776-ed01200761cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:26.143164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc4823-36b4-40f8-8776-ed01200761cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:26.143441 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc4823-36b4-40f8-8776-ed01200761cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:26.143706 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc4823-36b4-40f8-8776-ed01200761cc admin admin] PATH_INFO: `/v3/projects/fa5822821e7b43888482cf15d213f719/users/44533d628a7b4fc8b313e57b6887eb1d/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:26.146339 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc4823-36b4-40f8-8776-ed01200761cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5822821e7b43888482cf15d213f719, user_id=44533d628a7b4fc8b313e57b6887eb1d, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:26.148681 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc4823-36b4-40f8-8776-ed01200761cc admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:26.160238 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1011/2033] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:26 2022] PUT /identity/v3/projects/fa5822821e7b43888482cf15d213f719/users/44533d628a7b4fc8b313e57b6887eb1d/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:57:26.170554 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba9b79-933d-4f92-86f4-8fef9bcbdd1c None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:26.170846 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba9b79-933d-4f92-86f4-8fef9bcbdd1c None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:26.171340 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba9b79-933d-4f92-86f4-8fef9bcbdd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:26.199648 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-fdba9b79-933d-4f92-86f4-8fef9bcbdd1c None None] MFA Rules not processed for user `44533d628a7b4fc8b313e57b6887eb1d`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:26.201136 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-fdba9b79-933d-4f92-86f4-8fef9bcbdd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:26.277538 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1023/2034] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:26.289554 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc4823-36b4-40f8-8776-ed01200761cc admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:26.291468 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-40bc4823-36b4-40f8-8776-ed01200761cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:26.358086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc4823-36b4-40f8-8776-ed01200761cc admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:26.362920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1271e-857a-4174-baa5-331bb1f13696 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:26.363600 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1271e-857a-4174-baa5-331bb1f13696 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:26.363883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1271e-857a-4174-baa5-331bb1f13696 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:26.364184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1271e-857a-4174-baa5-331bb1f13696 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:26.374284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1271e-857a-4174-baa5-331bb1f13696 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:26.376000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1271e-857a-4174-baa5-331bb1f13696 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:26.385871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1012/2035] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:57:26.683744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba9b79-933d-4f92-86f4-8fef9bcbdd1c None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:26.693720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba9b79-933d-4f92-86f4-8fef9bcbdd1c None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:26.697218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccff20-e8f3-4f2a-867e-f51a0e68c88f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:26.697860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccff20-e8f3-4f2a-867e-f51a0e68c88f service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:26.698141 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccff20-e8f3-4f2a-867e-f51a0e68c88f service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:26.698453 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccff20-e8f3-4f2a-867e-f51a0e68c88f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:26.756179 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccff20-e8f3-4f2a-867e-f51a0e68c88f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:26.757665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccff20-e8f3-4f2a-867e-f51a0e68c88f service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:26.767462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1024/2036] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:57:34.443156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1271e-857a-4174-baa5-331bb1f13696 service cinder] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:34.445012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-09e1271e-857a-4174-baa5-331bb1f13696 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:34.523806 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1271e-857a-4174-baa5-331bb1f13696 service cinder] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:34.528516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9cc74-893a-46c5-a676-6bec5ecb1bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:34.540994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9cc74-893a-46c5-a676-6bec5ecb1bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:34.540994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9cc74-893a-46c5-a676-6bec5ecb1bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:34.540994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9cc74-893a-46c5-a676-6bec5ecb1bd2 admin admin] PATH_INFO: `/v3/users/f41c923ea50c46fbb0fe8a891e1bbff2` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:34.540994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9cc74-893a-46c5-a676-6bec5ecb1bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f41c923ea50c46fbb0fe8a891e1bbff2)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:34.540994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9cc74-893a-46c5-a676-6bec5ecb1bd2 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:34.710555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ceb9cc74-893a-46c5-a676-6bec5ecb1bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f41c923ea50c46fbb0fe8a891e1bbff2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:34.723236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ceb9cc74-893a-46c5-a676-6bec5ecb1bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f41c923ea50c46fbb0fe8a891e1bbff2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:34.792910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ceb9cc74-893a-46c5-a676-6bec5ecb1bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f41c923ea50c46fbb0fe8a891e1bbff2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:34.793684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ceb9cc74-893a-46c5-a676-6bec5ecb1bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f41c923ea50c46fbb0fe8a891e1bbff2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:34.802622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ceb9cc74-893a-46c5-a676-6bec5ecb1bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f41c923ea50c46fbb0fe8a891e1bbff2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:34.809130 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1013/2037] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:57:34 2022] DELETE /identity/v3/users/f41c923ea50c46fbb0fe8a891e1bbff2 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:34.814607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b80b6b-e388-4bb5-bbd6-80ec45407715 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:34.815484 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b80b6b-e388-4bb5-bbd6-80ec45407715 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:34.815484 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b80b6b-e388-4bb5-bbd6-80ec45407715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:34.833385 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-25b80b6b-e388-4bb5-bbd6-80ec45407715 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:34.834591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-25b80b6b-e388-4bb5-bbd6-80ec45407715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:34.877170 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:34.895984 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1025/2038] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:34.905755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9cc74-893a-46c5-a676-6bec5ecb1bd2 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:34.907225 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ceb9cc74-893a-46c5-a676-6bec5ecb1bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:34.921048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:34.979618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9cc74-893a-46c5-a676-6bec5ecb1bd2 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:34.988261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f98ed-04e6-4731-bd9a-2506a2dd59aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:34.988958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f98ed-04e6-4731-bd9a-2506a2dd59aa service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:34.989243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f98ed-04e6-4731-bd9a-2506a2dd59aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:34.989523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f98ed-04e6-4731-bd9a-2506a2dd59aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:35.001028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f98ed-04e6-4731-bd9a-2506a2dd59aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:35.002612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f98ed-04e6-4731-bd9a-2506a2dd59aa service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:35.012847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1014/2039] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:57:35.474469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b80b6b-e388-4bb5-bbd6-80ec45407715 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:35.479170 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-25b80b6b-e388-4bb5-bbd6-80ec45407715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:35.490423 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b80b6b-e388-4bb5-bbd6-80ec45407715 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:35.496790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adda3c6-0808-436d-91e9-86b497156b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:35.497669 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda3c6-0808-436d-91e9-86b497156b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:35.497953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda3c6-0808-436d-91e9-86b497156b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:35.498340 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda3c6-0808-436d-91e9-86b497156b3e admin admin] PATH_INFO: `/v3/projects/732be01709f8467db7e0c3cadeac84ec` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:35.499536 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adda3c6-0808-436d-91e9-86b497156b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=732be01709f8467db7e0c3cadeac84ec)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:35.502198 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adda3c6-0808-436d-91e9-86b497156b3e admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:35.650774 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3adda3c6-0808-436d-91e9-86b497156b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732be01709f8467db7e0c3cadeac84ec', 'request_id': 'req-3adda3c6-0808-436d-91e9-86b497156b3e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:35.657109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3adda3c6-0808-436d-91e9-86b497156b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732be01709f8467db7e0c3cadeac84ec', 'request_id': 'req-3adda3c6-0808-436d-91e9-86b497156b3e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:35.737406 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3adda3c6-0808-436d-91e9-86b497156b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732be01709f8467db7e0c3cadeac84ec', 'request_id': 'req-3adda3c6-0808-436d-91e9-86b497156b3e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:35.748873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3adda3c6-0808-436d-91e9-86b497156b3e admin admin] The token cache is being invalidate because project 732be01709f8467db7e0c3cadeac84ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:57:35.749196 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3adda3c6-0808-436d-91e9-86b497156b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:35.749856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3adda3c6-0808-436d-91e9-86b497156b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:35.752472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1026/2040] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:57:35 2022] DELETE /identity/v3/projects/732be01709f8467db7e0c3cadeac84ec => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:35.757584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041ce37-a8e4-4a83-9dee-35503157725e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:35.758071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041ce37-a8e4-4a83-9dee-35503157725e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:35.758233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041ce37-a8e4-4a83-9dee-35503157725e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:35.777244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-e041ce37-a8e4-4a83-9dee-35503157725e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:35.778625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-e041ce37-a8e4-4a83-9dee-35503157725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:35.840987 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1015/2041] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:57:35.848787 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7b2e0-de47-4592-98e8-1f383e8f6bdf None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:35.849292 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7b2e0-de47-4592-98e8-1f383e8f6bdf None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:35.849392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7b2e0-de47-4592-98e8-1f383e8f6bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:35.869149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a6f7b2e0-de47-4592-98e8-1f383e8f6bdf None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:35.870350 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a6f7b2e0-de47-4592-98e8-1f383e8f6bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:35.879306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1027/2042] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:35.883753 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041ce37-a8e4-4a83-9dee-35503157725e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:35.893878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041ce37-a8e4-4a83-9dee-35503157725e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:35.898963 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260002a9-6a59-4290-94e2-a8764ace36a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:35.899665 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260002a9-6a59-4290-94e2-a8764ace36a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:35.899932 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260002a9-6a59-4290-94e2-a8764ace36a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:35.900209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260002a9-6a59-4290-94e2-a8764ace36a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:35.900997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260002a9-6a59-4290-94e2-a8764ace36a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:57:35.901305 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260002a9-6a59-4290-94e2-a8764ace36a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:35.904821 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260002a9-6a59-4290-94e2-a8764ace36a9 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:35.917057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1016/2043] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:57:35.920918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7b2e0-de47-4592-98e8-1f383e8f6bdf None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:35.930893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7b2e0-de47-4592-98e8-1f383e8f6bdf None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:35.936617 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28f474-2283-45f4-9680-eec52d42900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:35.937339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28f474-2283-45f4-9680-eec52d42900b admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:35.937759 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28f474-2283-45f4-9680-eec52d42900b admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:35.938113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28f474-2283-45f4-9680-eec52d42900b admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:35.938904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28f474-2283-45f4-9680-eec52d42900b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:35.940979 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28f474-2283-45f4-9680-eec52d42900b admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:36.040063 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1028/2044] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:57:35 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:36.044018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260002a9-6a59-4290-94e2-a8764ace36a9 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:36.058394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260002a9-6a59-4290-94e2-a8764ace36a9 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:36.119811 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352e013-00cc-44a5-b317-a03de10cf3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:36.120480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352e013-00cc-44a5-b317-a03de10cf3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:36.120793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352e013-00cc-44a5-b317-a03de10cf3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:36.121072 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352e013-00cc-44a5-b317-a03de10cf3f9 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:36.122325 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352e013-00cc-44a5-b317-a03de10cf3f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:36.124267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352e013-00cc-44a5-b317-a03de10cf3f9 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:36.241344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1017/2045] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:57:36 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:36.245128 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28f474-2283-45f4-9680-eec52d42900b admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:36.255578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28f474-2283-45f4-9680-eec52d42900b admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:36.259983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817a539-eef4-4c63-9e7d-733bd49032ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:36.260626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817a539-eef4-4c63-9e7d-733bd49032ad admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:36.260943 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817a539-eef4-4c63-9e7d-733bd49032ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:36.261219 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817a539-eef4-4c63-9e7d-733bd49032ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:36.261987 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817a539-eef4-4c63-9e7d-733bd49032ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:36.263557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817a539-eef4-4c63-9e7d-733bd49032ad admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:36.274704 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1029/2046] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:36.278540 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352e013-00cc-44a5-b317-a03de10cf3f9 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:36.289791 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352e013-00cc-44a5-b317-a03de10cf3f9 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:36.294645 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676366f2-0a36-479b-871a-b2cb3d56e6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:36.295252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676366f2-0a36-479b-871a-b2cb3d56e6be admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:36.301555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676366f2-0a36-479b-871a-b2cb3d56e6be admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:36.301555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676366f2-0a36-479b-871a-b2cb3d56e6be admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:36.301555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676366f2-0a36-479b-871a-b2cb3d56e6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:36.301555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676366f2-0a36-479b-871a-b2cb3d56e6be admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:36.308961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1018/2047] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:36.313031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817a539-eef4-4c63-9e7d-733bd49032ad admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:36.323104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817a539-eef4-4c63-9e7d-733bd49032ad admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:36.327686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90269a4-2940-487a-80f6-e6669da9e941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:36.329115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90269a4-2940-487a-80f6-e6669da9e941 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:36.329437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90269a4-2940-487a-80f6-e6669da9e941 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:36.329667 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90269a4-2940-487a-80f6-e6669da9e941 admin admin] PATH_INFO: `/v3/projects/1857e1a325c9434fa9e74f4ef7e24eb1/users/be4063aea3854b879564ce90d7510b18/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:36.345733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90269a4-2940-487a-80f6-e6669da9e941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1857e1a325c9434fa9e74f4ef7e24eb1, user_id=be4063aea3854b879564ce90d7510b18, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:36.348515 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90269a4-2940-487a-80f6-e6669da9e941 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:36.433098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1030/2048] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:36 2022] PUT /identity/v3/projects/1857e1a325c9434fa9e74f4ef7e24eb1/users/be4063aea3854b879564ce90d7510b18/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:36.451562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23da23-fa89-4ebb-968b-6e4993fbd7e0 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:36.451854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23da23-fa89-4ebb-968b-6e4993fbd7e0 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:36.452138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23da23-fa89-4ebb-968b-6e4993fbd7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:36.480794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-5e23da23-fa89-4ebb-968b-6e4993fbd7e0 None None] MFA Rules not processed for user `be4063aea3854b879564ce90d7510b18`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:36.482013 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-5e23da23-fa89-4ebb-968b-6e4993fbd7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:36.490504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:36.547812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1019/2049] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:36.558568 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90269a4-2940-487a-80f6-e6669da9e941 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:36.560549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f90269a4-2940-487a-80f6-e6669da9e941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:36.620632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90269a4-2940-487a-80f6-e6669da9e941 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:36.624817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e5ddf-46d2-4e26-9e9a-c9d3c53242e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:36.632615 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e5ddf-46d2-4e26-9e9a-c9d3c53242e5 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:36.632615 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e5ddf-46d2-4e26-9e9a-c9d3c53242e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:36.632615 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e5ddf-46d2-4e26-9e9a-c9d3c53242e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:36.634850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e5ddf-46d2-4e26-9e9a-c9d3c53242e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:36.636277 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e5ddf-46d2-4e26-9e9a-c9d3c53242e5 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:36.645944 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1031/2050] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:57:44.860990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23da23-fa89-4ebb-968b-6e4993fbd7e0 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:44.926274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23da23-fa89-4ebb-968b-6e4993fbd7e0 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:44.930900 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62873dcc-131f-4735-be32-97f12b5f59a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:44.931763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62873dcc-131f-4735-be32-97f12b5f59a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:44.932050 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62873dcc-131f-4735-be32-97f12b5f59a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:44.932328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62873dcc-131f-4735-be32-97f12b5f59a9 admin admin] PATH_INFO: `/v3/users/be4063aea3854b879564ce90d7510b18` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:44.933565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62873dcc-131f-4735-be32-97f12b5f59a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be4063aea3854b879564ce90d7510b18)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:44.935483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62873dcc-131f-4735-be32-97f12b5f59a9 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:45.101700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-62873dcc-131f-4735-be32-97f12b5f59a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be4063aea3854b879564ce90d7510b18'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:45.117453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-62873dcc-131f-4735-be32-97f12b5f59a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be4063aea3854b879564ce90d7510b18'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:45.194531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-62873dcc-131f-4735-be32-97f12b5f59a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be4063aea3854b879564ce90d7510b18'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:45.195173 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-62873dcc-131f-4735-be32-97f12b5f59a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be4063aea3854b879564ce90d7510b18'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:45.202892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-62873dcc-131f-4735-be32-97f12b5f59a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be4063aea3854b879564ce90d7510b18'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:45.209781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1020/2051] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:57:44 2022] DELETE /identity/v3/users/be4063aea3854b879564ce90d7510b18 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:45.214274 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75aa01-cbc1-481f-b7bf-173c98fbc661 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:45.214772 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75aa01-cbc1-481f-b7bf-173c98fbc661 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:45.214983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75aa01-cbc1-481f-b7bf-173c98fbc661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:45.232936 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:45.239680 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-bf75aa01-cbc1-481f-b7bf-173c98fbc661 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:45.241064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-bf75aa01-cbc1-481f-b7bf-173c98fbc661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:45.309481 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1032/2052] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:57:45.320220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62873dcc-131f-4735-be32-97f12b5f59a9 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:45.321707 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-62873dcc-131f-4735-be32-97f12b5f59a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:45.356936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:45.386685 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62873dcc-131f-4735-be32-97f12b5f59a9 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:45.390966 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df6a4d-9c95-4bec-83bf-51779b27096d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:45.391626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df6a4d-9c95-4bec-83bf-51779b27096d service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:45.391911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df6a4d-9c95-4bec-83bf-51779b27096d service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:45.392186 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df6a4d-9c95-4bec-83bf-51779b27096d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:45.402968 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df6a4d-9c95-4bec-83bf-51779b27096d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:45.404395 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df6a4d-9c95-4bec-83bf-51779b27096d service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:45.420912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1021/2053] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:57:46.057402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75aa01-cbc1-481f-b7bf-173c98fbc661 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:46.059001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-bf75aa01-cbc1-481f-b7bf-173c98fbc661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:46.071977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75aa01-cbc1-481f-b7bf-173c98fbc661 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:46.076828 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afdecc-f4c6-407f-aacd-25f827af85ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:46.077866 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afdecc-f4c6-407f-aacd-25f827af85ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:46.078054 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afdecc-f4c6-407f-aacd-25f827af85ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:46.078528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afdecc-f4c6-407f-aacd-25f827af85ab admin admin] PATH_INFO: `/v3/projects/1857e1a325c9434fa9e74f4ef7e24eb1` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:46.079736 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27afdecc-f4c6-407f-aacd-25f827af85ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=1857e1a325c9434fa9e74f4ef7e24eb1)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:46.082596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27afdecc-f4c6-407f-aacd-25f827af85ab admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:46.212669 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-27afdecc-f4c6-407f-aacd-25f827af85ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1857e1a325c9434fa9e74f4ef7e24eb1', 'request_id': 'req-27afdecc-f4c6-407f-aacd-25f827af85ab'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:46.218698 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-27afdecc-f4c6-407f-aacd-25f827af85ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1857e1a325c9434fa9e74f4ef7e24eb1', 'request_id': 'req-27afdecc-f4c6-407f-aacd-25f827af85ab'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:46.288013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-27afdecc-f4c6-407f-aacd-25f827af85ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1857e1a325c9434fa9e74f4ef7e24eb1', 'request_id': 'req-27afdecc-f4c6-407f-aacd-25f827af85ab'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:46.302750 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-27afdecc-f4c6-407f-aacd-25f827af85ab admin admin] The token cache is being invalidate because project 1857e1a325c9434fa9e74f4ef7e24eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:57:46.303084 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-27afdecc-f4c6-407f-aacd-25f827af85ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:46.303753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-27afdecc-f4c6-407f-aacd-25f827af85ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:46.305721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1033/2054] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:57:46 2022] DELETE /identity/v3/projects/1857e1a325c9434fa9e74f4ef7e24eb1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:46.310501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008aa90-36ba-4930-a651-cbf6621e0d4e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:46.311759 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008aa90-36ba-4930-a651-cbf6621e0d4e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:46.312068 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008aa90-36ba-4930-a651-cbf6621e0d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:46.333360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-7008aa90-36ba-4930-a651-cbf6621e0d4e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:46.334562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7008aa90-36ba-4930-a651-cbf6621e0d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:46.398590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1022/2055] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:46.406569 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647c477-faba-4a4d-864d-55b9a0579f86 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:46.406864 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647c477-faba-4a4d-864d-55b9a0579f86 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:46.407146 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647c477-faba-4a4d-864d-55b9a0579f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:46.426482 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-c647c477-faba-4a4d-864d-55b9a0579f86 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:46.427741 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-c647c477-faba-4a4d-864d-55b9a0579f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:46.437275 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1034/2056] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:46.442687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008aa90-36ba-4930-a651-cbf6621e0d4e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:46.458092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008aa90-36ba-4930-a651-cbf6621e0d4e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:46.464822 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de149c9b-94ce-488b-80e8-f0884c9ec81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:46.465431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de149c9b-94ce-488b-80e8-f0884c9ec81c admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:46.465715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de149c9b-94ce-488b-80e8-f0884c9ec81c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:46.465991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de149c9b-94ce-488b-80e8-f0884c9ec81c admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:46.466727 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de149c9b-94ce-488b-80e8-f0884c9ec81c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:57:46.467034 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de149c9b-94ce-488b-80e8-f0884c9ec81c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:46.468786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de149c9b-94ce-488b-80e8-f0884c9ec81c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:46.482648 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1023/2057] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:57:46.487319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647c477-faba-4a4d-864d-55b9a0579f86 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:46.498181 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647c477-faba-4a4d-864d-55b9a0579f86 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:46.505644 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2a180-9ba7-4c3e-8a53-1bb8e4f09efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:46.506323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2a180-9ba7-4c3e-8a53-1bb8e4f09efe admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:46.506607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2a180-9ba7-4c3e-8a53-1bb8e4f09efe admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:46.506882 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2a180-9ba7-4c3e-8a53-1bb8e4f09efe admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:46.507590 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2a180-9ba7-4c3e-8a53-1bb8e4f09efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:46.509747 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2a180-9ba7-4c3e-8a53-1bb8e4f09efe admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:46.625674 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1035/2058] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:57:46 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:46.630807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de149c9b-94ce-488b-80e8-f0884c9ec81c admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:46.641764 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de149c9b-94ce-488b-80e8-f0884c9ec81c admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:46.716283 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c60c0-853f-4cc1-a929-1a9713df47e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:46.716923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c60c0-853f-4cc1-a929-1a9713df47e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:46.717259 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c60c0-853f-4cc1-a929-1a9713df47e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:46.717544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c60c0-853f-4cc1-a929-1a9713df47e4 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:46.718324 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c60c0-853f-4cc1-a929-1a9713df47e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:46.720175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c60c0-853f-4cc1-a929-1a9713df47e4 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:46.829030 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1024/2059] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:57:46 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:46.834603 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2a180-9ba7-4c3e-8a53-1bb8e4f09efe admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:46.846637 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2a180-9ba7-4c3e-8a53-1bb8e4f09efe admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:46.857306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccc971-0a0c-4330-9b77-bbf175a4106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:46.858082 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccc971-0a0c-4330-9b77-bbf175a4106a admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:46.858459 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccc971-0a0c-4330-9b77-bbf175a4106a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:46.858827 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccc971-0a0c-4330-9b77-bbf175a4106a admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:46.868162 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccc971-0a0c-4330-9b77-bbf175a4106a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:46.870504 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccc971-0a0c-4330-9b77-bbf175a4106a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:46.892609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1036/2060] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:46.897999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c60c0-853f-4cc1-a929-1a9713df47e4 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:46.908071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c60c0-853f-4cc1-a929-1a9713df47e4 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:46.912990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4ccd4-ac9e-4798-9ae2-da75ea2207bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:46.913646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4ccd4-ac9e-4798-9ae2-da75ea2207bc admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:46.913928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4ccd4-ac9e-4798-9ae2-da75ea2207bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:46.914203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4ccd4-ac9e-4798-9ae2-da75ea2207bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:46.914960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4ccd4-ac9e-4798-9ae2-da75ea2207bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:46.916678 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4ccd4-ac9e-4798-9ae2-da75ea2207bc admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:46.928699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1025/2061] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:46.932605 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccc971-0a0c-4330-9b77-bbf175a4106a admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:46.944169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccc971-0a0c-4330-9b77-bbf175a4106a admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:46.949229 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8754d-9aa2-4799-82ac-25dcbf97f1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:46.950195 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8754d-9aa2-4799-82ac-25dcbf97f1ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:46.950544 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8754d-9aa2-4799-82ac-25dcbf97f1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:46.950889 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8754d-9aa2-4799-82ac-25dcbf97f1ef admin admin] PATH_INFO: `/v3/projects/0b79598ec54243258d2f2f589be4940d/users/ef044785763a4bc4be4a1ffd4ea5290f/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:46.967145 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8754d-9aa2-4799-82ac-25dcbf97f1ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b79598ec54243258d2f2f589be4940d, user_id=ef044785763a4bc4be4a1ffd4ea5290f, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:46.972743 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8754d-9aa2-4799-82ac-25dcbf97f1ef admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:47.072722 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1037/2062] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:46 2022] PUT /identity/v3/projects/0b79598ec54243258d2f2f589be4940d/users/ef044785763a4bc4be4a1ffd4ea5290f/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:47.077850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e5fb1-dae6-465f-88dc-e42b48e70c3e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:47.078249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e5fb1-dae6-465f-88dc-e42b48e70c3e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:47.078633 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e5fb1-dae6-465f-88dc-e42b48e70c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:47.112337 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-616e5fb1-dae6-465f-88dc-e42b48e70c3e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:47.114566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-616e5fb1-dae6-465f-88dc-e42b48e70c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:47.158409 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:47.180916 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8754d-9aa2-4799-82ac-25dcbf97f1ef admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:47.183125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f5f8754d-9aa2-4799-82ac-25dcbf97f1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:47.196203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1026/2063] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:47.208389 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e5fb1-dae6-465f-88dc-e42b48e70c3e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:47.209912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-616e5fb1-dae6-465f-88dc-e42b48e70c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:47.223718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:47.260853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8754d-9aa2-4799-82ac-25dcbf97f1ef admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:47.266998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c475f92-0617-4921-a01e-37174063f8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:47.268341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c475f92-0617-4921-a01e-37174063f8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:47.269331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c475f92-0617-4921-a01e-37174063f8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:47.269761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c475f92-0617-4921-a01e-37174063f8dc admin admin] PATH_INFO: `/v3/users/9894ffb887784678954d3988054012a1` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:47.271801 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c475f92-0617-4921-a01e-37174063f8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9894ffb887784678954d3988054012a1)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:47.275072 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c475f92-0617-4921-a01e-37174063f8dc admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:47.310004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e5fb1-dae6-465f-88dc-e42b48e70c3e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:47.312494 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60def7-205e-49dd-8234-eb65302e77ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:47.313222 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60def7-205e-49dd-8234-eb65302e77ae service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:47.313581 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60def7-205e-49dd-8234-eb65302e77ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:47.314020 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60def7-205e-49dd-8234-eb65302e77ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:47.326047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60def7-205e-49dd-8234-eb65302e77ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:47.327603 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60def7-205e-49dd-8234-eb65302e77ae service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:47.338709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1027/2064] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:57:47.497828 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3c475f92-0617-4921-a01e-37174063f8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9894ffb887784678954d3988054012a1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:47.513269 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3c475f92-0617-4921-a01e-37174063f8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9894ffb887784678954d3988054012a1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:47.571724 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3c475f92-0617-4921-a01e-37174063f8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9894ffb887784678954d3988054012a1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:47.572338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3c475f92-0617-4921-a01e-37174063f8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9894ffb887784678954d3988054012a1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:47.579843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3c475f92-0617-4921-a01e-37174063f8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9894ffb887784678954d3988054012a1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:47.586469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1038/2065] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:57:47 2022] DELETE /identity/v3/users/9894ffb887784678954d3988054012a1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:57:47.591223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92873029-34a9-411f-ad85-b49eb64b1502 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:47.591516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92873029-34a9-411f-ad85-b49eb64b1502 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:47.591794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92873029-34a9-411f-ad85-b49eb64b1502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:47.610829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-92873029-34a9-411f-ad85-b49eb64b1502 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:47.612022 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-92873029-34a9-411f-ad85-b49eb64b1502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:47.674872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1028/2066] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:47.685024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c475f92-0617-4921-a01e-37174063f8dc admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:47.686657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-3c475f92-0617-4921-a01e-37174063f8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:47.749120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c475f92-0617-4921-a01e-37174063f8dc admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:47.761921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0fc06-4c61-450a-822c-22f7cf75f81a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:47.761921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0fc06-4c61-450a-822c-22f7cf75f81a service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:47.761921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0fc06-4c61-450a-822c-22f7cf75f81a service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:47.761921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0fc06-4c61-450a-822c-22f7cf75f81a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:47.766811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0fc06-4c61-450a-822c-22f7cf75f81a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:47.768366 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0fc06-4c61-450a-822c-22f7cf75f81a service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:47.779554 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1039/2067] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:57:48.242306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92873029-34a9-411f-ad85-b49eb64b1502 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:48.243741 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-92873029-34a9-411f-ad85-b49eb64b1502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:48.280757 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92873029-34a9-411f-ad85-b49eb64b1502 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:48.285525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fafde-df46-4ded-9496-d91009b9d21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:48.286402 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fafde-df46-4ded-9496-d91009b9d21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:48.286684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fafde-df46-4ded-9496-d91009b9d21c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:48.286959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fafde-df46-4ded-9496-d91009b9d21c admin admin] PATH_INFO: `/v3/projects/f434d424186d4b2a920cda0e9c1def7f` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:48.288217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fafde-df46-4ded-9496-d91009b9d21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f434d424186d4b2a920cda0e9c1def7f)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:48.290161 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fafde-df46-4ded-9496-d91009b9d21c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:48.410903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b35fafde-df46-4ded-9496-d91009b9d21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f434d424186d4b2a920cda0e9c1def7f', 'request_id': 'req-b35fafde-df46-4ded-9496-d91009b9d21c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:48.458657 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b35fafde-df46-4ded-9496-d91009b9d21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f434d424186d4b2a920cda0e9c1def7f', 'request_id': 'req-b35fafde-df46-4ded-9496-d91009b9d21c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:48.466123 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b35fafde-df46-4ded-9496-d91009b9d21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f434d424186d4b2a920cda0e9c1def7f', 'request_id': 'req-b35fafde-df46-4ded-9496-d91009b9d21c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:48.483579 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b35fafde-df46-4ded-9496-d91009b9d21c admin admin] The token cache is being invalidate because project f434d424186d4b2a920cda0e9c1def7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:57:48.484260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b35fafde-df46-4ded-9496-d91009b9d21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:48.485148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b35fafde-df46-4ded-9496-d91009b9d21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:48.487245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1029/2068] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:57:48 2022] DELETE /identity/v3/projects/f434d424186d4b2a920cda0e9c1def7f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:48.491530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0fc06-4c61-450a-822c-22f7cf75f81a service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:48.504182 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0fc06-4c61-450a-822c-22f7cf75f81a service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:48.576565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:48.589773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3f117-3b89-44e2-85a4-65aaf205fe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:48.590794 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3f117-3b89-44e2-85a4-65aaf205fe71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:48.591087 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3f117-3b89-44e2-85a4-65aaf205fe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:48.591368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3f117-3b89-44e2-85a4-65aaf205fe71 admin admin] PATH_INFO: `/v3/users/44533d628a7b4fc8b313e57b6887eb1d` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:48.592609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3f117-3b89-44e2-85a4-65aaf205fe71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44533d628a7b4fc8b313e57b6887eb1d)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:48.594579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3f117-3b89-44e2-85a4-65aaf205fe71 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:48.788427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da48d12-d590-4b97-b9bd-68925e109f8f None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:48.788743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da48d12-d590-4b97-b9bd-68925e109f8f None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:48.789023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da48d12-d590-4b97-b9bd-68925e109f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:48.797252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:48.821029 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b9e3f117-3b89-44e2-85a4-65aaf205fe71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44533d628a7b4fc8b313e57b6887eb1d'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:48.827954 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-4da48d12-d590-4b97-b9bd-68925e109f8f None None] MFA Rules not processed for user `ef044785763a4bc4be4a1ffd4ea5290f`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:48.827954 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-4da48d12-d590-4b97-b9bd-68925e109f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:48.839080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b9e3f117-3b89-44e2-85a4-65aaf205fe71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44533d628a7b4fc8b313e57b6887eb1d'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:48.897011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1030/2069] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:57:48.908158 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da48d12-d590-4b97-b9bd-68925e109f8f None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:48.908873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b9e3f117-3b89-44e2-85a4-65aaf205fe71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44533d628a7b4fc8b313e57b6887eb1d'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:48.909592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-4da48d12-d590-4b97-b9bd-68925e109f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:48.909733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b9e3f117-3b89-44e2-85a4-65aaf205fe71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44533d628a7b4fc8b313e57b6887eb1d'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:48.918085 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b9e3f117-3b89-44e2-85a4-65aaf205fe71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44533d628a7b4fc8b313e57b6887eb1d'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:48.929718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1040/2070] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:57:48 2022] DELETE /identity/v3/users/44533d628a7b4fc8b313e57b6887eb1d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:48.981792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da48d12-d590-4b97-b9bd-68925e109f8f None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:49.056665 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f169602-dd91-4b65-a215-bd019f789f46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:49.057393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f169602-dd91-4b65-a215-bd019f789f46 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:49.057678 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f169602-dd91-4b65-a215-bd019f789f46 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:49.058036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f169602-dd91-4b65-a215-bd019f789f46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:49.061351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7f169602-dd91-4b65-a215-bd019f789f46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:49.136429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f169602-dd91-4b65-a215-bd019f789f46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:49.137967 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f169602-dd91-4b65-a215-bd019f789f46 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:49.148190 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1031/2071] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:57:49.493807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3f117-3b89-44e2-85a4-65aaf205fe71 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:49.495462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b9e3f117-3b89-44e2-85a4-65aaf205fe71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:49.565973 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3f117-3b89-44e2-85a4-65aaf205fe71 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:49.571690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f76a9f-504c-4d89-80e1-40b5d96affef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:49.572769 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f76a9f-504c-4d89-80e1-40b5d96affef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:49.573268 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f76a9f-504c-4d89-80e1-40b5d96affef admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:49.573703 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f76a9f-504c-4d89-80e1-40b5d96affef admin admin] PATH_INFO: `/v3/projects/fa5822821e7b43888482cf15d213f719` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:49.574996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f76a9f-504c-4d89-80e1-40b5d96affef admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa5822821e7b43888482cf15d213f719)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:49.577321 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f76a9f-504c-4d89-80e1-40b5d96affef admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:49.705695 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-89f76a9f-504c-4d89-80e1-40b5d96affef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa5822821e7b43888482cf15d213f719', 'request_id': 'req-89f76a9f-504c-4d89-80e1-40b5d96affef'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:49.713027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-89f76a9f-504c-4d89-80e1-40b5d96affef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa5822821e7b43888482cf15d213f719', 'request_id': 'req-89f76a9f-504c-4d89-80e1-40b5d96affef'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:49.805401 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-89f76a9f-504c-4d89-80e1-40b5d96affef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa5822821e7b43888482cf15d213f719', 'request_id': 'req-89f76a9f-504c-4d89-80e1-40b5d96affef'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:49.817516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:49.822205 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-89f76a9f-504c-4d89-80e1-40b5d96affef admin admin] The token cache is being invalidate because project fa5822821e7b43888482cf15d213f719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:57:49.822498 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-89f76a9f-504c-4d89-80e1-40b5d96affef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:49.825307 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-89f76a9f-504c-4d89-80e1-40b5d96affef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:49.827114 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1041/2072] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:57:49 2022] DELETE /identity/v3/projects/fa5822821e7b43888482cf15d213f719 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:49.832445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101f6ef-acf6-4e2a-a370-4726ba7efee6 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:49.832951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101f6ef-acf6-4e2a-a370-4726ba7efee6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:49.833066 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101f6ef-acf6-4e2a-a370-4726ba7efee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:49.852106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-a101f6ef-acf6-4e2a-a370-4726ba7efee6 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:49.853641 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-a101f6ef-acf6-4e2a-a370-4726ba7efee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:49.878682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:49.936697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1032/2073] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:49.942302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498324c3-66bf-46af-bfdc-2cd92d7ad0a9 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:49.942302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498324c3-66bf-46af-bfdc-2cd92d7ad0a9 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:49.942875 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498324c3-66bf-46af-bfdc-2cd92d7ad0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:49.962641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-498324c3-66bf-46af-bfdc-2cd92d7ad0a9 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:49.963872 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-498324c3-66bf-46af-bfdc-2cd92d7ad0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:49.972438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1042/2074] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:49.976925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101f6ef-acf6-4e2a-a370-4726ba7efee6 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:49.986558 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101f6ef-acf6-4e2a-a370-4726ba7efee6 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:49.992319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746b35b-6f77-46a8-a33e-536593bcfdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:49.992992 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746b35b-6f77-46a8-a33e-536593bcfdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:49.993277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746b35b-6f77-46a8-a33e-536593bcfdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:49.993550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746b35b-6f77-46a8-a33e-536593bcfdf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:49.994495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746b35b-6f77-46a8-a33e-536593bcfdf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:57:49.994827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746b35b-6f77-46a8-a33e-536593bcfdf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:49.996440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746b35b-6f77-46a8-a33e-536593bcfdf2 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:50.009448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1033/2075] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:57:50.013670 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498324c3-66bf-46af-bfdc-2cd92d7ad0a9 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:50.024527 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498324c3-66bf-46af-bfdc-2cd92d7ad0a9 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:50.029419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fef94-6e5b-4042-9a09-0f4146b858cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:50.030112 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fef94-6e5b-4042-9a09-0f4146b858cc admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:50.030397 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fef94-6e5b-4042-9a09-0f4146b858cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:50.030666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fef94-6e5b-4042-9a09-0f4146b858cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:50.031513 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fef94-6e5b-4042-9a09-0f4146b858cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:50.033618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fef94-6e5b-4042-9a09-0f4146b858cc admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:50.128115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1043/2076] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:57:50 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:50.132353 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746b35b-6f77-46a8-a33e-536593bcfdf2 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:50.143422 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746b35b-6f77-46a8-a33e-536593bcfdf2 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:50.207174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe0b13-4cef-4290-b6f6-41bbaf0cad89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:50.207174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe0b13-4cef-4290-b6f6-41bbaf0cad89 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:50.207174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe0b13-4cef-4290-b6f6-41bbaf0cad89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:50.207494 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe0b13-4cef-4290-b6f6-41bbaf0cad89 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:50.207994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe0b13-4cef-4290-b6f6-41bbaf0cad89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:50.210018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe0b13-4cef-4290-b6f6-41bbaf0cad89 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:50.282168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1034/2077] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:57:50 2022] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:50.282783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fef94-6e5b-4042-9a09-0f4146b858cc admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:50.295492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fef94-6e5b-4042-9a09-0f4146b858cc admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:50.303739 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257c20f-9766-4f47-a202-d8ab1602a573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:50.304447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257c20f-9766-4f47-a202-d8ab1602a573 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:50.304771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257c20f-9766-4f47-a202-d8ab1602a573 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:50.305053 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257c20f-9766-4f47-a202-d8ab1602a573 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:50.305792 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257c20f-9766-4f47-a202-d8ab1602a573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:50.307373 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257c20f-9766-4f47-a202-d8ab1602a573 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:50.319615 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1044/2078] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:50.323788 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe0b13-4cef-4290-b6f6-41bbaf0cad89 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:50.338001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe0b13-4cef-4290-b6f6-41bbaf0cad89 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:50.349174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74176e-135a-43d3-9793-5fd10711b4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:50.349174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74176e-135a-43d3-9793-5fd10711b4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:50.349174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74176e-135a-43d3-9793-5fd10711b4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:50.349174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74176e-135a-43d3-9793-5fd10711b4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:50.349635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74176e-135a-43d3-9793-5fd10711b4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:50.349635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74176e-135a-43d3-9793-5fd10711b4f4 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:50.357514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1035/2079] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:50.362157 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257c20f-9766-4f47-a202-d8ab1602a573 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:50.372883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257c20f-9766-4f47-a202-d8ab1602a573 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:50.379276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9635e7f-4ebd-4e92-97d2-12a157621595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:50.380160 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9635e7f-4ebd-4e92-97d2-12a157621595 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:50.380445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9635e7f-4ebd-4e92-97d2-12a157621595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:50.380755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9635e7f-4ebd-4e92-97d2-12a157621595 admin admin] PATH_INFO: `/v3/projects/3f934b8bdde24394ae8bf45790c1a4bd/users/9af9d2af0aa7493c9d8d147769d5ee64/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:50.397249 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9635e7f-4ebd-4e92-97d2-12a157621595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f934b8bdde24394ae8bf45790c1a4bd, user_id=9af9d2af0aa7493c9d8d147769d5ee64, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:50.400059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9635e7f-4ebd-4e92-97d2-12a157621595 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:50.475922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1045/2080] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:50 2022] PUT /identity/v3/projects/3f934b8bdde24394ae8bf45790c1a4bd/users/9af9d2af0aa7493c9d8d147769d5ee64/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:50.486379 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41601e1-2282-4ac3-8889-069da0b5319a None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:50.486671 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41601e1-2282-4ac3-8889-069da0b5319a None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:50.486963 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41601e1-2282-4ac3-8889-069da0b5319a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:50.515157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f41601e1-2282-4ac3-8889-069da0b5319a None None] MFA Rules not processed for user `9af9d2af0aa7493c9d8d147769d5ee64`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:50.516441 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f41601e1-2282-4ac3-8889-069da0b5319a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:50.580842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:50.585275 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1036/2081] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:50.589780 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9635e7f-4ebd-4e92-97d2-12a157621595 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:50.656081 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9635e7f-4ebd-4e92-97d2-12a157621595 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:50.661025 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851a050-eee0-4a26-92dd-a97b70710655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:50.661686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851a050-eee0-4a26-92dd-a97b70710655 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:50.664498 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851a050-eee0-4a26-92dd-a97b70710655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:50.664498 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851a050-eee0-4a26-92dd-a97b70710655 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:50.664498 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851a050-eee0-4a26-92dd-a97b70710655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:50.664938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851a050-eee0-4a26-92dd-a97b70710655 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:50.846062 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1046/2082] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:57:50 2022] POST /identity/v3/projects => generated 367 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:50.850535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41601e1-2282-4ac3-8889-069da0b5319a None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:50.863311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41601e1-2282-4ac3-8889-069da0b5319a None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:50.924371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fffde-a1b1-4be5-a9fd-fe3757e9abb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:50.925598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fffde-a1b1-4be5-a9fd-fe3757e9abb8 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:50.925880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fffde-a1b1-4be5-a9fd-fe3757e9abb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:50.926170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fffde-a1b1-4be5-a9fd-fe3757e9abb8 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:50.926912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fffde-a1b1-4be5-a9fd-fe3757e9abb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:50.928851 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fffde-a1b1-4be5-a9fd-fe3757e9abb8 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:51.154781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1037/2083] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:57:50 2022] POST /identity/v3/users => generated 290 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:57:51.160191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851a050-eee0-4a26-92dd-a97b70710655 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:51.169834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851a050-eee0-4a26-92dd-a97b70710655 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:51.174499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc68a8-adfb-4668-9c4e-4fc61b1030ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:51.175324 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc68a8-adfb-4668-9c4e-4fc61b1030ab admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:51.175852 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc68a8-adfb-4668-9c4e-4fc61b1030ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:51.176141 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc68a8-adfb-4668-9c4e-4fc61b1030ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:51.177026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc68a8-adfb-4668-9c4e-4fc61b1030ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:51.180219 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc68a8-adfb-4668-9c4e-4fc61b1030ab admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:51.196159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1047/2084] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:51.200280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fffde-a1b1-4be5-a9fd-fe3757e9abb8 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:51.211332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fffde-a1b1-4be5-a9fd-fe3757e9abb8 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:51.215897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c52063-9c1b-4bc3-a415-45a19fcb2610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:51.216821 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c52063-9c1b-4bc3-a415-45a19fcb2610 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:51.217101 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c52063-9c1b-4bc3-a415-45a19fcb2610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:51.217371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c52063-9c1b-4bc3-a415-45a19fcb2610 admin admin] PATH_INFO: `/v3/projects/0cb75e61a67c4c5d895f6d1ff35b0abe/users/54d0bebe8a9143049d45820f1904ceec/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:51.232679 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c52063-9c1b-4bc3-a415-45a19fcb2610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb75e61a67c4c5d895f6d1ff35b0abe, user_id=54d0bebe8a9143049d45820f1904ceec, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:51.235601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c52063-9c1b-4bc3-a415-45a19fcb2610 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:51.291355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1038/2085] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:51 2022] PUT /identity/v3/projects/0cb75e61a67c4c5d895f6d1ff35b0abe/users/54d0bebe8a9143049d45820f1904ceec/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:51.295243 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc68a8-adfb-4668-9c4e-4fc61b1030ab admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:51.305649 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc68a8-adfb-4668-9c4e-4fc61b1030ab admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:51.363754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53aa5d-2579-43be-ada6-9053739bc6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:51.364542 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53aa5d-2579-43be-ada6-9053739bc6fd admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:51.364852 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53aa5d-2579-43be-ada6-9053739bc6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:51.367014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53aa5d-2579-43be-ada6-9053739bc6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:51.367014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53aa5d-2579-43be-ada6-9053739bc6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:51.367425 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53aa5d-2579-43be-ada6-9053739bc6fd admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:51.381525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1048/2086] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:51.382922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c52063-9c1b-4bc3-a415-45a19fcb2610 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:51.393439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c52063-9c1b-4bc3-a415-45a19fcb2610 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:51.398918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c5b8f-fca4-4355-91c4-9c8cffcdf589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:51.403166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5b8f-fca4-4355-91c4-9c8cffcdf589 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:51.403166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5b8f-fca4-4355-91c4-9c8cffcdf589 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:51.403166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5b8f-fca4-4355-91c4-9c8cffcdf589 admin admin] PATH_INFO: `/v3/projects/0cb75e61a67c4c5d895f6d1ff35b0abe/users/54d0bebe8a9143049d45820f1904ceec/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:51.403166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c5b8f-fca4-4355-91c4-9c8cffcdf589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb75e61a67c4c5d895f6d1ff35b0abe, user_id=54d0bebe8a9143049d45820f1904ceec, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:51.405176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c5b8f-fca4-4355-91c4-9c8cffcdf589 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:51.415834 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1039/2087] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:51 2022] PUT /identity/v3/projects/0cb75e61a67c4c5d895f6d1ff35b0abe/users/54d0bebe8a9143049d45820f1904ceec/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:51.427069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f289e-81cb-4265-a65b-d681e4220825 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:51.427358 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f289e-81cb-4265-a65b-d681e4220825 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:51.427635 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f289e-81cb-4265-a65b-d681e4220825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:51.434704 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:51.454729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-274f289e-81cb-4265-a65b-d681e4220825 None None] MFA Rules not processed for user `54d0bebe8a9143049d45820f1904ceec`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:51.455933 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-274f289e-81cb-4265-a65b-d681e4220825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:51.527769 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1049/2088] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:51.539504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c5b8f-fca4-4355-91c4-9c8cffcdf589 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:51.541260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2b9c5b8f-fca4-4355-91c4-9c8cffcdf589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:51.598650 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c5b8f-fca4-4355-91c4-9c8cffcdf589 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:51.602319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ed9d9-f6b7-49ff-9825-45156c466a29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:51.602972 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed9d9-f6b7-49ff-9825-45156c466a29 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:51.603255 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed9d9-f6b7-49ff-9825-45156c466a29 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:51.603532 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed9d9-f6b7-49ff-9825-45156c466a29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:51.613028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ed9d9-f6b7-49ff-9825-45156c466a29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:51.614537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ed9d9-f6b7-49ff-9825-45156c466a29 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:51.623969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1040/2089] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:51 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:57:51.746319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f289e-81cb-4265-a65b-d681e4220825 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:51.747824 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-274f289e-81cb-4265-a65b-d681e4220825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:51.760155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f289e-81cb-4265-a65b-d681e4220825 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:51.763786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9a8e3-2738-44ed-88ca-5fd49478f2da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:51.764417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9a8e3-2738-44ed-88ca-5fd49478f2da service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:51.764736 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9a8e3-2738-44ed-88ca-5fd49478f2da service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:51.765016 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9a8e3-2738-44ed-88ca-5fd49478f2da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:51.826056 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9a8e3-2738-44ed-88ca-5fd49478f2da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:51.827491 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9a8e3-2738-44ed-88ca-5fd49478f2da service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:51.836861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1050/2090] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:57:51.973440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dd16a-eb84-4027-8d94-0b73f16332af None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:51.974172 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dd16a-eb84-4027-8d94-0b73f16332af None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:51.974172 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dd16a-eb84-4027-8d94-0b73f16332af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:51.991794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-8f0dd16a-eb84-4027-8d94-0b73f16332af None None] MFA Rules not processed for user `ef044785763a4bc4be4a1ffd4ea5290f`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:51.993013 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8f0dd16a-eb84-4027-8d94-0b73f16332af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:52.043997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:52.052455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1041/2091] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:56.736408 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9a8e3-2738-44ed-88ca-5fd49478f2da service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:56.832488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9a8e3-2738-44ed-88ca-5fd49478f2da service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:56.837113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b111c2d-282a-4901-8349-b240b6e4367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:56.837970 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b111c2d-282a-4901-8349-b240b6e4367a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:56.838249 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b111c2d-282a-4901-8349-b240b6e4367a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:56.838517 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b111c2d-282a-4901-8349-b240b6e4367a admin admin] PATH_INFO: `/v3/users/9af9d2af0aa7493c9d8d147769d5ee64` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:56.839683 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b111c2d-282a-4901-8349-b240b6e4367a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af9d2af0aa7493c9d8d147769d5ee64)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:56.841631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b111c2d-282a-4901-8349-b240b6e4367a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:56.906471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dd16a-eb84-4027-8d94-0b73f16332af None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:56.907929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8f0dd16a-eb84-4027-8d94-0b73f16332af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:56.923038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dd16a-eb84-4027-8d94-0b73f16332af None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:56.928494 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c68ecd-a8f4-4df3-97ee-bec6bb30cdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:56.929397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c68ecd-a8f4-4df3-97ee-bec6bb30cdc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:56.929682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c68ecd-a8f4-4df3-97ee-bec6bb30cdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:56.929983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c68ecd-a8f4-4df3-97ee-bec6bb30cdc0 admin admin] PATH_INFO: `/v3/users/340af9c8b53a483d9fc311b36736ca01` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:56.931158 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c68ecd-a8f4-4df3-97ee-bec6bb30cdc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=340af9c8b53a483d9fc311b36736ca01)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:56.933106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c68ecd-a8f4-4df3-97ee-bec6bb30cdc0 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:57.035696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:57.049030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-8b111c2d-282a-4901-8349-b240b6e4367a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af9d2af0aa7493c9d8d147769d5ee64'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:57.061602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-8b111c2d-282a-4901-8349-b240b6e4367a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af9d2af0aa7493c9d8d147769d5ee64'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:57.175756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-8b111c2d-282a-4901-8349-b240b6e4367a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af9d2af0aa7493c9d8d147769d5ee64'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:57.176487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-8b111c2d-282a-4901-8349-b240b6e4367a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af9d2af0aa7493c9d8d147769d5ee64'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:57.184809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-8b111c2d-282a-4901-8349-b240b6e4367a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af9d2af0aa7493c9d8d147769d5ee64'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:57.190108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b1c68ecd-a8f4-4df3-97ee-bec6bb30cdc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340af9c8b53a483d9fc311b36736ca01'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:57.192173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1051/2092] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:57:56 2022] DELETE /identity/v3/users/9af9d2af0aa7493c9d8d147769d5ee64 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:57.196488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da90df-5aa3-463b-8863-f3cfad2e5dd8 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:57.196826 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da90df-5aa3-463b-8863-f3cfad2e5dd8 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:57.197415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da90df-5aa3-463b-8863-f3cfad2e5dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:57.206240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b1c68ecd-a8f4-4df3-97ee-bec6bb30cdc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340af9c8b53a483d9fc311b36736ca01'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:57.223574 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-25da90df-5aa3-463b-8863-f3cfad2e5dd8 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:57.224857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-25da90df-5aa3-463b-8863-f3cfad2e5dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:57.280181 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b1c68ecd-a8f4-4df3-97ee-bec6bb30cdc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340af9c8b53a483d9fc311b36736ca01'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:57.280944 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b1c68ecd-a8f4-4df3-97ee-bec6bb30cdc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340af9c8b53a483d9fc311b36736ca01'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:57.292099 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-b1c68ecd-a8f4-4df3-97ee-bec6bb30cdc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340af9c8b53a483d9fc311b36736ca01'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:57.292344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1052/2093] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:57:57.298685 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da90df-5aa3-463b-8863-f3cfad2e5dd8 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:57.300823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-25da90df-5aa3-463b-8863-f3cfad2e5dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:57.305880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1042/2094] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:57:56 2022] DELETE /identity/v3/users/340af9c8b53a483d9fc311b36736ca01 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:57:57.367135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da90df-5aa3-463b-8863-f3cfad2e5dd8 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:57.421599 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9205d58-ab75-47cb-881e-a7709a1cbbb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:57.422255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9205d58-ab75-47cb-881e-a7709a1cbbb4 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:57.422573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9205d58-ab75-47cb-881e-a7709a1cbbb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:57.422916 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9205d58-ab75-47cb-881e-a7709a1cbbb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:57.443777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:57.503131 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9205d58-ab75-47cb-881e-a7709a1cbbb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:57.504716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9205d58-ab75-47cb-881e-a7709a1cbbb4 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:57.514456 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1053/2095] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:57:57.857575 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c68ecd-a8f4-4df3-97ee-bec6bb30cdc0 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:57.859153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b1c68ecd-a8f4-4df3-97ee-bec6bb30cdc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:57.876501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c68ecd-a8f4-4df3-97ee-bec6bb30cdc0 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:57.883510 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0c65a-3652-4c7e-9e02-c7ff3a840dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:57.884512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0c65a-3652-4c7e-9e02-c7ff3a840dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:57.884701 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0c65a-3652-4c7e-9e02-c7ff3a840dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:57.884983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0c65a-3652-4c7e-9e02-c7ff3a840dc5 admin admin] PATH_INFO: `/v3/projects/27b7c4f8156b409785b5555712cdc934` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:57.886226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0c65a-3652-4c7e-9e02-c7ff3a840dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b7c4f8156b409785b5555712cdc934)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:57.888125 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0c65a-3652-4c7e-9e02-c7ff3a840dc5 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:57.939300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9205d58-ab75-47cb-881e-a7709a1cbbb4 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:57.942498 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b9205d58-ab75-47cb-881e-a7709a1cbbb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:57.956826 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9205d58-ab75-47cb-881e-a7709a1cbbb4 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:57.961289 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e53e28-ac03-4752-b5cc-c915e3711f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:57.962200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e53e28-ac03-4752-b5cc-c915e3711f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:57.962472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e53e28-ac03-4752-b5cc-c915e3711f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:57.962745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e53e28-ac03-4752-b5cc-c915e3711f81 admin admin] PATH_INFO: `/v3/projects/3f934b8bdde24394ae8bf45790c1a4bd` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:57.964035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e53e28-ac03-4752-b5cc-c915e3711f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f934b8bdde24394ae8bf45790c1a4bd)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:57.966008 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e53e28-ac03-4752-b5cc-c915e3711f81 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:57.998273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-04e0c65a-3652-4c7e-9e02-c7ff3a840dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b7c4f8156b409785b5555712cdc934', 'request_id': 'req-04e0c65a-3652-4c7e-9e02-c7ff3a840dc5'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:58.067176 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-82e53e28-ac03-4752-b5cc-c915e3711f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f934b8bdde24394ae8bf45790c1a4bd', 'request_id': 'req-82e53e28-ac03-4752-b5cc-c915e3711f81'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:58.069826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-04e0c65a-3652-4c7e-9e02-c7ff3a840dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b7c4f8156b409785b5555712cdc934', 'request_id': 'req-04e0c65a-3652-4c7e-9e02-c7ff3a840dc5'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:58.073962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-82e53e28-ac03-4752-b5cc-c915e3711f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f934b8bdde24394ae8bf45790c1a4bd', 'request_id': 'req-82e53e28-ac03-4752-b5cc-c915e3711f81'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:58.077389 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-04e0c65a-3652-4c7e-9e02-c7ff3a840dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b7c4f8156b409785b5555712cdc934', 'request_id': 'req-04e0c65a-3652-4c7e-9e02-c7ff3a840dc5'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:58.091905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-04e0c65a-3652-4c7e-9e02-c7ff3a840dc5 admin admin] The token cache is being invalidate because project 27b7c4f8156b409785b5555712cdc934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:57:58.092197 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-04e0c65a-3652-4c7e-9e02-c7ff3a840dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:58.092948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-04e0c65a-3652-4c7e-9e02-c7ff3a840dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:58.098971 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1043/2096] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:57:57 2022] DELETE /identity/v3/projects/27b7c4f8156b409785b5555712cdc934 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:58.102221 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c430b7-6d99-4c4a-b257-8a702659a103 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:58.104146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c430b7-6d99-4c4a-b257-8a702659a103 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:58.104431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c430b7-6d99-4c4a-b257-8a702659a103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:58.124344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-23c430b7-6d99-4c4a-b257-8a702659a103 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:58.127267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-23c430b7-6d99-4c4a-b257-8a702659a103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:58.146205 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-82e53e28-ac03-4752-b5cc-c915e3711f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f934b8bdde24394ae8bf45790c1a4bd', 'request_id': 'req-82e53e28-ac03-4752-b5cc-c915e3711f81'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:58.157897 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-82e53e28-ac03-4752-b5cc-c915e3711f81 admin admin] The token cache is being invalidate because project 3f934b8bdde24394ae8bf45790c1a4bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:57:58.158191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-82e53e28-ac03-4752-b5cc-c915e3711f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:58.158895 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-82e53e28-ac03-4752-b5cc-c915e3711f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:58.164897 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1054/2097] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:57:57 2022] DELETE /identity/v3/projects/3f934b8bdde24394ae8bf45790c1a4bd => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:57:58.166705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e53e28-ac03-4752-b5cc-c915e3711f81 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:58.168758 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-82e53e28-ac03-4752-b5cc-c915e3711f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:58.175873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:58.187184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1044/2098] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:58.196243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded16b1b-9814-49bb-a4d4-5b5230a009b9 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:58.198979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded16b1b-9814-49bb-a4d4-5b5230a009b9 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:58.199354 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded16b1b-9814-49bb-a4d4-5b5230a009b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:58.217588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-ded16b1b-9814-49bb-a4d4-5b5230a009b9 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:58.218816 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ded16b1b-9814-49bb-a4d4-5b5230a009b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:58.227655 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1045/2099] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:57:58.231717 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded16b1b-9814-49bb-a4d4-5b5230a009b9 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:58.243127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded16b1b-9814-49bb-a4d4-5b5230a009b9 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:58.247933 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e53e28-ac03-4752-b5cc-c915e3711f81 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:58.251167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8e5c8-97dd-4eee-88b6-3a3b61d249a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:58.254299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8e5c8-97dd-4eee-88b6-3a3b61d249a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:58.254299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8e5c8-97dd-4eee-88b6-3a3b61d249a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:58.254299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8e5c8-97dd-4eee-88b6-3a3b61d249a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:58.255272 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffdb2d-d0e6-4229-9f33-4c39fd87d678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:58.255412 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8e5c8-97dd-4eee-88b6-3a3b61d249a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:57:58.255412 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8e5c8-97dd-4eee-88b6-3a3b61d249a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:58.255572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffdb2d-d0e6-4229-9f33-4c39fd87d678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:58.255572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffdb2d-d0e6-4229-9f33-4c39fd87d678 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:58.255572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffdb2d-d0e6-4229-9f33-4c39fd87d678 admin admin] PATH_INFO: `/v3/users/54d0bebe8a9143049d45820f1904ceec` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:58.255808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8e5c8-97dd-4eee-88b6-3a3b61d249a5 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:58.256745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffdb2d-d0e6-4229-9f33-4c39fd87d678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d0bebe8a9143049d45820f1904ceec)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:58.258665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffdb2d-d0e6-4229-9f33-4c39fd87d678 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:58.267543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1046/2100] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:57:58.271743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8e5c8-97dd-4eee-88b6-3a3b61d249a5 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:58.281526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8e5c8-97dd-4eee-88b6-3a3b61d249a5 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:58.287064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334cbd9-5886-4436-9f4e-41a9f5ea1761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:58.287708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334cbd9-5886-4436-9f4e-41a9f5ea1761 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:58.287989 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334cbd9-5886-4436-9f4e-41a9f5ea1761 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:58.288267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334cbd9-5886-4436-9f4e-41a9f5ea1761 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:58.288986 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334cbd9-5886-4436-9f4e-41a9f5ea1761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:58.290867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334cbd9-5886-4436-9f4e-41a9f5ea1761 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:58.384830 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1047/2101] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:57:58 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:57:58.388662 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334cbd9-5886-4436-9f4e-41a9f5ea1761 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:58.452308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334cbd9-5886-4436-9f4e-41a9f5ea1761 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:58.453850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:58.457942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1f88-6680-4637-bccd-d0d9f5007a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:58.458807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1f88-6680-4637-bccd-d0d9f5007a12 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:58.459537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1f88-6680-4637-bccd-d0d9f5007a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:58.459537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1f88-6680-4637-bccd-d0d9f5007a12 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:58.460336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad1f88-6680-4637-bccd-d0d9f5007a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:58.462638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad1f88-6680-4637-bccd-d0d9f5007a12 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:58.469146 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-0cffdb2d-d0e6-4229-9f33-4c39fd87d678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d0bebe8a9143049d45820f1904ceec'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:58.490445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-0cffdb2d-d0e6-4229-9f33-4c39fd87d678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d0bebe8a9143049d45820f1904ceec'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:58.566155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-0cffdb2d-d0e6-4229-9f33-4c39fd87d678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d0bebe8a9143049d45820f1904ceec'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:58.566807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-0cffdb2d-d0e6-4229-9f33-4c39fd87d678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d0bebe8a9143049d45820f1904ceec'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:58.568612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1048/2102] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:57:58 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:57:58.569890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1f88-6680-4637-bccd-d0d9f5007a12 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:58.577395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-0cffdb2d-d0e6-4229-9f33-4c39fd87d678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d0bebe8a9143049d45820f1904ceec'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:58.583878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1f88-6680-4637-bccd-d0d9f5007a12 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:58.585065 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1055/2103] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:57:58 2022] DELETE /identity/v3/users/54d0bebe8a9143049d45820f1904ceec => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:58.669876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b89b20-09fa-45bc-8a6b-618cb80bad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:58.670552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b89b20-09fa-45bc-8a6b-618cb80bad6b admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:58.670836 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b89b20-09fa-45bc-8a6b-618cb80bad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:58.671108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b89b20-09fa-45bc-8a6b-618cb80bad6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:58.671850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b89b20-09fa-45bc-8a6b-618cb80bad6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:58.673503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b89b20-09fa-45bc-8a6b-618cb80bad6b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:58.686812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1049/2104] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:58.691228 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffdb2d-d0e6-4229-9f33-4c39fd87d678 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:58.692760 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-0cffdb2d-d0e6-4229-9f33-4c39fd87d678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:58.706389 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffdb2d-d0e6-4229-9f33-4c39fd87d678 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:58.710997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93852ea-749c-48dd-9b57-ba4af174a4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:58.711655 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93852ea-749c-48dd-9b57-ba4af174a4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:58.711944 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93852ea-749c-48dd-9b57-ba4af174a4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:58.712255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93852ea-749c-48dd-9b57-ba4af174a4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:58.713017 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93852ea-749c-48dd-9b57-ba4af174a4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:58.714601 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93852ea-749c-48dd-9b57-ba4af174a4e7 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:58.728473 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1056/2105] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:58.729709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b89b20-09fa-45bc-8a6b-618cb80bad6b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:58.739675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b89b20-09fa-45bc-8a6b-618cb80bad6b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:58.744404 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c717f3-3843-4602-88c5-8ef52e4f9348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:58.745319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c717f3-3843-4602-88c5-8ef52e4f9348 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:58.745604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c717f3-3843-4602-88c5-8ef52e4f9348 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:58.745878 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c717f3-3843-4602-88c5-8ef52e4f9348 admin admin] PATH_INFO: `/v3/projects/b97754fe254c4f53bf8e9ca81bc08e83/users/45d8a8b823ac4b7b980c2667bc486ee6/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:58.773287 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c717f3-3843-4602-88c5-8ef52e4f9348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97754fe254c4f53bf8e9ca81bc08e83, user_id=45d8a8b823ac4b7b980c2667bc486ee6, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:58.776064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c717f3-3843-4602-88c5-8ef52e4f9348 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:58.847620 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1050/2106] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:58 2022] PUT /identity/v3/projects/b97754fe254c4f53bf8e9ca81bc08e83/users/45d8a8b823ac4b7b980c2667bc486ee6/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:57:58.858702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0647620-3bff-4ab4-8a62-8b8d7d5c08e7 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:58.858994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0647620-3bff-4ab4-8a62-8b8d7d5c08e7 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:58.859295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0647620-3bff-4ab4-8a62-8b8d7d5c08e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:58.897082 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-b0647620-3bff-4ab4-8a62-8b8d7d5c08e7 None None] MFA Rules not processed for user `45d8a8b823ac4b7b980c2667bc486ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:58.898315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b0647620-3bff-4ab4-8a62-8b8d7d5c08e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:58.966109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1057/2107] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:57:58.970962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c717f3-3843-4602-88c5-8ef52e4f9348 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:58.989844 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:59.019479 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0647620-3bff-4ab4-8a62-8b8d7d5c08e7 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:59.021297 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b0647620-3bff-4ab4-8a62-8b8d7d5c08e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:59.035790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c717f3-3843-4602-88c5-8ef52e4f9348 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:59.040544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5177e-0b84-412d-88cc-f114a348a260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:59.041231 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5177e-0b84-412d-88cc-f114a348a260 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.041509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5177e-0b84-412d-88cc-f114a348a260 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.041783 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5177e-0b84-412d-88cc-f114a348a260 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.042527 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5177e-0b84-412d-88cc-f114a348a260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:59.044757 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5177e-0b84-412d-88cc-f114a348a260 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:59.110204 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0647620-3bff-4ab4-8a62-8b8d7d5c08e7 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:59.115360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fb604-bb31-4bb9-9604-7a924fcab663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:59.116204 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fb604-bb31-4bb9-9604-7a924fcab663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.116487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fb604-bb31-4bb9-9604-7a924fcab663 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.116799 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fb604-bb31-4bb9-9604-7a924fcab663 admin admin] PATH_INFO: `/v3/projects/0cb75e61a67c4c5d895f6d1ff35b0abe` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.118017 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fb604-bb31-4bb9-9604-7a924fcab663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb75e61a67c4c5d895f6d1ff35b0abe)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:59.119934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fb604-bb31-4bb9-9604-7a924fcab663 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:59.137713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1051/2108] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:57:58 2022] POST /identity/v3/projects => generated 363 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:59.141595 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5177e-0b84-412d-88cc-f114a348a260 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:59.209883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:59.216033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f47fb604-bb31-4bb9-9604-7a924fcab663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb75e61a67c4c5d895f6d1ff35b0abe', 'request_id': 'req-f47fb604-bb31-4bb9-9604-7a924fcab663'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:59.216227 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5177e-0b84-412d-88cc-f114a348a260 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:59.223085 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f47fb604-bb31-4bb9-9604-7a924fcab663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb75e61a67c4c5d895f6d1ff35b0abe', 'request_id': 'req-f47fb604-bb31-4bb9-9604-7a924fcab663'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:59.276302 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1327e5-d223-42ed-aff9-0f714c09e02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:59.277050 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1327e5-d223-42ed-aff9-0f714c09e02e admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.277335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1327e5-d223-42ed-aff9-0f714c09e02e admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.277615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1327e5-d223-42ed-aff9-0f714c09e02e admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.278322 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1327e5-d223-42ed-aff9-0f714c09e02e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:59.280340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1327e5-d223-42ed-aff9-0f714c09e02e admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:59.312280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f47fb604-bb31-4bb9-9604-7a924fcab663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb75e61a67c4c5d895f6d1ff35b0abe', 'request_id': 'req-f47fb604-bb31-4bb9-9604-7a924fcab663'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:59.324543 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f47fb604-bb31-4bb9-9604-7a924fcab663 admin admin] The token cache is being invalidate because project 0cb75e61a67c4c5d895f6d1ff35b0abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:57:59.324863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f47fb604-bb31-4bb9-9604-7a924fcab663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:59.325515 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f47fb604-bb31-4bb9-9604-7a924fcab663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:57:59.327075 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1058/2109] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:57:59 2022] DELETE /identity/v3/projects/0cb75e61a67c4c5d895f6d1ff35b0abe => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:57:59.332076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434eb61-e4a1-42fb-9c89-c7100d5cde92 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.332371 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434eb61-e4a1-42fb-9c89-c7100d5cde92 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.332758 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434eb61-e4a1-42fb-9c89-c7100d5cde92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.351317 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-6434eb61-e4a1-42fb-9c89-c7100d5cde92 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:59.352611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-6434eb61-e4a1-42fb-9c89-c7100d5cde92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:59.361079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1059/2110] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:57:59.369400 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b13db-c430-4543-80d5-7a9cba379cb8 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.369685 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b13db-c430-4543-80d5-7a9cba379cb8 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.369960 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b13db-c430-4543-80d5-7a9cba379cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.382311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1052/2111] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:57:59 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:57:59.387302 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1327e5-d223-42ed-aff9-0f714c09e02e admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:59.389035 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ea1327e5-d223-42ed-aff9-0f714c09e02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:59.391778 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-e45b13db-c430-4543-80d5-7a9cba379cb8 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:59.393108 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e45b13db-c430-4543-80d5-7a9cba379cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:59.401035 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1327e5-d223-42ed-aff9-0f714c09e02e admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:59.401482 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1060/2112] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:57:59.405263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b13db-c430-4543-80d5-7a9cba379cb8 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:59.408423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800db930-7828-4991-a841-2c775d7b2421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:59.409115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800db930-7828-4991-a841-2c775d7b2421 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.409576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800db930-7828-4991-a841-2c775d7b2421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.409774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800db930-7828-4991-a841-2c775d7b2421 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.410378 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800db930-7828-4991-a841-2c775d7b2421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:59.411990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800db930-7828-4991-a841-2c775d7b2421 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:59.414491 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b13db-c430-4543-80d5-7a9cba379cb8 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:59.419438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408bc78-5d56-40fa-b9ee-9e2b806d860c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:59.420188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408bc78-5d56-40fa-b9ee-9e2b806d860c admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.420467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408bc78-5d56-40fa-b9ee-9e2b806d860c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.420777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408bc78-5d56-40fa-b9ee-9e2b806d860c admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.421496 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408bc78-5d56-40fa-b9ee-9e2b806d860c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:57:59.421804 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408bc78-5d56-40fa-b9ee-9e2b806d860c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:59.425832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1053/2113] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:57:59.425983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408bc78-5d56-40fa-b9ee-9e2b806d860c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:59.426836 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800db930-7828-4991-a841-2c775d7b2421 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:59.436392 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800db930-7828-4991-a841-2c775d7b2421 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:59.436529 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1061/2114] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 14:57:59.441430 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408bc78-5d56-40fa-b9ee-9e2b806d860c admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:59.443137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c1a28-d757-441f-beca-bac7acf46325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:59.444002 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c1a28-d757-441f-beca-bac7acf46325 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.444280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c1a28-d757-441f-beca-bac7acf46325 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.444549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c1a28-d757-441f-beca-bac7acf46325 admin admin] PATH_INFO: `/v3/projects/19bb36ad21c04897ac67e56b3a1e287a/users/8dbe4e9eae194280935b2c347d7ad475/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.451511 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408bc78-5d56-40fa-b9ee-9e2b806d860c admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:59.458805 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872179f-a0b4-4b61-b4bd-050d189a7d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:59.460003 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872179f-a0b4-4b61-b4bd-050d189a7d1d admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.460450 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872179f-a0b4-4b61-b4bd-050d189a7d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.460759 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872179f-a0b4-4b61-b4bd-050d189a7d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.461469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872179f-a0b4-4b61-b4bd-050d189a7d1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:59.462267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c1a28-d757-441f-beca-bac7acf46325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19bb36ad21c04897ac67e56b3a1e287a, user_id=8dbe4e9eae194280935b2c347d7ad475, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:59.463712 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872179f-a0b4-4b61-b4bd-050d189a7d1d admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:59.465321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c1a28-d757-441f-beca-bac7acf46325 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:59.565995 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1054/2115] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:59 2022] PUT /identity/v3/projects/19bb36ad21c04897ac67e56b3a1e287a/users/8dbe4e9eae194280935b2c347d7ad475/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:57:59.577945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c1a28-d757-441f-beca-bac7acf46325 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:59.580255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1062/2116] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:57:59 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:57:59.583549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:59.584908 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872179f-a0b4-4b61-b4bd-050d189a7d1d admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:59.641713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c1a28-d757-441f-beca-bac7acf46325 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:59.647329 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872179f-a0b4-4b61-b4bd-050d189a7d1d admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:59.648143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e361c40-9168-4c95-b8dd-cc99bbca69db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:59.649024 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e361c40-9168-4c95-b8dd-cc99bbca69db admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.649428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e361c40-9168-4c95-b8dd-cc99bbca69db admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.649656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e361c40-9168-4c95-b8dd-cc99bbca69db admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.650390 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e361c40-9168-4c95-b8dd-cc99bbca69db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:59.652182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e361c40-9168-4c95-b8dd-cc99bbca69db admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:59.652296 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4189f02-9303-4918-b232-e233ff4d9be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:59.652887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4189f02-9303-4918-b232-e233ff4d9be4 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.653167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4189f02-9303-4918-b232-e233ff4d9be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.653438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4189f02-9303-4918-b232-e233ff4d9be4 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.654152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4189f02-9303-4918-b232-e233ff4d9be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:59.656109 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4189f02-9303-4918-b232-e233ff4d9be4 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:59.672707 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1055/2117] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:57:59.672707 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e361c40-9168-4c95-b8dd-cc99bbca69db admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:59.683617 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e361c40-9168-4c95-b8dd-cc99bbca69db admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:59.688440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589258ad-9bc9-4c99-bb5c-d0dcfe2f2328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:59.689677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589258ad-9bc9-4c99-bb5c-d0dcfe2f2328 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.690085 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589258ad-9bc9-4c99-bb5c-d0dcfe2f2328 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.691724 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589258ad-9bc9-4c99-bb5c-d0dcfe2f2328 admin admin] PATH_INFO: `/v3/projects/19bb36ad21c04897ac67e56b3a1e287a/users/8dbe4e9eae194280935b2c347d7ad475/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.694504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589258ad-9bc9-4c99-bb5c-d0dcfe2f2328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19bb36ad21c04897ac67e56b3a1e287a, user_id=8dbe4e9eae194280935b2c347d7ad475, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:59.697283 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589258ad-9bc9-4c99-bb5c-d0dcfe2f2328 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:59.708574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1056/2118] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:59 2022] PUT /identity/v3/projects/19bb36ad21c04897ac67e56b3a1e287a/users/8dbe4e9eae194280935b2c347d7ad475/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:57:59.718981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfbe8d-443a-4fe2-88fe-a387892800f6 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.719215 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfbe8d-443a-4fe2-88fe-a387892800f6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.719500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfbe8d-443a-4fe2-88fe-a387892800f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.747874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-52bfbe8d-443a-4fe2-88fe-a387892800f6 None None] MFA Rules not processed for user `8dbe4e9eae194280935b2c347d7ad475`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:57:59.749183 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-52bfbe8d-443a-4fe2-88fe-a387892800f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:59.785439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1063/2119] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:57:59 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:57:59.789639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4189f02-9303-4918-b232-e233ff4d9be4 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:59.826857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4189f02-9303-4918-b232-e233ff4d9be4 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:59.878857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1057/2120] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:57:59 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:57:59.891154 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfbe8d-443a-4fe2-88fe-a387892800f6 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:59.892605 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-52bfbe8d-443a-4fe2-88fe-a387892800f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:57:59.912140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420da340-50ac-4ba3-9d48-47cae9975304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:59.913064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420da340-50ac-4ba3-9d48-47cae9975304 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.913318 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420da340-50ac-4ba3-9d48-47cae9975304 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.913674 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420da340-50ac-4ba3-9d48-47cae9975304 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.914487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420da340-50ac-4ba3-9d48-47cae9975304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:59.916187 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420da340-50ac-4ba3-9d48-47cae9975304 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:59.930308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1064/2121] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:59.931773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420da340-50ac-4ba3-9d48-47cae9975304 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:59.937363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:57:59.945349 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420da340-50ac-4ba3-9d48-47cae9975304 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:59.950997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a8cc8-7099-4efc-b9e0-aab118d9a747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:59.951671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a8cc8-7099-4efc-b9e0-aab118d9a747 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.951953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a8cc8-7099-4efc-b9e0-aab118d9a747 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.952229 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a8cc8-7099-4efc-b9e0-aab118d9a747 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.953030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a8cc8-7099-4efc-b9e0-aab118d9a747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:59.954665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a8cc8-7099-4efc-b9e0-aab118d9a747 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:59.963418 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfbe8d-443a-4fe2-88fe-a387892800f6 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:59.967177 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c7609-07f3-450a-811e-8138d12eee21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:59.967822 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c7609-07f3-450a-811e-8138d12eee21 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.968102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c7609-07f3-450a-811e-8138d12eee21 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.968375 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c7609-07f3-450a-811e-8138d12eee21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.969163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1065/2122] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:57:59.971389 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a8cc8-7099-4efc-b9e0-aab118d9a747 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:57:59.980148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c7609-07f3-450a-811e-8138d12eee21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:57:59.981617 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a8cc8-7099-4efc-b9e0-aab118d9a747 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:57:59.981818 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c7609-07f3-450a-811e-8138d12eee21 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:57:59.986673 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826ea3a-022c-41a9-9ee4-d0c7e71e8665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:57:59.988156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826ea3a-022c-41a9-9ee4-d0c7e71e8665 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:57:59.988420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826ea3a-022c-41a9-9ee4-d0c7e71e8665 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:57:59.988709 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826ea3a-022c-41a9-9ee4-d0c7e71e8665 admin admin] PATH_INFO: `/v3/projects/5a022da787b345a9abd9698aa0bd978a/users/97f294907a1344a4bd1385e6119e767a/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:57:59.993846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1058/2123] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:57:59 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:58:00.005469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826ea3a-022c-41a9-9ee4-d0c7e71e8665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a022da787b345a9abd9698aa0bd978a, user_id=97f294907a1344a4bd1385e6119e767a, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:00.008135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826ea3a-022c-41a9-9ee4-d0c7e71e8665 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:00.086066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1066/2124] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:57:59 2022] PUT /identity/v3/projects/5a022da787b345a9abd9698aa0bd978a/users/97f294907a1344a4bd1385e6119e767a/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:00.092039 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67ecd9-605b-419b-a9a8-08b1d27078d7 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:00.092583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67ecd9-605b-419b-a9a8-08b1d27078d7 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:00.092723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67ecd9-605b-419b-a9a8-08b1d27078d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:00.127089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:00.131137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-4e67ecd9-605b-419b-a9a8-08b1d27078d7 None None] MFA Rules not processed for user `97f294907a1344a4bd1385e6119e767a`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:00.132423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-4e67ecd9-605b-419b-a9a8-08b1d27078d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:00.204811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826ea3a-022c-41a9-9ee4-d0c7e71e8665 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:00.212299 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1059/2125] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:00.216664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67ecd9-605b-419b-a9a8-08b1d27078d7 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:00.283348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826ea3a-022c-41a9-9ee4-d0c7e71e8665 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:00.288397 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca66d6-fa22-488d-aaa3-afa0b108da50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:00.289168 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca66d6-fa22-488d-aaa3-afa0b108da50 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:00.289530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca66d6-fa22-488d-aaa3-afa0b108da50 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:00.289879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca66d6-fa22-488d-aaa3-afa0b108da50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:00.292498 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2aca66d6-fa22-488d-aaa3-afa0b108da50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:00.296042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67ecd9-605b-419b-a9a8-08b1d27078d7 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:00.302589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac043873-c619-44b3-a365-50ffc68eecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:00.303245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac043873-c619-44b3-a365-50ffc68eecc9 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:00.303529 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac043873-c619-44b3-a365-50ffc68eecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:00.303807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac043873-c619-44b3-a365-50ffc68eecc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:00.304503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac043873-c619-44b3-a365-50ffc68eecc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:00.306495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac043873-c619-44b3-a365-50ffc68eecc9 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:00.354734 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca66d6-fa22-488d-aaa3-afa0b108da50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:00.356164 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca66d6-fa22-488d-aaa3-afa0b108da50 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:00.366237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1067/2126] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:58:00.418772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1060/2127] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:58:00 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:58:00.422777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca66d6-fa22-488d-aaa3-afa0b108da50 service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:00.434261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca66d6-fa22-488d-aaa3-afa0b108da50 service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:00.521543 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ade1fe-a5f8-4816-bbf4-0a0111bfca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:00.522397 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ade1fe-a5f8-4816-bbf4-0a0111bfca68 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:00.522689 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ade1fe-a5f8-4816-bbf4-0a0111bfca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:00.522968 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ade1fe-a5f8-4816-bbf4-0a0111bfca68 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:00.524103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ade1fe-a5f8-4816-bbf4-0a0111bfca68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:00.526578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ade1fe-a5f8-4816-bbf4-0a0111bfca68 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:00.624388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1068/2128] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:58:00 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:00.628291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac043873-c619-44b3-a365-50ffc68eecc9 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:00.641273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac043873-c619-44b3-a365-50ffc68eecc9 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:00.645265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777aad9-5449-4602-a8a5-c481b3a5afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:00.646021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777aad9-5449-4602-a8a5-c481b3a5afa1 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:00.646311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777aad9-5449-4602-a8a5-c481b3a5afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:00.646656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777aad9-5449-4602-a8a5-c481b3a5afa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:00.647376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777aad9-5449-4602-a8a5-c481b3a5afa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:00.649070 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777aad9-5449-4602-a8a5-c481b3a5afa1 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:00.661070 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1061/2129] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:00.665225 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ade1fe-a5f8-4816-bbf4-0a0111bfca68 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:00.675940 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ade1fe-a5f8-4816-bbf4-0a0111bfca68 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:00.680693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4309d28-9973-4b8f-be8e-f6ea2b5a07d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:00.681575 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4309d28-9973-4b8f-be8e-f6ea2b5a07d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:00.681861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4309d28-9973-4b8f-be8e-f6ea2b5a07d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:00.682141 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4309d28-9973-4b8f-be8e-f6ea2b5a07d3 admin admin] PATH_INFO: `/v3/projects/276da6aeeb484b9bb1291f92b47cdd6d/users/411da18dd2464f7698f5b72cfc0d3d19/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:00.692140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:00.698494 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4309d28-9973-4b8f-be8e-f6ea2b5a07d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276da6aeeb484b9bb1291f92b47cdd6d, user_id=411da18dd2464f7698f5b72cfc0d3d19, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:00.701208 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4309d28-9973-4b8f-be8e-f6ea2b5a07d3 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:00.807161 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1069/2130] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:00 2022] PUT /identity/v3/projects/276da6aeeb484b9bb1291f92b47cdd6d/users/411da18dd2464f7698f5b72cfc0d3d19/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:00.811018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777aad9-5449-4602-a8a5-c481b3a5afa1 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:00.821982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777aad9-5449-4602-a8a5-c481b3a5afa1 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:00.883235 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5e620-2a94-4b9d-9d1d-5f329c88c974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:00.884025 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5e620-2a94-4b9d-9d1d-5f329c88c974 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:00.884182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5e620-2a94-4b9d-9d1d-5f329c88c974 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:00.884587 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5e620-2a94-4b9d-9d1d-5f329c88c974 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:00.885394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5e620-2a94-4b9d-9d1d-5f329c88c974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:00.887139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5e620-2a94-4b9d-9d1d-5f329c88c974 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:00.898924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1062/2131] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:00.903046 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4309d28-9973-4b8f-be8e-f6ea2b5a07d3 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:00.920691 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4309d28-9973-4b8f-be8e-f6ea2b5a07d3 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:00.929386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24f1e0-9154-401f-8e8d-8ecc6d1c48ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:00.930343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24f1e0-9154-401f-8e8d-8ecc6d1c48ed admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:00.935264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24f1e0-9154-401f-8e8d-8ecc6d1c48ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:00.935264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24f1e0-9154-401f-8e8d-8ecc6d1c48ed admin admin] PATH_INFO: `/v3/projects/276da6aeeb484b9bb1291f92b47cdd6d/users/411da18dd2464f7698f5b72cfc0d3d19/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:00.935264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24f1e0-9154-401f-8e8d-8ecc6d1c48ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=276da6aeeb484b9bb1291f92b47cdd6d, user_id=411da18dd2464f7698f5b72cfc0d3d19, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:00.935868 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24f1e0-9154-401f-8e8d-8ecc6d1c48ed admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:00.947861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1070/2132] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:00 2022] PUT /identity/v3/projects/276da6aeeb484b9bb1291f92b47cdd6d/users/411da18dd2464f7698f5b72cfc0d3d19/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:00.958912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdd3a7-4ba8-4c4a-a4b4-404135da116b None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:00.963985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdd3a7-4ba8-4c4a-a4b4-404135da116b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:00.963985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdd3a7-4ba8-4c4a-a4b4-404135da116b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:00.984167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:00.994597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-e7fdd3a7-4ba8-4c4a-a4b4-404135da116b None None] MFA Rules not processed for user `411da18dd2464f7698f5b72cfc0d3d19`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:00.995857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-e7fdd3a7-4ba8-4c4a-a4b4-404135da116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:01.081259 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1063/2133] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:01.098891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24f1e0-9154-401f-8e8d-8ecc6d1c48ed admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:01.100720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-bd24f1e0-9154-401f-8e8d-8ecc6d1c48ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:01.159444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24f1e0-9154-401f-8e8d-8ecc6d1c48ed admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:01.163244 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceac5a5-dbb8-45ee-b286-7de8ca907b49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:01.163878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceac5a5-dbb8-45ee-b286-7de8ca907b49 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:01.164159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceac5a5-dbb8-45ee-b286-7de8ca907b49 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:01.164430 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceac5a5-dbb8-45ee-b286-7de8ca907b49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:01.179497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceac5a5-dbb8-45ee-b286-7de8ca907b49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:01.179497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceac5a5-dbb8-45ee-b286-7de8ca907b49 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:01.186831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1071/2134] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:58:01.215200 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdd3a7-4ba8-4c4a-a4b4-404135da116b None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:01.281714 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdd3a7-4ba8-4c4a-a4b4-404135da116b None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:01.287538 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88ca12-1b5f-4367-9bc0-49299d613200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:01.287819 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88ca12-1b5f-4367-9bc0-49299d613200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:01.287958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88ca12-1b5f-4367-9bc0-49299d613200 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:01.288229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88ca12-1b5f-4367-9bc0-49299d613200 admin admin] PATH_INFO: `/v3/users/97f294907a1344a4bd1385e6119e767a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:01.289449 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88ca12-1b5f-4367-9bc0-49299d613200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f294907a1344a4bd1385e6119e767a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:01.291358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88ca12-1b5f-4367-9bc0-49299d613200 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:01.480631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8b88ca12-1b5f-4367-9bc0-49299d613200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f294907a1344a4bd1385e6119e767a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:01.492414 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8b88ca12-1b5f-4367-9bc0-49299d613200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f294907a1344a4bd1385e6119e767a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:01.565833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8b88ca12-1b5f-4367-9bc0-49299d613200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f294907a1344a4bd1385e6119e767a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:01.566469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8b88ca12-1b5f-4367-9bc0-49299d613200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f294907a1344a4bd1385e6119e767a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:01.580611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8b88ca12-1b5f-4367-9bc0-49299d613200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f294907a1344a4bd1385e6119e767a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:01.587784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1064/2135] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:58:01 2022] DELETE /identity/v3/users/97f294907a1344a4bd1385e6119e767a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:01.592131 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d5431-a4c2-478e-b211-1b91e3902363 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:01.592453 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d5431-a4c2-478e-b211-1b91e3902363 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:01.592819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d5431-a4c2-478e-b211-1b91e3902363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:01.612631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a16d5431-a4c2-478e-b211-1b91e3902363 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:01.613890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a16d5431-a4c2-478e-b211-1b91e3902363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:01.701006 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1072/2136] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:01.711562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88ca12-1b5f-4367-9bc0-49299d613200 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:01.713033 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8b88ca12-1b5f-4367-9bc0-49299d613200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:01.733293 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:01.772678 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88ca12-1b5f-4367-9bc0-49299d613200 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:01.776309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d06b2-d464-49c4-a355-123a6dd160fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:01.776991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d06b2-d464-49c4-a355-123a6dd160fb service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:01.777282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d06b2-d464-49c4-a355-123a6dd160fb service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:01.777550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d06b2-d464-49c4-a355-123a6dd160fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:01.786831 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d06b2-d464-49c4-a355-123a6dd160fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:01.788246 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d06b2-d464-49c4-a355-123a6dd160fb service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:01.797855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1065/2137] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:58:02.287818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d5431-a4c2-478e-b211-1b91e3902363 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:02.287818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a16d5431-a4c2-478e-b211-1b91e3902363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:02.296364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d5431-a4c2-478e-b211-1b91e3902363 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:02.301626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef2d33-bc17-49b4-9e61-f71289c03338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:02.302493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef2d33-bc17-49b4-9e61-f71289c03338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:02.302788 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef2d33-bc17-49b4-9e61-f71289c03338 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:02.303057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef2d33-bc17-49b4-9e61-f71289c03338 admin admin] PATH_INFO: `/v3/projects/5a022da787b345a9abd9698aa0bd978a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:02.304248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef2d33-bc17-49b4-9e61-f71289c03338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a022da787b345a9abd9698aa0bd978a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:02.306186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef2d33-bc17-49b4-9e61-f71289c03338 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:02.421586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-89ef2d33-bc17-49b4-9e61-f71289c03338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a022da787b345a9abd9698aa0bd978a', 'request_id': 'req-89ef2d33-bc17-49b4-9e61-f71289c03338'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:02.429859 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-89ef2d33-bc17-49b4-9e61-f71289c03338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a022da787b345a9abd9698aa0bd978a', 'request_id': 'req-89ef2d33-bc17-49b4-9e61-f71289c03338'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:02.529262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-89ef2d33-bc17-49b4-9e61-f71289c03338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a022da787b345a9abd9698aa0bd978a', 'request_id': 'req-89ef2d33-bc17-49b4-9e61-f71289c03338'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:02.537465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:02.542255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-89ef2d33-bc17-49b4-9e61-f71289c03338 admin admin] The token cache is being invalidate because project 5a022da787b345a9abd9698aa0bd978a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:58:02.542661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-89ef2d33-bc17-49b4-9e61-f71289c03338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:02.543580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-89ef2d33-bc17-49b4-9e61-f71289c03338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:02.545191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1073/2138] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:58:02 2022] DELETE /identity/v3/projects/5a022da787b345a9abd9698aa0bd978a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:02.549554 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d06b2-d464-49c4-a355-123a6dd160fb service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:02.559999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d06b2-d464-49c4-a355-123a6dd160fb service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:02.617000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe2b0b-dba6-4ca7-a236-12694df51b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:02.617865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe2b0b-dba6-4ca7-a236-12694df51b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:02.618147 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe2b0b-dba6-4ca7-a236-12694df51b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:02.618422 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe2b0b-dba6-4ca7-a236-12694df51b8f admin admin] PATH_INFO: `/v3/users/411da18dd2464f7698f5b72cfc0d3d19` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:02.619683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe2b0b-dba6-4ca7-a236-12694df51b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=411da18dd2464f7698f5b72cfc0d3d19)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:02.621570 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe2b0b-dba6-4ca7-a236-12694df51b8f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:02.907587 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-fabe2b0b-dba6-4ca7-a236-12694df51b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '411da18dd2464f7698f5b72cfc0d3d19'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:02.929748 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-fabe2b0b-dba6-4ca7-a236-12694df51b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '411da18dd2464f7698f5b72cfc0d3d19'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:03.091517 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-fabe2b0b-dba6-4ca7-a236-12694df51b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '411da18dd2464f7698f5b72cfc0d3d19'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:03.092350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-fabe2b0b-dba6-4ca7-a236-12694df51b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '411da18dd2464f7698f5b72cfc0d3d19'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:03.100718 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-fabe2b0b-dba6-4ca7-a236-12694df51b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '411da18dd2464f7698f5b72cfc0d3d19'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:03.107267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1066/2139] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:58:02 2022] DELETE /identity/v3/users/411da18dd2464f7698f5b72cfc0d3d19 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:03.588537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef2d33-bc17-49b4-9e61-f71289c03338 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:03.590355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-89ef2d33-bc17-49b4-9e61-f71289c03338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:03.605265 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef2d33-bc17-49b4-9e61-f71289c03338 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:03.667410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985e7a7-1a9d-48ed-82b0-01ef15a18242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:03.668269 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985e7a7-1a9d-48ed-82b0-01ef15a18242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:03.668547 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985e7a7-1a9d-48ed-82b0-01ef15a18242 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:03.668853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985e7a7-1a9d-48ed-82b0-01ef15a18242 admin admin] PATH_INFO: `/v3/projects/276da6aeeb484b9bb1291f92b47cdd6d` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:03.670138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985e7a7-1a9d-48ed-82b0-01ef15a18242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=276da6aeeb484b9bb1291f92b47cdd6d)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:03.672272 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985e7a7-1a9d-48ed-82b0-01ef15a18242 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:03.790387 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f985e7a7-1a9d-48ed-82b0-01ef15a18242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276da6aeeb484b9bb1291f92b47cdd6d', 'request_id': 'req-f985e7a7-1a9d-48ed-82b0-01ef15a18242'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:03.797553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f985e7a7-1a9d-48ed-82b0-01ef15a18242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276da6aeeb484b9bb1291f92b47cdd6d', 'request_id': 'req-f985e7a7-1a9d-48ed-82b0-01ef15a18242'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:03.883859 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f985e7a7-1a9d-48ed-82b0-01ef15a18242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276da6aeeb484b9bb1291f92b47cdd6d', 'request_id': 'req-f985e7a7-1a9d-48ed-82b0-01ef15a18242'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:03.926749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f985e7a7-1a9d-48ed-82b0-01ef15a18242 admin admin] The token cache is being invalidate because project 276da6aeeb484b9bb1291f92b47cdd6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:58:03.928701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f985e7a7-1a9d-48ed-82b0-01ef15a18242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:03.929438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f985e7a7-1a9d-48ed-82b0-01ef15a18242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:03.931445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1074/2140] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:58:03 2022] DELETE /identity/v3/projects/276da6aeeb484b9bb1291f92b47cdd6d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:03.937335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448162ba-4021-44ff-9bb4-e7e38a668868 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:03.938174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448162ba-4021-44ff-9bb4-e7e38a668868 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:03.940942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448162ba-4021-44ff-9bb4-e7e38a668868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:04.002925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-448162ba-4021-44ff-9bb4-e7e38a668868 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:04.004218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-448162ba-4021-44ff-9bb4-e7e38a668868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:04.006470 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:04.136504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1067/2141] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:04.144356 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa7b1a-6e33-404c-af27-f95539ac66c4 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:04.144663 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa7b1a-6e33-404c-af27-f95539ac66c4 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:04.145020 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa7b1a-6e33-404c-af27-f95539ac66c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:04.164104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-2cfa7b1a-6e33-404c-af27-f95539ac66c4 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:04.165301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2cfa7b1a-6e33-404c-af27-f95539ac66c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:04.173584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1075/2142] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:04.178261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448162ba-4021-44ff-9bb4-e7e38a668868 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:04.188285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448162ba-4021-44ff-9bb4-e7e38a668868 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:04.193870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3999fe6-748b-4d66-b9a8-33662303932b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:04.194527 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3999fe6-748b-4d66-b9a8-33662303932b admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:04.194807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3999fe6-748b-4d66-b9a8-33662303932b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:04.195077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3999fe6-748b-4d66-b9a8-33662303932b admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:04.195810 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3999fe6-748b-4d66-b9a8-33662303932b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:58:04.196236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3999fe6-748b-4d66-b9a8-33662303932b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:04.197858 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3999fe6-748b-4d66-b9a8-33662303932b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:04.212182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1068/2143] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:58:04.216715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa7b1a-6e33-404c-af27-f95539ac66c4 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:04.226353 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa7b1a-6e33-404c-af27-f95539ac66c4 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:04.231367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21c2d1-c98d-4fc9-8cf1-65f594ccf37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:04.235100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21c2d1-c98d-4fc9-8cf1-65f594ccf37c admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:04.235100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21c2d1-c98d-4fc9-8cf1-65f594ccf37c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:04.235100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21c2d1-c98d-4fc9-8cf1-65f594ccf37c admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:04.235100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21c2d1-c98d-4fc9-8cf1-65f594ccf37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:04.235435 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21c2d1-c98d-4fc9-8cf1-65f594ccf37c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:04.310052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1076/2144] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:58:04 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:04.311486 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3999fe6-748b-4d66-b9a8-33662303932b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:04.322827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3999fe6-748b-4d66-b9a8-33662303932b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:04.387257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f252fc6-cea5-4af6-af92-96c57f1a89f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:04.387914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f252fc6-cea5-4af6-af92-96c57f1a89f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:04.388194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f252fc6-cea5-4af6-af92-96c57f1a89f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:04.388468 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f252fc6-cea5-4af6-af92-96c57f1a89f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:04.389212 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f252fc6-cea5-4af6-af92-96c57f1a89f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:04.391356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f252fc6-cea5-4af6-af92-96c57f1a89f7 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:04.493029 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1069/2145] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:58:04 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:04.494593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21c2d1-c98d-4fc9-8cf1-65f594ccf37c admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:04.506079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21c2d1-c98d-4fc9-8cf1-65f594ccf37c admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:04.511559 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a5290-8c42-494a-980a-b946abfde0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:04.512227 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a5290-8c42-494a-980a-b946abfde0fb admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:04.512508 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a5290-8c42-494a-980a-b946abfde0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:04.513402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a5290-8c42-494a-980a-b946abfde0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:04.513810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a5290-8c42-494a-980a-b946abfde0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:04.516381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a5290-8c42-494a-980a-b946abfde0fb admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:04.536223 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1077/2146] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:04.537494 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f252fc6-cea5-4af6-af92-96c57f1a89f7 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:04.547882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f252fc6-cea5-4af6-af92-96c57f1a89f7 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:04.555419 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b27ee2-0fc2-4ea5-9de9-ff1fe7880f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:04.556095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b27ee2-0fc2-4ea5-9de9-ff1fe7880f02 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:04.556456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b27ee2-0fc2-4ea5-9de9-ff1fe7880f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:04.556681 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b27ee2-0fc2-4ea5-9de9-ff1fe7880f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:04.557416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b27ee2-0fc2-4ea5-9de9-ff1fe7880f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:04.564525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b27ee2-0fc2-4ea5-9de9-ff1fe7880f02 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:04.569676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1070/2147] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:04.573848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a5290-8c42-494a-980a-b946abfde0fb admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:04.585352 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a5290-8c42-494a-980a-b946abfde0fb admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:04.590140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e1977-5f53-4b38-b1e2-5ab8fc0e0397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:04.592944 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e1977-5f53-4b38-b1e2-5ab8fc0e0397 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:04.592944 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e1977-5f53-4b38-b1e2-5ab8fc0e0397 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:04.592944 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e1977-5f53-4b38-b1e2-5ab8fc0e0397 admin admin] PATH_INFO: `/v3/projects/1929c9cb13fc404082bf171c125159a0/users/31cde125c0394f84a4c60dc0605e2e6b/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:04.607597 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e1977-5f53-4b38-b1e2-5ab8fc0e0397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1929c9cb13fc404082bf171c125159a0, user_id=31cde125c0394f84a4c60dc0605e2e6b, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:04.610646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e1977-5f53-4b38-b1e2-5ab8fc0e0397 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:04.701601 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1078/2148] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:04 2022] PUT /identity/v3/projects/1929c9cb13fc404082bf171c125159a0/users/31cde125c0394f84a4c60dc0605e2e6b/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:58:04.712908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013fe22-45ba-4be5-a413-8a34ed9d70aa None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:04.713202 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013fe22-45ba-4be5-a413-8a34ed9d70aa None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:04.713664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013fe22-45ba-4be5-a413-8a34ed9d70aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:04.747356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-8013fe22-45ba-4be5-a413-8a34ed9d70aa None None] MFA Rules not processed for user `31cde125c0394f84a4c60dc0605e2e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:04.748573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8013fe22-45ba-4be5-a413-8a34ed9d70aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:04.813170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1071/2149] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:04.825049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e1977-5f53-4b38-b1e2-5ab8fc0e0397 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:04.843499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:04.887924 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e1977-5f53-4b38-b1e2-5ab8fc0e0397 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:04.892746 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974e98b-af4d-4db0-98ce-c273a14d4c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:04.893997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974e98b-af4d-4db0-98ce-c273a14d4c29 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:04.894285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974e98b-af4d-4db0-98ce-c273a14d4c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:04.894565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974e98b-af4d-4db0-98ce-c273a14d4c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:04.895270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974e98b-af4d-4db0-98ce-c273a14d4c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:04.897719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974e98b-af4d-4db0-98ce-c273a14d4c29 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:04.989300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1079/2150] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:58:04 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:04.992772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013fe22-45ba-4be5-a413-8a34ed9d70aa None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:05.004531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013fe22-45ba-4be5-a413-8a34ed9d70aa None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:05.028480 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:05.076144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c800d4-c4e2-42ab-a44e-fd4196047727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:05.077094 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c800d4-c4e2-42ab-a44e-fd4196047727 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:05.077381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c800d4-c4e2-42ab-a44e-fd4196047727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:05.077656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c800d4-c4e2-42ab-a44e-fd4196047727 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:05.078356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c800d4-c4e2-42ab-a44e-fd4196047727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:05.080252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c800d4-c4e2-42ab-a44e-fd4196047727 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:05.176284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1072/2151] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:58:04 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:05.179959 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974e98b-af4d-4db0-98ce-c273a14d4c29 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:05.191194 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974e98b-af4d-4db0-98ce-c273a14d4c29 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:05.196178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65c2b6-8574-4690-a24d-e930a417c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:05.197728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65c2b6-8574-4690-a24d-e930a417c7fd admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:05.197728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65c2b6-8574-4690-a24d-e930a417c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:05.197728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65c2b6-8574-4690-a24d-e930a417c7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:05.198190 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65c2b6-8574-4690-a24d-e930a417c7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:05.199780 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65c2b6-8574-4690-a24d-e930a417c7fd admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:05.211719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1080/2152] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:05.216854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c800d4-c4e2-42ab-a44e-fd4196047727 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:05.227172 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c800d4-c4e2-42ab-a44e-fd4196047727 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:05.233331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96494ce-d55f-4cbc-96fc-b23f1fde3613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:05.234222 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96494ce-d55f-4cbc-96fc-b23f1fde3613 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:05.234501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96494ce-d55f-4cbc-96fc-b23f1fde3613 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:05.234937 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96494ce-d55f-4cbc-96fc-b23f1fde3613 admin admin] PATH_INFO: `/v3/projects/504ac2e598f94c259c5f66df3c585ff4/users/077406010e91478fae6934c6ee92554c/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:05.252019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96494ce-d55f-4cbc-96fc-b23f1fde3613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=504ac2e598f94c259c5f66df3c585ff4, user_id=077406010e91478fae6934c6ee92554c, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:05.256280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96494ce-d55f-4cbc-96fc-b23f1fde3613 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:05.344311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1073/2153] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:05 2022] PUT /identity/v3/projects/504ac2e598f94c259c5f66df3c585ff4/users/077406010e91478fae6934c6ee92554c/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:05.348421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65c2b6-8574-4690-a24d-e930a417c7fd admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:05.363715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65c2b6-8574-4690-a24d-e930a417c7fd admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:05.425534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0d074-33b8-480d-be98-d65e6a901552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:05.426280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0d074-33b8-480d-be98-d65e6a901552 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:05.426622 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0d074-33b8-480d-be98-d65e6a901552 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:05.426966 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0d074-33b8-480d-be98-d65e6a901552 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:05.427731 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0d074-33b8-480d-be98-d65e6a901552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:05.429400 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0d074-33b8-480d-be98-d65e6a901552 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:05.440857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1081/2154] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:05.445150 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96494ce-d55f-4cbc-96fc-b23f1fde3613 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:05.456976 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96494ce-d55f-4cbc-96fc-b23f1fde3613 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:05.462059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4fd6f-e4ae-457f-8e1f-d3b52a88bfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:05.462968 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4fd6f-e4ae-457f-8e1f-d3b52a88bfc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:05.463241 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4fd6f-e4ae-457f-8e1f-d3b52a88bfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:05.463512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4fd6f-e4ae-457f-8e1f-d3b52a88bfc9 admin admin] PATH_INFO: `/v3/projects/504ac2e598f94c259c5f66df3c585ff4/users/077406010e91478fae6934c6ee92554c/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:05.465564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4fd6f-e4ae-457f-8e1f-d3b52a88bfc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=504ac2e598f94c259c5f66df3c585ff4, user_id=077406010e91478fae6934c6ee92554c, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:05.468456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4fd6f-e4ae-457f-8e1f-d3b52a88bfc9 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:05.480833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1074/2155] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:05 2022] PUT /identity/v3/projects/504ac2e598f94c259c5f66df3c585ff4/users/077406010e91478fae6934c6ee92554c/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:05.491688 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d185291-79ff-4855-b966-c7afb01e90cf None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:05.491976 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d185291-79ff-4855-b966-c7afb01e90cf None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:05.492253 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d185291-79ff-4855-b966-c7afb01e90cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:05.518418 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-7d185291-79ff-4855-b966-c7afb01e90cf None None] MFA Rules not processed for user `077406010e91478fae6934c6ee92554c`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:05.519983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7d185291-79ff-4855-b966-c7afb01e90cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:05.594319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1082/2156] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:05.605707 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4fd6f-e4ae-457f-8e1f-d3b52a88bfc9 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:05.608902 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-def4fd6f-e4ae-457f-8e1f-d3b52a88bfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:05.681595 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4fd6f-e4ae-457f-8e1f-d3b52a88bfc9 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:05.685238 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688d80c-1341-4333-a349-74bbef43f9ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:05.685879 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688d80c-1341-4333-a349-74bbef43f9ab service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:05.686160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688d80c-1341-4333-a349-74bbef43f9ab service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:05.686433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688d80c-1341-4333-a349-74bbef43f9ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:05.699942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:05.756695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688d80c-1341-4333-a349-74bbef43f9ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:05.758189 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688d80c-1341-4333-a349-74bbef43f9ab service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:05.786952 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1075/2157] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:58:15.800985 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:16.359749 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=21 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:18.379572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d185291-79ff-4855-b966-c7afb01e90cf None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:18.441137 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d185291-79ff-4855-b966-c7afb01e90cf None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:18.445634 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c7780-c077-42c6-972e-809e53c3571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:18.446482 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c7780-c077-42c6-972e-809e53c3571b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:18.446767 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c7780-c077-42c6-972e-809e53c3571b admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:18.447040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c7780-c077-42c6-972e-809e53c3571b admin admin] PATH_INFO: `/v3/users/31cde125c0394f84a4c60dc0605e2e6b` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:18.448214 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c7780-c077-42c6-972e-809e53c3571b admin admin] RBAC: Authorizing `identity:delete_user(user_id=31cde125c0394f84a4c60dc0605e2e6b)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:18.450151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c7780-c077-42c6-972e-809e53c3571b admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:18.607858 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-250c7780-c077-42c6-972e-809e53c3571b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31cde125c0394f84a4c60dc0605e2e6b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:18.620160 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-250c7780-c077-42c6-972e-809e53c3571b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31cde125c0394f84a4c60dc0605e2e6b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:18.703072 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-250c7780-c077-42c6-972e-809e53c3571b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31cde125c0394f84a4c60dc0605e2e6b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:18.703784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-250c7780-c077-42c6-972e-809e53c3571b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31cde125c0394f84a4c60dc0605e2e6b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:18.712483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-250c7780-c077-42c6-972e-809e53c3571b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31cde125c0394f84a4c60dc0605e2e6b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:18.718791 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1083/2158] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:58:18 2022] DELETE /identity/v3/users/31cde125c0394f84a4c60dc0605e2e6b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:18.724073 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9670d9-ba4c-4299-9941-c19c30f7d585 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:18.724526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9670d9-ba4c-4299-9941-c19c30f7d585 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:18.724614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9670d9-ba4c-4299-9941-c19c30f7d585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:18.742450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-8b9670d9-ba4c-4299-9941-c19c30f7d585 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:18.743577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8b9670d9-ba4c-4299-9941-c19c30f7d585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:18.812050 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1076/2159] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:18.822139 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c7780-c077-42c6-972e-809e53c3571b admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:18.828117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-250c7780-c077-42c6-972e-809e53c3571b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:18.901076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c7780-c077-42c6-972e-809e53c3571b admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:18.904665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764df2b-3937-4836-90be-9a1ca5eb451e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:18.905293 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764df2b-3937-4836-90be-9a1ca5eb451e service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:18.905573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764df2b-3937-4836-90be-9a1ca5eb451e service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:18.905845 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764df2b-3937-4836-90be-9a1ca5eb451e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:18.915631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764df2b-3937-4836-90be-9a1ca5eb451e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:18.917079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764df2b-3937-4836-90be-9a1ca5eb451e service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:18.926614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1084/2160] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:58:19.411543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9670d9-ba4c-4299-9941-c19c30f7d585 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:19.413353 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8b9670d9-ba4c-4299-9941-c19c30f7d585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:19.429262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9670d9-ba4c-4299-9941-c19c30f7d585 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:19.437491 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1c4a4-1395-4053-9b3f-8856df15cdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:19.438406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1c4a4-1395-4053-9b3f-8856df15cdb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:19.438722 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1c4a4-1395-4053-9b3f-8856df15cdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:19.439250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1c4a4-1395-4053-9b3f-8856df15cdb6 admin admin] PATH_INFO: `/v3/projects/1929c9cb13fc404082bf171c125159a0` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:19.441176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1c4a4-1395-4053-9b3f-8856df15cdb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1929c9cb13fc404082bf171c125159a0)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:19.443123 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1c4a4-1395-4053-9b3f-8856df15cdb6 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:19.590041 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3be1c4a4-1395-4053-9b3f-8856df15cdb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1929c9cb13fc404082bf171c125159a0', 'request_id': 'req-3be1c4a4-1395-4053-9b3f-8856df15cdb6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:19.685773 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3be1c4a4-1395-4053-9b3f-8856df15cdb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1929c9cb13fc404082bf171c125159a0', 'request_id': 'req-3be1c4a4-1395-4053-9b3f-8856df15cdb6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:19.693341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3be1c4a4-1395-4053-9b3f-8856df15cdb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1929c9cb13fc404082bf171c125159a0', 'request_id': 'req-3be1c4a4-1395-4053-9b3f-8856df15cdb6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:19.703614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3be1c4a4-1395-4053-9b3f-8856df15cdb6 admin admin] The token cache is being invalidate because project 1929c9cb13fc404082bf171c125159a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:58:19.703839 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3be1c4a4-1395-4053-9b3f-8856df15cdb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:19.704472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3be1c4a4-1395-4053-9b3f-8856df15cdb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:19.706985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1077/2161] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:58:19 2022] DELETE /identity/v3/projects/1929c9cb13fc404082bf171c125159a0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:19.710938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764df2b-3937-4836-90be-9a1ca5eb451e service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:19.715838 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:19.721898 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764df2b-3937-4836-90be-9a1ca5eb451e service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:19.779061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72430b47-9e2b-42e1-a32e-fd31d651e1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:19.779878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72430b47-9e2b-42e1-a32e-fd31d651e1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:19.780167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72430b47-9e2b-42e1-a32e-fd31d651e1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:19.780444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72430b47-9e2b-42e1-a32e-fd31d651e1ff admin admin] PATH_INFO: `/v3/users/077406010e91478fae6934c6ee92554c` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:19.781733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72430b47-9e2b-42e1-a32e-fd31d651e1ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=077406010e91478fae6934c6ee92554c)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:19.784003 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72430b47-9e2b-42e1-a32e-fd31d651e1ff admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:19.927929 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-72430b47-9e2b-42e1-a32e-fd31d651e1ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '077406010e91478fae6934c6ee92554c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:19.941191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-72430b47-9e2b-42e1-a32e-fd31d651e1ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '077406010e91478fae6934c6ee92554c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:20.028017 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-72430b47-9e2b-42e1-a32e-fd31d651e1ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '077406010e91478fae6934c6ee92554c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:20.028565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-72430b47-9e2b-42e1-a32e-fd31d651e1ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '077406010e91478fae6934c6ee92554c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:20.036006 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-72430b47-9e2b-42e1-a32e-fd31d651e1ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '077406010e91478fae6934c6ee92554c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:20.042099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1085/2162] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:58:19 2022] DELETE /identity/v3/users/077406010e91478fae6934c6ee92554c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:20.489942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1c4a4-1395-4053-9b3f-8856df15cdb6 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:20.491411 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-3be1c4a4-1395-4053-9b3f-8856df15cdb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:20.506239 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1c4a4-1395-4053-9b3f-8856df15cdb6 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:20.568372 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ef91a-6f0a-43fa-b346-bf9c40d25223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:20.569282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ef91a-6f0a-43fa-b346-bf9c40d25223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:20.569569 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ef91a-6f0a-43fa-b346-bf9c40d25223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:20.569842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ef91a-6f0a-43fa-b346-bf9c40d25223 admin admin] PATH_INFO: `/v3/projects/504ac2e598f94c259c5f66df3c585ff4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:20.571048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ef91a-6f0a-43fa-b346-bf9c40d25223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=504ac2e598f94c259c5f66df3c585ff4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:20.573065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ef91a-6f0a-43fa-b346-bf9c40d25223 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:20.709981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:20.726395 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-350ef91a-6f0a-43fa-b346-bf9c40d25223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504ac2e598f94c259c5f66df3c585ff4', 'request_id': 'req-350ef91a-6f0a-43fa-b346-bf9c40d25223'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:20.833635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-350ef91a-6f0a-43fa-b346-bf9c40d25223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504ac2e598f94c259c5f66df3c585ff4', 'request_id': 'req-350ef91a-6f0a-43fa-b346-bf9c40d25223'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:20.840077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-350ef91a-6f0a-43fa-b346-bf9c40d25223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504ac2e598f94c259c5f66df3c585ff4', 'request_id': 'req-350ef91a-6f0a-43fa-b346-bf9c40d25223'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:20.851223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-350ef91a-6f0a-43fa-b346-bf9c40d25223 admin admin] The token cache is being invalidate because project 504ac2e598f94c259c5f66df3c585ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:58:20.851508 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-350ef91a-6f0a-43fa-b346-bf9c40d25223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:20.852143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-350ef91a-6f0a-43fa-b346-bf9c40d25223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:20.853706 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1078/2163] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:58:20 2022] DELETE /identity/v3/projects/504ac2e598f94c259c5f66df3c585ff4 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:20.861359 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db07c5-cd49-4696-be4c-0b7830ebab40 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:20.861920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db07c5-cd49-4696-be4c-0b7830ebab40 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:20.861920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db07c5-cd49-4696-be4c-0b7830ebab40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:20.893314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-40db07c5-cd49-4696-be4c-0b7830ebab40 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:20.897608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-40db07c5-cd49-4696-be4c-0b7830ebab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:20.959457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1086/2164] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:58:20.967298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e38e0f-98e4-4fc0-8280-92fb4ea5dc2e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:20.967588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e38e0f-98e4-4fc0-8280-92fb4ea5dc2e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:20.967868 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e38e0f-98e4-4fc0-8280-92fb4ea5dc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:20.987298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-42e38e0f-98e4-4fc0-8280-92fb4ea5dc2e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:20.988500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-42e38e0f-98e4-4fc0-8280-92fb4ea5dc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:20.999533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1079/2165] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:21.000931 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db07c5-cd49-4696-be4c-0b7830ebab40 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:21.011605 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db07c5-cd49-4696-be4c-0b7830ebab40 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:21.016436 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226ad12-360b-4ed3-aea4-1d70509c7c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:21.017102 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226ad12-360b-4ed3-aea4-1d70509c7c03 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:21.017377 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226ad12-360b-4ed3-aea4-1d70509c7c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:21.017664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226ad12-360b-4ed3-aea4-1d70509c7c03 admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:21.018903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226ad12-360b-4ed3-aea4-1d70509c7c03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:58:21.019206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226ad12-360b-4ed3-aea4-1d70509c7c03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:21.020901 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226ad12-360b-4ed3-aea4-1d70509c7c03 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:21.030333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:21.038132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1087/2166] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:58:21.043407 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e38e0f-98e4-4fc0-8280-92fb4ea5dc2e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:21.050317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e38e0f-98e4-4fc0-8280-92fb4ea5dc2e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:21.055743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a992604-3b62-4fa2-962c-c3fc0d01455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:21.056440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a992604-3b62-4fa2-962c-c3fc0d01455d admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:21.056762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a992604-3b62-4fa2-962c-c3fc0d01455d admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:21.057044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a992604-3b62-4fa2-962c-c3fc0d01455d admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:21.058301 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a992604-3b62-4fa2-962c-c3fc0d01455d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:21.059645 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a992604-3b62-4fa2-962c-c3fc0d01455d admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:21.184245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1080/2167] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:58:21 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:58:21.188476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226ad12-360b-4ed3-aea4-1d70509c7c03 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:21.201989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226ad12-360b-4ed3-aea4-1d70509c7c03 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:21.211961 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a992604-3b62-4fa2-962c-c3fc0d01455d admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:21.213747 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7a992604-3b62-4fa2-962c-c3fc0d01455d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:21.261307 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f3010-c201-496c-ad14-a6015515bafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:21.261966 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f3010-c201-496c-ad14-a6015515bafb admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:21.262247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f3010-c201-496c-ad14-a6015515bafb admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:21.262523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f3010-c201-496c-ad14-a6015515bafb admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:21.263204 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f3010-c201-496c-ad14-a6015515bafb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:21.265135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f3010-c201-496c-ad14-a6015515bafb admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:21.277355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a992604-3b62-4fa2-962c-c3fc0d01455d admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:21.282100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee273-0c1b-456e-97b5-5dc77b083b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:21.282957 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee273-0c1b-456e-97b5-5dc77b083b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:21.283258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee273-0c1b-456e-97b5-5dc77b083b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:21.283549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee273-0c1b-456e-97b5-5dc77b083b13 admin admin] PATH_INFO: `/v3/users/45d8a8b823ac4b7b980c2667bc486ee6` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:21.284790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ee273-0c1b-456e-97b5-5dc77b083b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d8a8b823ac4b7b980c2667bc486ee6)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:21.289116 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ee273-0c1b-456e-97b5-5dc77b083b13 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:21.378285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1088/2168] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:58:21 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:21.382202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f3010-c201-496c-ad14-a6015515bafb admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:21.392667 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f3010-c201-496c-ad14-a6015515bafb admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:21.398280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb60ce0-41c6-4efb-bfdc-caa468807249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:21.398974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb60ce0-41c6-4efb-bfdc-caa468807249 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:21.399261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb60ce0-41c6-4efb-bfdc-caa468807249 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:21.399540 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb60ce0-41c6-4efb-bfdc-caa468807249 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:21.400279 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb60ce0-41c6-4efb-bfdc-caa468807249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:21.402044 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb60ce0-41c6-4efb-bfdc-caa468807249 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:21.412380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1089/2169] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:58:21.416283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb60ce0-41c6-4efb-bfdc-caa468807249 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:21.425970 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb60ce0-41c6-4efb-bfdc-caa468807249 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:21.430738 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9bc66-4f5d-40a9-8549-4f0567076171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:21.431392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9bc66-4f5d-40a9-8549-4f0567076171 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:21.431677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9bc66-4f5d-40a9-8549-4f0567076171 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:21.432016 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9bc66-4f5d-40a9-8549-4f0567076171 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:21.432780 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9bc66-4f5d-40a9-8549-4f0567076171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:21.434368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9bc66-4f5d-40a9-8549-4f0567076171 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:21.446259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1090/2170] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:58:21.450208 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9bc66-4f5d-40a9-8549-4f0567076171 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:21.461427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9bc66-4f5d-40a9-8549-4f0567076171 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:21.470469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03722512-d1c8-44d6-a925-c880c6eef5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:21.472307 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03722512-d1c8-44d6-a925-c880c6eef5d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:21.477148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03722512-d1c8-44d6-a925-c880c6eef5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:21.477148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03722512-d1c8-44d6-a925-c880c6eef5d3 admin admin] PATH_INFO: `/v3/projects/253d5ed8735d445c930140b6d91136c8/users/4f764a725deb405198f95d583035b371/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:21.477634 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5e1ee273-0c1b-456e-97b5-5dc77b083b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d8a8b823ac4b7b980c2667bc486ee6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:21.500522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5e1ee273-0c1b-456e-97b5-5dc77b083b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d8a8b823ac4b7b980c2667bc486ee6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:21.510784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03722512-d1c8-44d6-a925-c880c6eef5d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=253d5ed8735d445c930140b6d91136c8, user_id=4f764a725deb405198f95d583035b371, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:21.513506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03722512-d1c8-44d6-a925-c880c6eef5d3 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:21.668444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5e1ee273-0c1b-456e-97b5-5dc77b083b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d8a8b823ac4b7b980c2667bc486ee6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:21.669282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5e1ee273-0c1b-456e-97b5-5dc77b083b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d8a8b823ac4b7b980c2667bc486ee6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:21.678825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5e1ee273-0c1b-456e-97b5-5dc77b083b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d8a8b823ac4b7b980c2667bc486ee6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:21.695104 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1081/2171] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:58:21 2022] DELETE /identity/v3/users/45d8a8b823ac4b7b980c2667bc486ee6 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:58:21.700091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c59eef-170a-46fd-9c13-b4881a30220e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:21.700628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c59eef-170a-46fd-9c13-b4881a30220e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:21.701672 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c59eef-170a-46fd-9c13-b4881a30220e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:21.705821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1091/2172] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:21 2022] PUT /identity/v3/projects/253d5ed8735d445c930140b6d91136c8/users/4f764a725deb405198f95d583035b371/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:58:21.713024 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:21.714652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbaf95-227c-4a9b-83be-df2bc526bc0a None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:21.715525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbaf95-227c-4a9b-83be-df2bc526bc0a None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:21.715877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbaf95-227c-4a9b-83be-df2bc526bc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:21.725644 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-e9c59eef-170a-46fd-9c13-b4881a30220e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:21.726898 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-e9c59eef-170a-46fd-9c13-b4881a30220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:21.735534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-98cbaf95-227c-4a9b-83be-df2bc526bc0a None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:21.739099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-98cbaf95-227c-4a9b-83be-df2bc526bc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:21.796208 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1082/2173] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:58:21.808342 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c59eef-170a-46fd-9c13-b4881a30220e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:21.810364 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-e9c59eef-170a-46fd-9c13-b4881a30220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:21.817060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1092/2174] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:21.824298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbaf95-227c-4a9b-83be-df2bc526bc0a None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:21.826138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-98cbaf95-227c-4a9b-83be-df2bc526bc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:21.878194 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:21.882162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c59eef-170a-46fd-9c13-b4881a30220e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:21.887194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39568035-e22f-461f-a2c3-12277e42601b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:21.887883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39568035-e22f-461f-a2c3-12277e42601b service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:21.888009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39568035-e22f-461f-a2c3-12277e42601b service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:21.888223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39568035-e22f-461f-a2c3-12277e42601b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:21.890139 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbaf95-227c-4a9b-83be-df2bc526bc0a None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:21.896386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b44436-23e1-4fe8-83aa-eb3c740a37d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:21.896386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b44436-23e1-4fe8-83aa-eb3c740a37d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:21.896386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b44436-23e1-4fe8-83aa-eb3c740a37d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:21.896386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b44436-23e1-4fe8-83aa-eb3c740a37d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:21.899521 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39568035-e22f-461f-a2c3-12277e42601b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:21.901174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39568035-e22f-461f-a2c3-12277e42601b service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:21.910203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b44436-23e1-4fe8-83aa-eb3c740a37d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:21.911168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1083/2175] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:58:21.913390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b44436-23e1-4fe8-83aa-eb3c740a37d3 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:21.931172 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1093/2176] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:58:22.484887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39568035-e22f-461f-a2c3-12277e42601b service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:22.484887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-39568035-e22f-461f-a2c3-12277e42601b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:22.500208 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39568035-e22f-461f-a2c3-12277e42601b service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:22.512405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9f850-035b-415d-8e0d-1d696c48c2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:22.512405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9f850-035b-415d-8e0d-1d696c48c2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:22.512405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9f850-035b-415d-8e0d-1d696c48c2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:22.512405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9f850-035b-415d-8e0d-1d696c48c2d9 admin admin] PATH_INFO: `/v3/projects/b97754fe254c4f53bf8e9ca81bc08e83` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:22.514321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9f850-035b-415d-8e0d-1d696c48c2d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97754fe254c4f53bf8e9ca81bc08e83)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:22.519108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9f850-035b-415d-8e0d-1d696c48c2d9 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:22.634879 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f1a9f850-035b-415d-8e0d-1d696c48c2d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97754fe254c4f53bf8e9ca81bc08e83', 'request_id': 'req-f1a9f850-035b-415d-8e0d-1d696c48c2d9'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:22.718346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f1a9f850-035b-415d-8e0d-1d696c48c2d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97754fe254c4f53bf8e9ca81bc08e83', 'request_id': 'req-f1a9f850-035b-415d-8e0d-1d696c48c2d9'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:22.726627 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f1a9f850-035b-415d-8e0d-1d696c48c2d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97754fe254c4f53bf8e9ca81bc08e83', 'request_id': 'req-f1a9f850-035b-415d-8e0d-1d696c48c2d9'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:22.740904 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f1a9f850-035b-415d-8e0d-1d696c48c2d9 admin admin] The token cache is being invalidate because project b97754fe254c4f53bf8e9ca81bc08e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:58:22.741184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f1a9f850-035b-415d-8e0d-1d696c48c2d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:22.741895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-f1a9f850-035b-415d-8e0d-1d696c48c2d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:22.743427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1084/2177] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:58:22 2022] DELETE /identity/v3/projects/b97754fe254c4f53bf8e9ca81bc08e83 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:22.747312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b44436-23e1-4fe8-83aa-eb3c740a37d3 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:22.757688 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b44436-23e1-4fe8-83aa-eb3c740a37d3 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:22.827096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3c596-8eb7-4cc3-bdf2-e18a0bfaea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:22.827973 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3c596-8eb7-4cc3-bdf2-e18a0bfaea28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:22.828255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3c596-8eb7-4cc3-bdf2-e18a0bfaea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:22.828531 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3c596-8eb7-4cc3-bdf2-e18a0bfaea28 admin admin] PATH_INFO: `/v3/users/8dbe4e9eae194280935b2c347d7ad475` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:22.829756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3c596-8eb7-4cc3-bdf2-e18a0bfaea28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbe4e9eae194280935b2c347d7ad475)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:22.832267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3c596-8eb7-4cc3-bdf2-e18a0bfaea28 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:23.040733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c2a3c596-8eb7-4cc3-bdf2-e18a0bfaea28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbe4e9eae194280935b2c347d7ad475'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:23.059104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c2a3c596-8eb7-4cc3-bdf2-e18a0bfaea28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbe4e9eae194280935b2c347d7ad475'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:23.123462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c2a3c596-8eb7-4cc3-bdf2-e18a0bfaea28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbe4e9eae194280935b2c347d7ad475'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:23.124099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c2a3c596-8eb7-4cc3-bdf2-e18a0bfaea28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbe4e9eae194280935b2c347d7ad475'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:23.133217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c2a3c596-8eb7-4cc3-bdf2-e18a0bfaea28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbe4e9eae194280935b2c347d7ad475'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:23.144811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1094/2178] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:58:22 2022] DELETE /identity/v3/users/8dbe4e9eae194280935b2c347d7ad475 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:23.704062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9f850-035b-415d-8e0d-1d696c48c2d9 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:23.706948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f1a9f850-035b-415d-8e0d-1d696c48c2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:23.724258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9f850-035b-415d-8e0d-1d696c48c2d9 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:23.762602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:23.805169 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffa624-9f66-47bf-9163-b8c44f08c695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:23.805169 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffa624-9f66-47bf-9163-b8c44f08c695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:23.805169 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffa624-9f66-47bf-9163-b8c44f08c695 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:23.805169 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffa624-9f66-47bf-9163-b8c44f08c695 admin admin] PATH_INFO: `/v3/projects/19bb36ad21c04897ac67e56b3a1e287a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:23.805585 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffa624-9f66-47bf-9163-b8c44f08c695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19bb36ad21c04897ac67e56b3a1e287a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:23.805585 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffa624-9f66-47bf-9163-b8c44f08c695 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:23.954933 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3bffa624-9f66-47bf-9163-b8c44f08c695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19bb36ad21c04897ac67e56b3a1e287a', 'request_id': 'req-3bffa624-9f66-47bf-9163-b8c44f08c695'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:24.034165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3bffa624-9f66-47bf-9163-b8c44f08c695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19bb36ad21c04897ac67e56b3a1e287a', 'request_id': 'req-3bffa624-9f66-47bf-9163-b8c44f08c695'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:24.040939 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3bffa624-9f66-47bf-9163-b8c44f08c695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19bb36ad21c04897ac67e56b3a1e287a', 'request_id': 'req-3bffa624-9f66-47bf-9163-b8c44f08c695'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:24.051798 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3bffa624-9f66-47bf-9163-b8c44f08c695 admin admin] The token cache is being invalidate because project 19bb36ad21c04897ac67e56b3a1e287a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:58:24.052086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3bffa624-9f66-47bf-9163-b8c44f08c695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:24.052748 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3bffa624-9f66-47bf-9163-b8c44f08c695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:24.054290 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1085/2179] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:58:23 2022] DELETE /identity/v3/projects/19bb36ad21c04897ac67e56b3a1e287a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:24.059592 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5f632-c265-4278-b565-1444d1951d00 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:24.060103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5f632-c265-4278-b565-1444d1951d00 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:24.060208 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5f632-c265-4278-b565-1444d1951d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:24.083643 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-7ec5f632-c265-4278-b565-1444d1951d00 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:24.090801 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7ec5f632-c265-4278-b565-1444d1951d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:24.193539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1095/2180] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:24.202580 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa97d43-abe8-40ac-bec1-bdb690db582f None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:24.202580 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa97d43-abe8-40ac-bec1-bdb690db582f None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:24.202777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa97d43-abe8-40ac-bec1-bdb690db582f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:24.237677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-efa97d43-abe8-40ac-bec1-bdb690db582f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:24.240113 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-efa97d43-abe8-40ac-bec1-bdb690db582f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:24.253203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5f632-c265-4278-b565-1444d1951d00 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:24.259492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1086/2181] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:24.264726 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5f632-c265-4278-b565-1444d1951d00 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:24.272527 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518aec8a-5386-4221-9a1f-252ba1f097bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:24.274285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aec8a-5386-4221-9a1f-252ba1f097bd admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:24.274285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aec8a-5386-4221-9a1f-252ba1f097bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:24.274494 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aec8a-5386-4221-9a1f-252ba1f097bd admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:24.275216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518aec8a-5386-4221-9a1f-252ba1f097bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:58:24.275526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518aec8a-5386-4221-9a1f-252ba1f097bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:24.278074 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518aec8a-5386-4221-9a1f-252ba1f097bd admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:24.281150 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:24.293717 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1096/2182] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:58:24.298144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa97d43-abe8-40ac-bec1-bdb690db582f None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:24.308592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa97d43-abe8-40ac-bec1-bdb690db582f None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:24.313562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e8e1f-ed95-47b8-8209-e0de871046a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:24.314564 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e8e1f-ed95-47b8-8209-e0de871046a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:24.315011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e8e1f-ed95-47b8-8209-e0de871046a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:24.315354 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e8e1f-ed95-47b8-8209-e0de871046a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:24.316098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e8e1f-ed95-47b8-8209-e0de871046a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:24.318012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e8e1f-ed95-47b8-8209-e0de871046a9 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:24.430942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1087/2183] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:58:24 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:24.435329 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518aec8a-5386-4221-9a1f-252ba1f097bd admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:24.446536 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518aec8a-5386-4221-9a1f-252ba1f097bd admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:24.520331 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7abf1-a25b-43ba-8ca3-a7b57f82b419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:24.521061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7abf1-a25b-43ba-8ca3-a7b57f82b419 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:24.521347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7abf1-a25b-43ba-8ca3-a7b57f82b419 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:24.521623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7abf1-a25b-43ba-8ca3-a7b57f82b419 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:24.522332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7abf1-a25b-43ba-8ca3-a7b57f82b419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:24.524269 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7abf1-a25b-43ba-8ca3-a7b57f82b419 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:24.641756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1097/2184] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:58:24 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:24.646728 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e8e1f-ed95-47b8-8209-e0de871046a9 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:24.663778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e8e1f-ed95-47b8-8209-e0de871046a9 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:24.674328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf08ab-04f4-45e4-bf5b-13e4b603b3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:24.674328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf08ab-04f4-45e4-bf5b-13e4b603b3af admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:24.674328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf08ab-04f4-45e4-bf5b-13e4b603b3af admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:24.674328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf08ab-04f4-45e4-bf5b-13e4b603b3af admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:24.675071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf08ab-04f4-45e4-bf5b-13e4b603b3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:24.678063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf08ab-04f4-45e4-bf5b-13e4b603b3af admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:24.713125 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1088/2185] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:24.717188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7abf1-a25b-43ba-8ca3-a7b57f82b419 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:24.730208 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7abf1-a25b-43ba-8ca3-a7b57f82b419 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:24.735765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f2f2a-a9e6-4e27-ba04-37e515d50352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:24.736056 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f2f2a-a9e6-4e27-ba04-37e515d50352 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:24.736393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f2f2a-a9e6-4e27-ba04-37e515d50352 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:24.736764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f2f2a-a9e6-4e27-ba04-37e515d50352 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:24.737810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f2f2a-a9e6-4e27-ba04-37e515d50352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:24.739432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f2f2a-a9e6-4e27-ba04-37e515d50352 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:24.762553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1098/2186] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:58:24.768269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf08ab-04f4-45e4-bf5b-13e4b603b3af admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:24.776841 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf08ab-04f4-45e4-bf5b-13e4b603b3af admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:24.800916 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec4a71-f801-4b46-885b-cf9163569d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:24.801855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec4a71-f801-4b46-885b-cf9163569d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:24.802146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec4a71-f801-4b46-885b-cf9163569d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:24.802426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec4a71-f801-4b46-885b-cf9163569d25 admin admin] PATH_INFO: `/v3/projects/62907f54d3e24f29963bd4a94612bf8d/users/48d7fea7d9844770bc8ede41b4feb419/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:24.874792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec4a71-f801-4b46-885b-cf9163569d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62907f54d3e24f29963bd4a94612bf8d, user_id=48d7fea7d9844770bc8ede41b4feb419, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:24.877864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec4a71-f801-4b46-885b-cf9163569d25 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:24.979807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1089/2187] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:24 2022] PUT /identity/v3/projects/62907f54d3e24f29963bd4a94612bf8d/users/48d7fea7d9844770bc8ede41b4feb419/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:24.992253 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd4016-60df-439e-8b21-b0a436b42cc8 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:24.992555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd4016-60df-439e-8b21-b0a436b42cc8 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:24.992872 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd4016-60df-439e-8b21-b0a436b42cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:25.026469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-35fd4016-60df-439e-8b21-b0a436b42cc8 None None] MFA Rules not processed for user `48d7fea7d9844770bc8ede41b4feb419`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:25.027733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-35fd4016-60df-439e-8b21-b0a436b42cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:25.126318 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1099/2188] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:25.130717 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec4a71-f801-4b46-885b-cf9163569d25 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:25.266811 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:25.273580 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec4a71-f801-4b46-885b-cf9163569d25 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:25.279923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f5220-b912-403b-b787-2dc4308d3c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:25.280768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f5220-b912-403b-b787-2dc4308d3c82 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:25.281116 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f5220-b912-403b-b787-2dc4308d3c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:25.281467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f5220-b912-403b-b787-2dc4308d3c82 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:25.282244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f5220-b912-403b-b787-2dc4308d3c82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:25.284991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f5220-b912-403b-b787-2dc4308d3c82 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:25.426063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1090/2189] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:58:25 2022] POST /identity/v3/projects => generated 385 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:25.427252 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd4016-60df-439e-8b21-b0a436b42cc8 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:25.442032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd4016-60df-439e-8b21-b0a436b42cc8 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:25.570051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40267275-608e-4021-8f90-ddbf430b7d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:25.571064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40267275-608e-4021-8f90-ddbf430b7d24 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:25.571404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40267275-608e-4021-8f90-ddbf430b7d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:25.571686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40267275-608e-4021-8f90-ddbf430b7d24 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:25.572395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40267275-608e-4021-8f90-ddbf430b7d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:25.574467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40267275-608e-4021-8f90-ddbf430b7d24 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:25.588502 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:25.718268 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1100/2190] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:58:25 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:25.720151 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f5220-b912-403b-b787-2dc4308d3c82 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:25.734179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f5220-b912-403b-b787-2dc4308d3c82 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:25.746014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc9cf6-0099-4d89-85d5-2d79494f2929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:25.749484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc9cf6-0099-4d89-85d5-2d79494f2929 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:25.750128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc9cf6-0099-4d89-85d5-2d79494f2929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:25.750618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc9cf6-0099-4d89-85d5-2d79494f2929 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:25.752751 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc9cf6-0099-4d89-85d5-2d79494f2929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:25.757846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc9cf6-0099-4d89-85d5-2d79494f2929 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:25.776975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1091/2191] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:25.781417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40267275-608e-4021-8f90-ddbf430b7d24 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:25.792989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40267275-608e-4021-8f90-ddbf430b7d24 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:25.799046 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fb0dc-314d-4309-99f3-b0bbdae70463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:25.799922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fb0dc-314d-4309-99f3-b0bbdae70463 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:25.800213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fb0dc-314d-4309-99f3-b0bbdae70463 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:25.800882 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fb0dc-314d-4309-99f3-b0bbdae70463 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:25.801290 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fb0dc-314d-4309-99f3-b0bbdae70463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:25.803217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fb0dc-314d-4309-99f3-b0bbdae70463 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:25.820478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1101/2192] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:25.824934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc9cf6-0099-4d89-85d5-2d79494f2929 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:25.836618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc9cf6-0099-4d89-85d5-2d79494f2929 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:25.841580 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cdd01-07f8-4f08-9365-3e4deb9d1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:25.842636 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cdd01-07f8-4f08-9365-3e4deb9d1773 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:25.843071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cdd01-07f8-4f08-9365-3e4deb9d1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:25.843369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cdd01-07f8-4f08-9365-3e4deb9d1773 admin admin] PATH_INFO: `/v3/projects/87208ee8438f4ded8562f713926d336a/users/2a0b47ce732343f8944247aea54fcdab/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:25.903192 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cdd01-07f8-4f08-9365-3e4deb9d1773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87208ee8438f4ded8562f713926d336a, user_id=2a0b47ce732343f8944247aea54fcdab, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:25.927772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cdd01-07f8-4f08-9365-3e4deb9d1773 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:26.014416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1092/2193] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:25 2022] PUT /identity/v3/projects/87208ee8438f4ded8562f713926d336a/users/2a0b47ce732343f8944247aea54fcdab/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:26.025678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d28c0-60b2-47d4-ab19-8f345127cdfd None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:26.027416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d28c0-60b2-47d4-ab19-8f345127cdfd None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:26.027706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d28c0-60b2-47d4-ab19-8f345127cdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:26.081804 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-b46d28c0-60b2-47d4-ab19-8f345127cdfd None None] MFA Rules not processed for user `2a0b47ce732343f8944247aea54fcdab`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:26.081804 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b46d28c0-60b2-47d4-ab19-8f345127cdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:26.157706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1102/2194] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:26.162974 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cdd01-07f8-4f08-9365-3e4deb9d1773 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:26.266375 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cdd01-07f8-4f08-9365-3e4deb9d1773 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:26.274690 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c844c-90ab-460e-b5d1-bcb5df677a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:26.276975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c844c-90ab-460e-b5d1-bcb5df677a17 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:26.276975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c844c-90ab-460e-b5d1-bcb5df677a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:26.276975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c844c-90ab-460e-b5d1-bcb5df677a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:26.276975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c844c-90ab-460e-b5d1-bcb5df677a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:26.278842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c844c-90ab-460e-b5d1-bcb5df677a17 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:26.390594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1093/2195] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:58:26 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:58:26.394703 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d28c0-60b2-47d4-ab19-8f345127cdfd None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:26.409068 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d28c0-60b2-47d4-ab19-8f345127cdfd None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:26.477542 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be144c6f-5889-4011-9bc4-8af6ee65625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:26.478225 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be144c6f-5889-4011-9bc4-8af6ee65625a admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:26.478515 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be144c6f-5889-4011-9bc4-8af6ee65625a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:26.479164 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be144c6f-5889-4011-9bc4-8af6ee65625a admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:26.479490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be144c6f-5889-4011-9bc4-8af6ee65625a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:26.481576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be144c6f-5889-4011-9bc4-8af6ee65625a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:26.557225 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c844c-90ab-460e-b5d1-bcb5df677a17 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:26.557644 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1103/2196] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:58:26 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:26.569544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c844c-90ab-460e-b5d1-bcb5df677a17 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:26.574521 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f7841-3724-428e-8f63-57a78f980974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:26.575186 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f7841-3724-428e-8f63-57a78f980974 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:26.575468 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f7841-3724-428e-8f63-57a78f980974 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:26.575743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f7841-3724-428e-8f63-57a78f980974 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:26.576479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f7841-3724-428e-8f63-57a78f980974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:26.578100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f7841-3724-428e-8f63-57a78f980974 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:26.597075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1094/2197] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:26.598473 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be144c6f-5889-4011-9bc4-8af6ee65625a admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:26.613284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be144c6f-5889-4011-9bc4-8af6ee65625a admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:26.618664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a911c-65a1-4c32-9518-c2c9fdf18c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:26.621003 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a911c-65a1-4c32-9518-c2c9fdf18c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:26.621003 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a911c-65a1-4c32-9518-c2c9fdf18c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:26.621003 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a911c-65a1-4c32-9518-c2c9fdf18c56 admin admin] PATH_INFO: `/v3/projects/1baa5bf1fd864725a2cf167473aa69fe/users/a3a9d8d3f2fc489cb5bc3474dd91bb8e/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:26.637317 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a911c-65a1-4c32-9518-c2c9fdf18c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1baa5bf1fd864725a2cf167473aa69fe, user_id=a3a9d8d3f2fc489cb5bc3474dd91bb8e, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:26.641180 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a911c-65a1-4c32-9518-c2c9fdf18c56 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:26.729708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1104/2198] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:26 2022] PUT /identity/v3/projects/1baa5bf1fd864725a2cf167473aa69fe/users/a3a9d8d3f2fc489cb5bc3474dd91bb8e/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:26.729881 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f7841-3724-428e-8f63-57a78f980974 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:26.746325 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f7841-3724-428e-8f63-57a78f980974 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:26.807399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91cfdf-785d-4fc0-8aac-e620fac2af17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:26.808358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91cfdf-785d-4fc0-8aac-e620fac2af17 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:26.808666 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91cfdf-785d-4fc0-8aac-e620fac2af17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:26.808950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91cfdf-785d-4fc0-8aac-e620fac2af17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:26.809692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91cfdf-785d-4fc0-8aac-e620fac2af17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:26.811294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91cfdf-785d-4fc0-8aac-e620fac2af17 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:26.822867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1095/2199] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:58:26.827289 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a911c-65a1-4c32-9518-c2c9fdf18c56 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:26.854586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a911c-65a1-4c32-9518-c2c9fdf18c56 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:26.856543 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff533c5d-9727-4289-8a7f-f30a36c4b195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:26.857579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff533c5d-9727-4289-8a7f-f30a36c4b195 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:26.857959 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff533c5d-9727-4289-8a7f-f30a36c4b195 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:26.858369 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff533c5d-9727-4289-8a7f-f30a36c4b195 admin admin] PATH_INFO: `/v3/projects/1baa5bf1fd864725a2cf167473aa69fe/users/a3a9d8d3f2fc489cb5bc3474dd91bb8e/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:26.860489 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff533c5d-9727-4289-8a7f-f30a36c4b195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1baa5bf1fd864725a2cf167473aa69fe, user_id=a3a9d8d3f2fc489cb5bc3474dd91bb8e, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:26.864071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff533c5d-9727-4289-8a7f-f30a36c4b195 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:26.875440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1105/2200] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:26 2022] PUT /identity/v3/projects/1baa5bf1fd864725a2cf167473aa69fe/users/a3a9d8d3f2fc489cb5bc3474dd91bb8e/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:26.887232 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34747e17-b934-42d7-9d42-2d4fbc144ff6 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:26.887606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34747e17-b934-42d7-9d42-2d4fbc144ff6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:26.887953 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34747e17-b934-42d7-9d42-2d4fbc144ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:26.917099 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-34747e17-b934-42d7-9d42-2d4fbc144ff6 None None] MFA Rules not processed for user `a3a9d8d3f2fc489cb5bc3474dd91bb8e`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:26.918421 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-34747e17-b934-42d7-9d42-2d4fbc144ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:26.923458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:27.000901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1096/2201] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:27.533074 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff533c5d-9727-4289-8a7f-f30a36c4b195 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:27.535556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-ff533c5d-9727-4289-8a7f-f30a36c4b195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:27.572104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:27.612425 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff533c5d-9727-4289-8a7f-f30a36c4b195 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:27.614320 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355ccd8-c5ad-44bf-9050-0ce450d698c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:27.614987 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355ccd8-c5ad-44bf-9050-0ce450d698c1 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:27.615283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355ccd8-c5ad-44bf-9050-0ce450d698c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:27.615771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355ccd8-c5ad-44bf-9050-0ce450d698c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:27.628575 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355ccd8-c5ad-44bf-9050-0ce450d698c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:27.630192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355ccd8-c5ad-44bf-9050-0ce450d698c1 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:27.641567 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1106/2202] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:58:28.609841 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48ae5b-5c4a-4541-909c-2be85b70e230 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:28.612095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48ae5b-5c4a-4541-909c-2be85b70e230 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:28.613586 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48ae5b-5c4a-4541-909c-2be85b70e230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:28.693479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-1c48ae5b-5c4a-4541-909c-2be85b70e230 None None] MFA Rules not processed for user `4f764a725deb405198f95d583035b371`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:28.695313 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-1c48ae5b-5c4a-4541-909c-2be85b70e230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:28.794463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1097/2203] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:28.798673 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355ccd8-c5ad-44bf-9050-0ce450d698c1 service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:28.803561 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2355ccd8-c5ad-44bf-9050-0ce450d698c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:28.887001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355ccd8-c5ad-44bf-9050-0ce450d698c1 service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:28.891951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d63d4-4c10-49e8-823d-eec0fd541b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:28.893142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d63d4-4c10-49e8-823d-eec0fd541b3d admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:28.893428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d63d4-4c10-49e8-823d-eec0fd541b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:28.893732 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d63d4-4c10-49e8-823d-eec0fd541b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:28.894449 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d63d4-4c10-49e8-823d-eec0fd541b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:28.896452 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d63d4-4c10-49e8-823d-eec0fd541b3d admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:28.975210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1107/2204] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:58:28 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:58:28.978275 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48ae5b-5c4a-4541-909c-2be85b70e230 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:28.989862 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48ae5b-5c4a-4541-909c-2be85b70e230 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:29.067600 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6e2a6-7249-4f24-a8c0-507ab2ae15a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:29.068475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6e2a6-7249-4f24-a8c0-507ab2ae15a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:29.069189 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6e2a6-7249-4f24-a8c0-507ab2ae15a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:29.069189 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6e2a6-7249-4f24-a8c0-507ab2ae15a1 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:29.069879 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6e2a6-7249-4f24-a8c0-507ab2ae15a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:29.072296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6e2a6-7249-4f24-a8c0-507ab2ae15a1 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:29.203797 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1098/2205] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:58:28 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:29.205984 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d63d4-4c10-49e8-823d-eec0fd541b3d admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:29.218938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d63d4-4c10-49e8-823d-eec0fd541b3d admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:29.237820 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bafa0d-507a-4170-8b45-617a72b5bcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:29.239348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bafa0d-507a-4170-8b45-617a72b5bcaf admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:29.239634 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bafa0d-507a-4170-8b45-617a72b5bcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:29.239905 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bafa0d-507a-4170-8b45-617a72b5bcaf admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:29.240661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bafa0d-507a-4170-8b45-617a72b5bcaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:29.243158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bafa0d-507a-4170-8b45-617a72b5bcaf admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:29.256424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1108/2206] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:29.260863 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6e2a6-7249-4f24-a8c0-507ab2ae15a1 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:29.271365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6e2a6-7249-4f24-a8c0-507ab2ae15a1 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:29.276038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068caf9-620c-44bd-939f-530206b15b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:29.276966 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068caf9-620c-44bd-939f-530206b15b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:29.277236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068caf9-620c-44bd-939f-530206b15b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:29.277659 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068caf9-620c-44bd-939f-530206b15b0b admin admin] PATH_INFO: `/v3/projects/24596a0ec0e54c74b7360b116ac36144/users/f6ddd18eaf94495bb19903c96c75b691/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:29.300742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068caf9-620c-44bd-939f-530206b15b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24596a0ec0e54c74b7360b116ac36144, user_id=f6ddd18eaf94495bb19903c96c75b691, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:29.303898 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068caf9-620c-44bd-939f-530206b15b0b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:29.414858 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:29.427089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1099/2207] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:29 2022] PUT /identity/v3/projects/24596a0ec0e54c74b7360b116ac36144/users/f6ddd18eaf94495bb19903c96c75b691/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:29.428318 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bafa0d-507a-4170-8b45-617a72b5bcaf admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:29.438466 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bafa0d-507a-4170-8b45-617a72b5bcaf admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:29.487016 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068caf9-620c-44bd-939f-530206b15b0b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:29.488775 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-5068caf9-620c-44bd-939f-530206b15b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:29.528440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2af8e1-895d-4a85-828e-3f5aebf16075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:29.529228 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2af8e1-895d-4a85-828e-3f5aebf16075 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:29.530046 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2af8e1-895d-4a85-828e-3f5aebf16075 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:29.530387 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2af8e1-895d-4a85-828e-3f5aebf16075 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:29.531251 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2af8e1-895d-4a85-828e-3f5aebf16075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:29.533676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2af8e1-895d-4a85-828e-3f5aebf16075 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:29.552833 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1109/2208] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:29.556188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2af8e1-895d-4a85-828e-3f5aebf16075 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:29.571845 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2af8e1-895d-4a85-828e-3f5aebf16075 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:29.578303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068caf9-620c-44bd-939f-530206b15b0b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:29.585413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e930f9-01f6-4981-a4ee-3968ee50f4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:29.586433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7131a2-9665-49b1-80de-4950137b1110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:29.586433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7131a2-9665-49b1-80de-4950137b1110 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:29.586433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7131a2-9665-49b1-80de-4950137b1110 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:29.586693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e930f9-01f6-4981-a4ee-3968ee50f4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:29.586769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7131a2-9665-49b1-80de-4950137b1110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:29.586842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e930f9-01f6-4981-a4ee-3968ee50f4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:29.586993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e930f9-01f6-4981-a4ee-3968ee50f4c0 admin admin] PATH_INFO: `/v3/projects/24596a0ec0e54c74b7360b116ac36144/users/f6ddd18eaf94495bb19903c96c75b691/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:29.589149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e930f9-01f6-4981-a4ee-3968ee50f4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24596a0ec0e54c74b7360b116ac36144, user_id=f6ddd18eaf94495bb19903c96c75b691, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:29.592159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e930f9-01f6-4981-a4ee-3968ee50f4c0 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:29.604229 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1110/2209] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:29 2022] PUT /identity/v3/projects/24596a0ec0e54c74b7360b116ac36144/users/f6ddd18eaf94495bb19903c96c75b691/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:29.657639 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7131a2-9665-49b1-80de-4950137b1110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:29.659139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7131a2-9665-49b1-80de-4950137b1110 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:29.668751 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1100/2210] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:58:33.975831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44313bb3-48be-4baa-9d9d-15c50af72871 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:33.978705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44313bb3-48be-4baa-9d9d-15c50af72871 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:33.978705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44313bb3-48be-4baa-9d9d-15c50af72871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:33.999551 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-44313bb3-48be-4baa-9d9d-15c50af72871 None None] MFA Rules not processed for user `ef044785763a4bc4be4a1ffd4ea5290f`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:34.001236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-44313bb3-48be-4baa-9d9d-15c50af72871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:34.023016 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:34.112738 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1111/2211] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:35.622463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7131a2-9665-49b1-80de-4950137b1110 service cinder] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:35.625052 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-3c7131a2-9665-49b1-80de-4950137b1110 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:35.640938 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7131a2-9665-49b1-80de-4950137b1110 service cinder] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:35.705908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7ed2d-fefc-4cae-8c25-368815d3f495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:35.706988 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7ed2d-fefc-4cae-8c25-368815d3f495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:35.707274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7ed2d-fefc-4cae-8c25-368815d3f495 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:35.707550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7ed2d-fefc-4cae-8c25-368815d3f495 admin admin] PATH_INFO: `/v3/users/0d9566c63c80411489fb6927834301a7` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:35.708832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7ed2d-fefc-4cae-8c25-368815d3f495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9566c63c80411489fb6927834301a7)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:35.710833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7ed2d-fefc-4cae-8c25-368815d3f495 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:35.937285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-50c7ed2d-fefc-4cae-8c25-368815d3f495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9566c63c80411489fb6927834301a7'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:35.945938 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:35.954566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-50c7ed2d-fefc-4cae-8c25-368815d3f495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9566c63c80411489fb6927834301a7'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:36.060606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-50c7ed2d-fefc-4cae-8c25-368815d3f495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9566c63c80411489fb6927834301a7'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:36.068278 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-50c7ed2d-fefc-4cae-8c25-368815d3f495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9566c63c80411489fb6927834301a7'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:36.077854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-50c7ed2d-fefc-4cae-8c25-368815d3f495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9566c63c80411489fb6927834301a7'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:36.085040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1101/2212] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:58:35 2022] DELETE /identity/v3/users/0d9566c63c80411489fb6927834301a7 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:36.089587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04423e51-1b51-4d93-9608-4bd7451298a7 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:36.090094 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04423e51-1b51-4d93-9608-4bd7451298a7 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:36.090187 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04423e51-1b51-4d93-9608-4bd7451298a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:36.109667 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-04423e51-1b51-4d93-9608-4bd7451298a7 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:36.111984 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-04423e51-1b51-4d93-9608-4bd7451298a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:36.203893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1112/2213] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:36.215953 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7ed2d-fefc-4cae-8c25-368815d3f495 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:36.218250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-50c7ed2d-fefc-4cae-8c25-368815d3f495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:36.290324 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7ed2d-fefc-4cae-8c25-368815d3f495 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:36.296848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0c8f5-d4eb-4488-9803-c09d30e07dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:36.297522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0c8f5-d4eb-4488-9803-c09d30e07dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:36.297803 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0c8f5-d4eb-4488-9803-c09d30e07dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:36.298078 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0c8f5-d4eb-4488-9803-c09d30e07dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:36.311359 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0c8f5-d4eb-4488-9803-c09d30e07dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:36.311359 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0c8f5-d4eb-4488-9803-c09d30e07dc0 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:36.323874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1102/2214] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:58:36.934539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc96a9d-eeee-49fc-bf7f-36410ae8447f None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:36.934837 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc96a9d-eeee-49fc-bf7f-36410ae8447f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:36.935119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc96a9d-eeee-49fc-bf7f-36410ae8447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:36.959234 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0c8f5-d4eb-4488-9803-c09d30e07dc0 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:36.968988 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ecf0c8f5-d4eb-4488-9803-c09d30e07dc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:36.983939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1dc96a9d-eeee-49fc-bf7f-36410ae8447f None None] MFA Rules not processed for user `f6ddd18eaf94495bb19903c96c75b691`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:36.985086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0c8f5-d4eb-4488-9803-c09d30e07dc0 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:36.986812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1dc96a9d-eeee-49fc-bf7f-36410ae8447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:36.995050 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:36.996255 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:36.997748 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:36.998105 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1 admin admin] PATH_INFO: `/v3/projects/9f583ae86f384fb2ac0f9430796f23ae` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:37.000240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f583ae86f384fb2ac0f9430796f23ae)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:37.005098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:37.093318 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1113/2215] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:37.114474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc96a9d-eeee-49fc-bf7f-36410ae8447f None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:37.115871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1dc96a9d-eeee-49fc-bf7f-36410ae8447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:37.129725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f583ae86f384fb2ac0f9430796f23ae', 'request_id': 'req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:37.186466 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:37.232222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc96a9d-eeee-49fc-bf7f-36410ae8447f None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:37.268908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f583ae86f384fb2ac0f9430796f23ae', 'request_id': 'req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:37.283301 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f583ae86f384fb2ac0f9430796f23ae', 'request_id': 'req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:37.295577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1 admin admin] The token cache is being invalidate because project 9f583ae86f384fb2ac0f9430796f23ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:58:37.295867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:37.299861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:37.299861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1103/2216] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:58:36 2022] DELETE /identity/v3/projects/9f583ae86f384fb2ac0f9430796f23ae => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:37.299861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:37.303015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:37.325011 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844a089-cc73-44c4-952d-0d1f9f75ee72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:37.325737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844a089-cc73-44c4-952d-0d1f9f75ee72 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:37.326026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844a089-cc73-44c4-952d-0d1f9f75ee72 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:37.326307 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844a089-cc73-44c4-952d-0d1f9f75ee72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:37.328098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-6844a089-cc73-44c4-952d-0d1f9f75ee72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:37.371185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:37.386493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a68007-9af0-4947-a4fb-4a91ae97bdd1 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:37.387659 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844a089-cc73-44c4-952d-0d1f9f75ee72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:37.389296 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844a089-cc73-44c4-952d-0d1f9f75ee72 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:37.390339 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80074bbd-09bd-4a45-ab4b-7968b0ed4eac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:37.390976 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80074bbd-09bd-4a45-ab4b-7968b0ed4eac service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:37.391251 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80074bbd-09bd-4a45-ab4b-7968b0ed4eac service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:37.391527 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80074bbd-09bd-4a45-ab4b-7968b0ed4eac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:37.393423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-80074bbd-09bd-4a45-ab4b-7968b0ed4eac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:37.398578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1114/2217] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:58:37.405983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11ec29-e6ad-45af-832e-5cefd7f1f017 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:37.406427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11ec29-e6ad-45af-832e-5cefd7f1f017 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:37.406709 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11ec29-e6ad-45af-832e-5cefd7f1f017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:37.426513 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-da11ec29-e6ad-45af-832e-5cefd7f1f017 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:37.427680 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-da11ec29-e6ad-45af-832e-5cefd7f1f017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:37.455098 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80074bbd-09bd-4a45-ab4b-7968b0ed4eac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:37.456874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80074bbd-09bd-4a45-ab4b-7968b0ed4eac service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:37.479619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1104/2218] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:58:37.508970 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1115/2219] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:37.516861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0d552-9fce-4b2d-bf34-3257b54c4d80 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:37.517160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0d552-9fce-4b2d-bf34-3257b54c4d80 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:37.518013 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0d552-9fce-4b2d-bf34-3257b54c4d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:37.543887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-e9d0d552-9fce-4b2d-bf34-3257b54c4d80 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:37.545132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-e9d0d552-9fce-4b2d-bf34-3257b54c4d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:37.553966 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1105/2220] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:37.558460 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11ec29-e6ad-45af-832e-5cefd7f1f017 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:37.568449 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:37.574663 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11ec29-e6ad-45af-832e-5cefd7f1f017 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:37.586222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882c3bb-e20f-4eab-a534-4bd9619bd016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:37.586892 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882c3bb-e20f-4eab-a534-4bd9619bd016 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:37.587174 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882c3bb-e20f-4eab-a534-4bd9619bd016 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:37.587446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882c3bb-e20f-4eab-a534-4bd9619bd016 admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:37.588183 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882c3bb-e20f-4eab-a534-4bd9619bd016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:58:37.588490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882c3bb-e20f-4eab-a534-4bd9619bd016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:37.590175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882c3bb-e20f-4eab-a534-4bd9619bd016 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:37.602654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1116/2221] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:58:37.611583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0d552-9fce-4b2d-bf34-3257b54c4d80 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:37.621397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0d552-9fce-4b2d-bf34-3257b54c4d80 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:37.625930 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc31a92-f35e-47e6-920c-3c50f1631b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:37.626607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc31a92-f35e-47e6-920c-3c50f1631b34 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:37.626891 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc31a92-f35e-47e6-920c-3c50f1631b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:37.627166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc31a92-f35e-47e6-920c-3c50f1631b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:37.627863 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc31a92-f35e-47e6-920c-3c50f1631b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:37.629786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc31a92-f35e-47e6-920c-3c50f1631b34 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:37.729289 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1106/2222] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:58:37 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:58:37.730386 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882c3bb-e20f-4eab-a534-4bd9619bd016 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:37.740603 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882c3bb-e20f-4eab-a534-4bd9619bd016 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:37.796279 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33533979-723d-478e-873b-388f035d4d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:37.796995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33533979-723d-478e-873b-388f035d4d9d admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:37.797278 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33533979-723d-478e-873b-388f035d4d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:37.797556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33533979-723d-478e-873b-388f035d4d9d admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:37.798247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33533979-723d-478e-873b-388f035d4d9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:37.800181 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33533979-723d-478e-873b-388f035d4d9d admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:37.886067 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1117/2223] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:58:37 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:37.888261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc31a92-f35e-47e6-920c-3c50f1631b34 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:37.899164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc31a92-f35e-47e6-920c-3c50f1631b34 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:37.903733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c6337-61a8-45e4-aeb9-860013a34930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:37.904386 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c6337-61a8-45e4-aeb9-860013a34930 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:37.904692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c6337-61a8-45e4-aeb9-860013a34930 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:37.905267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c6337-61a8-45e4-aeb9-860013a34930 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:37.906517 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c6337-61a8-45e4-aeb9-860013a34930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:37.908234 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c6337-61a8-45e4-aeb9-860013a34930 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:37.920837 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1107/2224] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:37.925495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33533979-723d-478e-873b-388f035d4d9d admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:37.937724 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33533979-723d-478e-873b-388f035d4d9d admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:37.947192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e4d85-7ec1-4e70-bbbc-ee0122265298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:37.948438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e4d85-7ec1-4e70-bbbc-ee0122265298 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:37.948947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e4d85-7ec1-4e70-bbbc-ee0122265298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:37.949400 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e4d85-7ec1-4e70-bbbc-ee0122265298 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:37.950380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e4d85-7ec1-4e70-bbbc-ee0122265298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:37.952183 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e4d85-7ec1-4e70-bbbc-ee0122265298 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:37.963971 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1118/2225] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:37.968187 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c6337-61a8-45e4-aeb9-860013a34930 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:37.978406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c6337-61a8-45e4-aeb9-860013a34930 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:37.983016 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5eb06-141c-4859-9991-665da51ce4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:37.983883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5eb06-141c-4859-9991-665da51ce4d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:37.984165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5eb06-141c-4859-9991-665da51ce4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:37.984442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5eb06-141c-4859-9991-665da51ce4d0 admin admin] PATH_INFO: `/v3/projects/773c5d27e2b24590922802937bf9db1b/users/c150fadafc3944159dfbf11f15bb1ba5/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:37.999791 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5eb06-141c-4859-9991-665da51ce4d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=773c5d27e2b24590922802937bf9db1b, user_id=c150fadafc3944159dfbf11f15bb1ba5, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:38.003521 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5eb06-141c-4859-9991-665da51ce4d0 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:38.075136 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1108/2226] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:37 2022] PUT /identity/v3/projects/773c5d27e2b24590922802937bf9db1b/users/c150fadafc3944159dfbf11f15bb1ba5/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:38.087173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eec96-019a-497d-8691-dc26bd71e076 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:38.087696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eec96-019a-497d-8691-dc26bd71e076 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:38.087916 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eec96-019a-497d-8691-dc26bd71e076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:38.117580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-618eec96-019a-497d-8691-dc26bd71e076 None None] MFA Rules not processed for user `c150fadafc3944159dfbf11f15bb1ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:38.118823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-618eec96-019a-497d-8691-dc26bd71e076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:38.193884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1119/2227] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:38.204893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5eb06-141c-4859-9991-665da51ce4d0 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:38.206692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-55e5eb06-141c-4859-9991-665da51ce4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:38.274403 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5eb06-141c-4859-9991-665da51ce4d0 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:38.278539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51eb1f-de0d-402a-865d-5d6b74a36ed5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:38.279193 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51eb1f-de0d-402a-865d-5d6b74a36ed5 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:38.279476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51eb1f-de0d-402a-865d-5d6b74a36ed5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:38.279769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51eb1f-de0d-402a-865d-5d6b74a36ed5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:38.289830 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51eb1f-de0d-402a-865d-5d6b74a36ed5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:38.291371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51eb1f-de0d-402a-865d-5d6b74a36ed5 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:38.302634 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1109/2228] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:58:40.421454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42419c0d-f42d-4aeb-9ca0-40974dfff6de None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:40.421972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42419c0d-f42d-4aeb-9ca0-40974dfff6de None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:40.422067 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42419c0d-f42d-4aeb-9ca0-40974dfff6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:40.444224 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-42419c0d-f42d-4aeb-9ca0-40974dfff6de None None] MFA Rules not processed for user `4f764a725deb405198f95d583035b371`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:40.445486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-42419c0d-f42d-4aeb-9ca0-40974dfff6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:40.508725 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1120/2229] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:41.815463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce662a5-7a53-4555-a5b8-b7d675883731 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:41.816023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce662a5-7a53-4555-a5b8-b7d675883731 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:41.816023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce662a5-7a53-4555-a5b8-b7d675883731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:41.848831 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-4ce662a5-7a53-4555-a5b8-b7d675883731 None None] MFA Rules not processed for user `c150fadafc3944159dfbf11f15bb1ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:41.848831 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-4ce662a5-7a53-4555-a5b8-b7d675883731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:41.866245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1110/2230] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:58:44.158563 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42419c0d-f42d-4aeb-9ca0-40974dfff6de None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:44.160107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-42419c0d-f42d-4aeb-9ca0-40974dfff6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:44.165188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:44.226608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42419c0d-f42d-4aeb-9ca0-40974dfff6de None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:44.231185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfae65-2dad-4004-abae-8cf0726782ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:44.232303 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfae65-2dad-4004-abae-8cf0726782ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:44.232581 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfae65-2dad-4004-abae-8cf0726782ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:44.232906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfae65-2dad-4004-abae-8cf0726782ba admin admin] PATH_INFO: `/v3/users/48d7fea7d9844770bc8ede41b4feb419` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:44.234078 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfae65-2dad-4004-abae-8cf0726782ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d7fea7d9844770bc8ede41b4feb419)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:44.236602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfae65-2dad-4004-abae-8cf0726782ba admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:44.413014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-e7dfae65-2dad-4004-abae-8cf0726782ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d7fea7d9844770bc8ede41b4feb419'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:44.426764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-e7dfae65-2dad-4004-abae-8cf0726782ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d7fea7d9844770bc8ede41b4feb419'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:44.513690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-e7dfae65-2dad-4004-abae-8cf0726782ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d7fea7d9844770bc8ede41b4feb419'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:44.514457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-e7dfae65-2dad-4004-abae-8cf0726782ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d7fea7d9844770bc8ede41b4feb419'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:44.525004 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-e7dfae65-2dad-4004-abae-8cf0726782ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d7fea7d9844770bc8ede41b4feb419'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:44.537284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1121/2231] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:58:44 2022] DELETE /identity/v3/users/48d7fea7d9844770bc8ede41b4feb419 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:44.541719 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b60fb-c40a-408a-9793-520af0e085a1 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:44.542300 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b60fb-c40a-408a-9793-520af0e085a1 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:44.542586 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b60fb-c40a-408a-9793-520af0e085a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:44.567512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-fb4b60fb-c40a-408a-9793-520af0e085a1 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:44.569018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-fb4b60fb-c40a-408a-9793-520af0e085a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:44.588537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:44.645222 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1111/2232] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:44.655516 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfae65-2dad-4004-abae-8cf0726782ba admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:44.657223 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e7dfae65-2dad-4004-abae-8cf0726782ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:44.724827 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfae65-2dad-4004-abae-8cf0726782ba admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:44.728673 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffc952-ecb3-4cc5-b558-5fb5f4b21bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:44.729342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffc952-ecb3-4cc5-b558-5fb5f4b21bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:44.729625 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffc952-ecb3-4cc5-b558-5fb5f4b21bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:44.729902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffc952-ecb3-4cc5-b558-5fb5f4b21bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:44.740112 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffc952-ecb3-4cc5-b558-5fb5f4b21bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:44.741607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffc952-ecb3-4cc5-b558-5fb5f4b21bc5 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:44.751064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1122/2233] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:58:45.215802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b60fb-c40a-408a-9793-520af0e085a1 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:45.217327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-fb4b60fb-c40a-408a-9793-520af0e085a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:45.230526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b60fb-c40a-408a-9793-520af0e085a1 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:45.234993 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:45.236563 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:45.237004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:45.237288 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2 admin admin] PATH_INFO: `/v3/projects/62907f54d3e24f29963bd4a94612bf8d` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:45.238488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62907f54d3e24f29963bd4a94612bf8d)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:45.240379 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:45.380257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62907f54d3e24f29963bd4a94612bf8d', 'request_id': 'req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:45.437416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62907f54d3e24f29963bd4a94612bf8d', 'request_id': 'req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:45.444668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62907f54d3e24f29963bd4a94612bf8d', 'request_id': 'req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:45.455008 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2 admin admin] The token cache is being invalidate because project 62907f54d3e24f29963bd4a94612bf8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:58:45.455291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:45.455920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:45.457550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1112/2234] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:58:45 2022] DELETE /identity/v3/projects/62907f54d3e24f29963bd4a94612bf8d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:45.461922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffc952-ecb3-4cc5-b558-5fb5f4b21bc5 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:45.473415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffc952-ecb3-4cc5-b558-5fb5f4b21bc5 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:45.494417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:45.532404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30e945-4016-4b0d-a69e-6af170901024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:45.533904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30e945-4016-4b0d-a69e-6af170901024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:45.534186 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30e945-4016-4b0d-a69e-6af170901024 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:45.534461 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30e945-4016-4b0d-a69e-6af170901024 admin admin] PATH_INFO: `/v3/users/2a0b47ce732343f8944247aea54fcdab` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:45.535650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30e945-4016-4b0d-a69e-6af170901024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a0b47ce732343f8944247aea54fcdab)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:45.537588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30e945-4016-4b0d-a69e-6af170901024 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:45.688974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-be30e945-4016-4b0d-a69e-6af170901024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a0b47ce732343f8944247aea54fcdab'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:45.705028 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-be30e945-4016-4b0d-a69e-6af170901024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a0b47ce732343f8944247aea54fcdab'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:45.788339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-be30e945-4016-4b0d-a69e-6af170901024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a0b47ce732343f8944247aea54fcdab'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:45.791191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-be30e945-4016-4b0d-a69e-6af170901024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a0b47ce732343f8944247aea54fcdab'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:45.801199 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-be30e945-4016-4b0d-a69e-6af170901024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a0b47ce732343f8944247aea54fcdab'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:45.819033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1123/2235] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:58:45 2022] DELETE /identity/v3/users/2a0b47ce732343f8944247aea54fcdab => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:58:46.256522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:46.258025 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:46.271818 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00edff-b65a-4d9c-86df-bbd2da9d49d2 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:46.328362 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892eb81-e984-448a-a03b-9bbdac1f82d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:46.329259 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892eb81-e984-448a-a03b-9bbdac1f82d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:46.330435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892eb81-e984-448a-a03b-9bbdac1f82d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:46.330713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892eb81-e984-448a-a03b-9bbdac1f82d2 admin admin] PATH_INFO: `/v3/projects/87208ee8438f4ded8562f713926d336a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:46.331887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892eb81-e984-448a-a03b-9bbdac1f82d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87208ee8438f4ded8562f713926d336a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:46.333837 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892eb81-e984-448a-a03b-9bbdac1f82d2 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:46.481191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1892eb81-e984-448a-a03b-9bbdac1f82d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87208ee8438f4ded8562f713926d336a', 'request_id': 'req-1892eb81-e984-448a-a03b-9bbdac1f82d2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:46.482813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:46.571006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1892eb81-e984-448a-a03b-9bbdac1f82d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87208ee8438f4ded8562f713926d336a', 'request_id': 'req-1892eb81-e984-448a-a03b-9bbdac1f82d2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:46.577962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1892eb81-e984-448a-a03b-9bbdac1f82d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87208ee8438f4ded8562f713926d336a', 'request_id': 'req-1892eb81-e984-448a-a03b-9bbdac1f82d2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:46.588382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1892eb81-e984-448a-a03b-9bbdac1f82d2 admin admin] The token cache is being invalidate because project 87208ee8438f4ded8562f713926d336a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:58:46.588692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1892eb81-e984-448a-a03b-9bbdac1f82d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:46.589323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1892eb81-e984-448a-a03b-9bbdac1f82d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:46.590871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1113/2236] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:58:46 2022] DELETE /identity/v3/projects/87208ee8438f4ded8562f713926d336a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:46.594846 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30e945-4016-4b0d-a69e-6af170901024 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:46.596436 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-be30e945-4016-4b0d-a69e-6af170901024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:46.610125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30e945-4016-4b0d-a69e-6af170901024 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:46.667259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9d57b-dc22-4abd-9c52-8c73c3d3319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:46.668125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9d57b-dc22-4abd-9c52-8c73c3d3319f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:46.668408 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9d57b-dc22-4abd-9c52-8c73c3d3319f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:46.668706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9d57b-dc22-4abd-9c52-8c73c3d3319f admin admin] PATH_INFO: `/v3/users/a3a9d8d3f2fc489cb5bc3474dd91bb8e` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:46.669908 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9d57b-dc22-4abd-9c52-8c73c3d3319f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a9d8d3f2fc489cb5bc3474dd91bb8e)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:46.671820 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9d57b-dc22-4abd-9c52-8c73c3d3319f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:46.866193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:46.868441 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-27b9d57b-dc22-4abd-9c52-8c73c3d3319f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a9d8d3f2fc489cb5bc3474dd91bb8e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:46.883632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-27b9d57b-dc22-4abd-9c52-8c73c3d3319f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a9d8d3f2fc489cb5bc3474dd91bb8e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:46.948183 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-27b9d57b-dc22-4abd-9c52-8c73c3d3319f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a9d8d3f2fc489cb5bc3474dd91bb8e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:46.948922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-27b9d57b-dc22-4abd-9c52-8c73c3d3319f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a9d8d3f2fc489cb5bc3474dd91bb8e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:46.956567 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-27b9d57b-dc22-4abd-9c52-8c73c3d3319f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a9d8d3f2fc489cb5bc3474dd91bb8e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:46.962856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1124/2237] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:58:46 2022] DELETE /identity/v3/users/a3a9d8d3f2fc489cb5bc3474dd91bb8e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:47.396089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892eb81-e984-448a-a03b-9bbdac1f82d2 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:47.397576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-1892eb81-e984-448a-a03b-9bbdac1f82d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:47.411007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892eb81-e984-448a-a03b-9bbdac1f82d2 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:47.467893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5ba93-aee0-465b-8d24-d0cefc567242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:47.468776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ba93-aee0-465b-8d24-d0cefc567242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:47.469057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ba93-aee0-465b-8d24-d0cefc567242 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:47.469332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5ba93-aee0-465b-8d24-d0cefc567242 admin admin] PATH_INFO: `/v3/projects/1baa5bf1fd864725a2cf167473aa69fe` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:47.471279 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5ba93-aee0-465b-8d24-d0cefc567242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1baa5bf1fd864725a2cf167473aa69fe)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:47.473266 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5ba93-aee0-465b-8d24-d0cefc567242 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:47.599025 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c7c5ba93-aee0-465b-8d24-d0cefc567242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1baa5bf1fd864725a2cf167473aa69fe', 'request_id': 'req-c7c5ba93-aee0-465b-8d24-d0cefc567242'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:47.661967 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c7c5ba93-aee0-465b-8d24-d0cefc567242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1baa5bf1fd864725a2cf167473aa69fe', 'request_id': 'req-c7c5ba93-aee0-465b-8d24-d0cefc567242'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:47.668373 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c7c5ba93-aee0-465b-8d24-d0cefc567242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1baa5bf1fd864725a2cf167473aa69fe', 'request_id': 'req-c7c5ba93-aee0-465b-8d24-d0cefc567242'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:47.679068 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c7c5ba93-aee0-465b-8d24-d0cefc567242 admin admin] The token cache is being invalidate because project 1baa5bf1fd864725a2cf167473aa69fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:58:47.679350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c7c5ba93-aee0-465b-8d24-d0cefc567242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:47.679995 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-c7c5ba93-aee0-465b-8d24-d0cefc567242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:47.682028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1114/2238] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:58:47 2022] DELETE /identity/v3/projects/1baa5bf1fd864725a2cf167473aa69fe => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:47.688140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d9247-77bf-43ac-8a5f-ceb753b56ae5 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:47.689399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d9247-77bf-43ac-8a5f-ceb753b56ae5 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:47.689685 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d9247-77bf-43ac-8a5f-ceb753b56ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:47.710493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-707d9247-77bf-43ac-8a5f-ceb753b56ae5 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:47.711706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-707d9247-77bf-43ac-8a5f-ceb753b56ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:47.770985 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1125/2239] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:47.779499 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df9c0f-05ea-4a04-8ece-99dccc81b4c4 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:47.779785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df9c0f-05ea-4a04-8ece-99dccc81b4c4 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:47.780062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df9c0f-05ea-4a04-8ece-99dccc81b4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:47.797793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-81df9c0f-05ea-4a04-8ece-99dccc81b4c4 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:47.799170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-81df9c0f-05ea-4a04-8ece-99dccc81b4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:47.806905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1115/2240] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:47.810989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d9247-77bf-43ac-8a5f-ceb753b56ae5 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:47.821577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d9247-77bf-43ac-8a5f-ceb753b56ae5 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:47.826125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ec936-68db-4f76-a65c-370bfae3ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:47.826775 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ec936-68db-4f76-a65c-370bfae3ddc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:47.827060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ec936-68db-4f76-a65c-370bfae3ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:47.827340 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ec936-68db-4f76-a65c-370bfae3ddc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:47.828065 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ec936-68db-4f76-a65c-370bfae3ddc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:58:47.828388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ec936-68db-4f76-a65c-370bfae3ddc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:47.831034 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ec936-68db-4f76-a65c-370bfae3ddc8 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:47.842330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1126/2241] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:58:47.846563 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df9c0f-05ea-4a04-8ece-99dccc81b4c4 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:47.855662 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df9c0f-05ea-4a04-8ece-99dccc81b4c4 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:47.860494 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406817-845f-4905-a8c6-49f25b89b728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:47.861720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406817-845f-4905-a8c6-49f25b89b728 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:47.862003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406817-845f-4905-a8c6-49f25b89b728 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:47.862279 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406817-845f-4905-a8c6-49f25b89b728 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:47.862998 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69406817-845f-4905-a8c6-49f25b89b728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:47.864901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69406817-845f-4905-a8c6-49f25b89b728 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:48.003643 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1116/2242] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:58:47 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:48.007877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ec936-68db-4f76-a65c-370bfae3ddc8 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:48.023939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ec936-68db-4f76-a65c-370bfae3ddc8 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:48.137268 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb1d37-434d-4e53-ae97-dd9809dcd6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:48.137574 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb1d37-434d-4e53-ae97-dd9809dcd6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:48.137862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb1d37-434d-4e53-ae97-dd9809dcd6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:48.138143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb1d37-434d-4e53-ae97-dd9809dcd6c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:48.138856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb1d37-434d-4e53-ae97-dd9809dcd6c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:48.141106 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb1d37-434d-4e53-ae97-dd9809dcd6c1 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:48.256697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1127/2243] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:58:48 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:48.258543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406817-845f-4905-a8c6-49f25b89b728 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:48.272741 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406817-845f-4905-a8c6-49f25b89b728 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:48.277562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4a11c-3959-49a1-bcdf-f5e7a57b486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:48.278283 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4a11c-3959-49a1-bcdf-f5e7a57b486d admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:48.278573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4a11c-3959-49a1-bcdf-f5e7a57b486d admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:48.278854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4a11c-3959-49a1-bcdf-f5e7a57b486d admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:48.279588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4a11c-3959-49a1-bcdf-f5e7a57b486d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:48.281211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4a11c-3959-49a1-bcdf-f5e7a57b486d admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:48.293307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1117/2244] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:48.297416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb1d37-434d-4e53-ae97-dd9809dcd6c1 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:48.308341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb1d37-434d-4e53-ae97-dd9809dcd6c1 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:48.313240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f96da-ecd8-471d-85e8-4ecf59ed48f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:48.314417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f96da-ecd8-471d-85e8-4ecf59ed48f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:48.314706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f96da-ecd8-471d-85e8-4ecf59ed48f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:48.314971 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f96da-ecd8-471d-85e8-4ecf59ed48f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:48.315719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f96da-ecd8-471d-85e8-4ecf59ed48f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:48.317955 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f96da-ecd8-471d-85e8-4ecf59ed48f2 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:48.334587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1128/2245] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:48.336179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4a11c-3959-49a1-bcdf-f5e7a57b486d admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:48.349456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4a11c-3959-49a1-bcdf-f5e7a57b486d admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:48.354791 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da553-26f4-424e-875a-e5239b6217c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:48.355685 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da553-26f4-424e-875a-e5239b6217c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:48.355977 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da553-26f4-424e-875a-e5239b6217c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:48.356331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da553-26f4-424e-875a-e5239b6217c5 admin admin] PATH_INFO: `/v3/projects/3fe5fdc21cf745e2abbd0d218f89f2c8/users/53aa7619239c4198936815316cb2084c/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:48.372823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09da553-26f4-424e-875a-e5239b6217c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe5fdc21cf745e2abbd0d218f89f2c8, user_id=53aa7619239c4198936815316cb2084c, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:48.375912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09da553-26f4-424e-875a-e5239b6217c5 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:48.472816 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1118/2246] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:48 2022] PUT /identity/v3/projects/3fe5fdc21cf745e2abbd0d218f89f2c8/users/53aa7619239c4198936815316cb2084c/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:58:48.498506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ddded-472f-4207-a10e-bfa2d342001b None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:48.498801 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ddded-472f-4207-a10e-bfa2d342001b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:48.499082 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ddded-472f-4207-a10e-bfa2d342001b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:48.541039 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-4e6ddded-472f-4207-a10e-bfa2d342001b None None] MFA Rules not processed for user `53aa7619239c4198936815316cb2084c`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:48.542277 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4e6ddded-472f-4207-a10e-bfa2d342001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:48.561642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:48.627218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1129/2247] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:48.631779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da553-26f4-424e-875a-e5239b6217c5 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:48.638085 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:48.704110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da553-26f4-424e-875a-e5239b6217c5 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:48.709543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aa5eb-b48f-406f-b5a5-195306140b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:48.710207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aa5eb-b48f-406f-b5a5-195306140b3b admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:48.710542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aa5eb-b48f-406f-b5a5-195306140b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:48.710816 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aa5eb-b48f-406f-b5a5-195306140b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:48.711561 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9aa5eb-b48f-406f-b5a5-195306140b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:48.713492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9aa5eb-b48f-406f-b5a5-195306140b3b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:48.791239 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1119/2248] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:58:48 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:48.792671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ddded-472f-4207-a10e-bfa2d342001b None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:48.804008 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ddded-472f-4207-a10e-bfa2d342001b None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:48.863148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d29af2-0615-4204-a064-36977007983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:48.863748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29af2-0615-4204-a064-36977007983a admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:48.864027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29af2-0615-4204-a064-36977007983a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:48.864299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29af2-0615-4204-a064-36977007983a admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:48.865033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d29af2-0615-4204-a064-36977007983a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:48.867032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d29af2-0615-4204-a064-36977007983a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:48.944775 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1130/2249] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:58:48 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:48.946206 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aa5eb-b48f-406f-b5a5-195306140b3b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:48.957000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aa5eb-b48f-406f-b5a5-195306140b3b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:48.961625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda7223-fd93-4632-8454-1f3eeb18435f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:48.962285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda7223-fd93-4632-8454-1f3eeb18435f admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:48.962562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda7223-fd93-4632-8454-1f3eeb18435f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:48.962832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda7223-fd93-4632-8454-1f3eeb18435f admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:48.963558 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda7223-fd93-4632-8454-1f3eeb18435f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:48.965183 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda7223-fd93-4632-8454-1f3eeb18435f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:48.980021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1120/2250] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:48.981291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d29af2-0615-4204-a064-36977007983a admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:48.993924 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d29af2-0615-4204-a064-36977007983a admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:48.998867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5c133-fe17-4224-bbe0-6ac3bea4a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:48.999773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5c133-fe17-4224-bbe0-6ac3bea4a52c admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:49.000055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5c133-fe17-4224-bbe0-6ac3bea4a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:49.000334 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5c133-fe17-4224-bbe0-6ac3bea4a52c admin admin] PATH_INFO: `/v3/projects/ff1145a23aaa453aae829939b55fe548/users/74236bf7e9d4492d96d8bd6ce220b64c/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:49.016668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5c133-fe17-4224-bbe0-6ac3bea4a52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1145a23aaa453aae829939b55fe548, user_id=74236bf7e9d4492d96d8bd6ce220b64c, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:49.019835 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5c133-fe17-4224-bbe0-6ac3bea4a52c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:49.112484 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1131/2251] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:48 2022] PUT /identity/v3/projects/ff1145a23aaa453aae829939b55fe548/users/74236bf7e9d4492d96d8bd6ce220b64c/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:58:49.117055 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda7223-fd93-4632-8454-1f3eeb18435f admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:49.127136 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda7223-fd93-4632-8454-1f3eeb18435f admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:49.188199 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10d4c3-4668-4e88-a3dc-79d47008fd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:49.189322 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10d4c3-4668-4e88-a3dc-79d47008fd97 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:49.189606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10d4c3-4668-4e88-a3dc-79d47008fd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:49.189890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10d4c3-4668-4e88-a3dc-79d47008fd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:49.190731 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10d4c3-4668-4e88-a3dc-79d47008fd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:49.192324 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10d4c3-4668-4e88-a3dc-79d47008fd97 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:49.225454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5c133-fe17-4224-bbe0-6ac3bea4a52c admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:49.231388 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1121/2252] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:49.250796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5c133-fe17-4224-bbe0-6ac3bea4a52c admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:49.265924 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647f4ea-0815-4065-a6ad-e569804c6659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:49.267154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647f4ea-0815-4065-a6ad-e569804c6659 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:49.267584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647f4ea-0815-4065-a6ad-e569804c6659 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:49.270465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647f4ea-0815-4065-a6ad-e569804c6659 admin admin] PATH_INFO: `/v3/projects/ff1145a23aaa453aae829939b55fe548/users/74236bf7e9d4492d96d8bd6ce220b64c/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:49.274297 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647f4ea-0815-4065-a6ad-e569804c6659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1145a23aaa453aae829939b55fe548, user_id=74236bf7e9d4492d96d8bd6ce220b64c, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:49.277298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647f4ea-0815-4065-a6ad-e569804c6659 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:49.319158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1132/2253] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:49 2022] PUT /identity/v3/projects/ff1145a23aaa453aae829939b55fe548/users/74236bf7e9d4492d96d8bd6ce220b64c/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:49.324674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d51ea4-d3fe-4c26-a79b-782eeb2bce71 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:49.324674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d51ea4-d3fe-4c26-a79b-782eeb2bce71 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:49.324865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d51ea4-d3fe-4c26-a79b-782eeb2bce71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:49.358877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-c8d51ea4-d3fe-4c26-a79b-782eeb2bce71 None None] MFA Rules not processed for user `74236bf7e9d4492d96d8bd6ce220b64c`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:49.360100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-c8d51ea4-d3fe-4c26-a79b-782eeb2bce71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:49.462647 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:49.467248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1122/2254] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:49.478652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647f4ea-0815-4065-a6ad-e569804c6659 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:49.480239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7647f4ea-0815-4065-a6ad-e569804c6659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:49.538433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647f4ea-0815-4065-a6ad-e569804c6659 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:49.542077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5ef14-8673-4499-a32d-a57dd4486caa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:49.542719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5ef14-8673-4499-a32d-a57dd4486caa service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:49.542996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5ef14-8673-4499-a32d-a57dd4486caa service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:49.543268 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5ef14-8673-4499-a32d-a57dd4486caa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:49.552162 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5ef14-8673-4499-a32d-a57dd4486caa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:49.553630 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5ef14-8673-4499-a32d-a57dd4486caa service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:49.562915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1133/2255] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:58:50.072088 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d51ea4-d3fe-4c26-a79b-782eeb2bce71 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:50.146755 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d51ea4-d3fe-4c26-a79b-782eeb2bce71 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:50.151394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23d77c-a4f5-4839-8800-31fae7a46925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:50.152256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23d77c-a4f5-4839-8800-31fae7a46925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:50.152540 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23d77c-a4f5-4839-8800-31fae7a46925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:50.152847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23d77c-a4f5-4839-8800-31fae7a46925 admin admin] PATH_INFO: `/v3/users/53aa7619239c4198936815316cb2084c` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:50.154056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23d77c-a4f5-4839-8800-31fae7a46925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53aa7619239c4198936815316cb2084c)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:50.155941 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23d77c-a4f5-4839-8800-31fae7a46925 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:50.389960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9b23d77c-a4f5-4839-8800-31fae7a46925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53aa7619239c4198936815316cb2084c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:50.403283 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9b23d77c-a4f5-4839-8800-31fae7a46925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53aa7619239c4198936815316cb2084c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:50.489768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9b23d77c-a4f5-4839-8800-31fae7a46925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53aa7619239c4198936815316cb2084c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:50.489768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9b23d77c-a4f5-4839-8800-31fae7a46925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53aa7619239c4198936815316cb2084c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:50.497504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9b23d77c-a4f5-4839-8800-31fae7a46925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53aa7619239c4198936815316cb2084c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:50.505772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1123/2256] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:58:50 2022] DELETE /identity/v3/users/53aa7619239c4198936815316cb2084c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:50.510086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a5a88-dcc7-4232-a375-239b10ac5526 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:50.510558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a5a88-dcc7-4232-a375-239b10ac5526 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:50.510855 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a5a88-dcc7-4232-a375-239b10ac5526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:50.534607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1f6a5a88-dcc7-4232-a375-239b10ac5526 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:50.535837 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1f6a5a88-dcc7-4232-a375-239b10ac5526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:50.547413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:50.623547 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1134/2257] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 14:58:50.644879 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23d77c-a4f5-4839-8800-31fae7a46925 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:50.646377 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-9b23d77c-a4f5-4839-8800-31fae7a46925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:50.709150 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23d77c-a4f5-4839-8800-31fae7a46925 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:50.712785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3328a65-20b0-4afd-bb81-ecd2b64190f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:50.714731 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3328a65-20b0-4afd-bb81-ecd2b64190f1 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:50.715203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3328a65-20b0-4afd-bb81-ecd2b64190f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:50.715485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3328a65-20b0-4afd-bb81-ecd2b64190f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:50.726049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3328a65-20b0-4afd-bb81-ecd2b64190f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:50.727505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3328a65-20b0-4afd-bb81-ecd2b64190f1 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:50.737799 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1124/2258] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:58:51.118980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a5a88-dcc7-4232-a375-239b10ac5526 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:51.120485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1f6a5a88-dcc7-4232-a375-239b10ac5526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:51.132433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a5a88-dcc7-4232-a375-239b10ac5526 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:51.137248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:51.138128 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:51.138416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:51.138693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08 admin admin] PATH_INFO: `/v3/projects/3fe5fdc21cf745e2abbd0d218f89f2c8` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:51.140102 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fe5fdc21cf745e2abbd0d218f89f2c8)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:51.142628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:51.269423 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fe5fdc21cf745e2abbd0d218f89f2c8', 'request_id': 'req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:51.275375 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fe5fdc21cf745e2abbd0d218f89f2c8', 'request_id': 'req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:51.336358 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fe5fdc21cf745e2abbd0d218f89f2c8', 'request_id': 'req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:51.347424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08 admin admin] The token cache is being invalidate because project 3fe5fdc21cf745e2abbd0d218f89f2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:58:51.347706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:51.348426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:51.352592 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1135/2259] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:58:51 2022] DELETE /identity/v3/projects/3fe5fdc21cf745e2abbd0d218f89f2c8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:51.354284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3328a65-20b0-4afd-bb81-ecd2b64190f1 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:51.364724 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3328a65-20b0-4afd-bb81-ecd2b64190f1 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:51.386102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:51.430146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedff452-25d6-4589-b652-413aa128422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:51.433036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedff452-25d6-4589-b652-413aa128422b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:51.433036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedff452-25d6-4589-b652-413aa128422b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:51.433036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedff452-25d6-4589-b652-413aa128422b admin admin] PATH_INFO: `/v3/users/74236bf7e9d4492d96d8bd6ce220b64c` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:51.433036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedff452-25d6-4589-b652-413aa128422b admin admin] RBAC: Authorizing `identity:delete_user(user_id=74236bf7e9d4492d96d8bd6ce220b64c)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:51.434631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedff452-25d6-4589-b652-413aa128422b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:51.668186 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-eedff452-25d6-4589-b652-413aa128422b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74236bf7e9d4492d96d8bd6ce220b64c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:51.691457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-eedff452-25d6-4589-b652-413aa128422b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74236bf7e9d4492d96d8bd6ce220b64c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:51.763077 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-eedff452-25d6-4589-b652-413aa128422b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74236bf7e9d4492d96d8bd6ce220b64c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:51.763769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-eedff452-25d6-4589-b652-413aa128422b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74236bf7e9d4492d96d8bd6ce220b64c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:51.775626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-eedff452-25d6-4589-b652-413aa128422b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74236bf7e9d4492d96d8bd6ce220b64c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:51.782836 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1125/2260] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:58:51 2022] DELETE /identity/v3/users/74236bf7e9d4492d96d8bd6ce220b64c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:52.580045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:52.581690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:52.595836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da81bb5-db82-4cdf-9102-e47b4cd6bf08 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:52.657173 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47338231-d1ae-4cbe-ac26-6d2f5bfd0e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:52.658681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47338231-d1ae-4cbe-ac26-6d2f5bfd0e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:52.658960 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47338231-d1ae-4cbe-ac26-6d2f5bfd0e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:52.659232 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47338231-d1ae-4cbe-ac26-6d2f5bfd0e3a admin admin] PATH_INFO: `/v3/projects/ff1145a23aaa453aae829939b55fe548` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:52.660426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47338231-d1ae-4cbe-ac26-6d2f5bfd0e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1145a23aaa453aae829939b55fe548)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:52.662423 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47338231-d1ae-4cbe-ac26-6d2f5bfd0e3a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:52.757189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:52.763787 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-47338231-d1ae-4cbe-ac26-6d2f5bfd0e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1145a23aaa453aae829939b55fe548', 'request_id': 'req-47338231-d1ae-4cbe-ac26-6d2f5bfd0e3a'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:52.771149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-47338231-d1ae-4cbe-ac26-6d2f5bfd0e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1145a23aaa453aae829939b55fe548', 'request_id': 'req-47338231-d1ae-4cbe-ac26-6d2f5bfd0e3a'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:52.856372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-47338231-d1ae-4cbe-ac26-6d2f5bfd0e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1145a23aaa453aae829939b55fe548', 'request_id': 'req-47338231-d1ae-4cbe-ac26-6d2f5bfd0e3a'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:52.867352 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-47338231-d1ae-4cbe-ac26-6d2f5bfd0e3a admin admin] The token cache is being invalidate because project ff1145a23aaa453aae829939b55fe548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:58:52.867636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-47338231-d1ae-4cbe-ac26-6d2f5bfd0e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:52.868258 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-47338231-d1ae-4cbe-ac26-6d2f5bfd0e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:58:52.869835 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1136/2261] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:58:52 2022] DELETE /identity/v3/projects/ff1145a23aaa453aae829939b55fe548 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:52.874918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0f3c8-9fe5-4776-b470-24d9ff6f3a2f None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:52.875394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0f3c8-9fe5-4776-b470-24d9ff6f3a2f None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:52.875492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0f3c8-9fe5-4776-b470-24d9ff6f3a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:52.894317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-46d0f3c8-9fe5-4776-b470-24d9ff6f3a2f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:52.895512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-46d0f3c8-9fe5-4776-b470-24d9ff6f3a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:52.959798 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1126/2262] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:52.967712 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ee68d-9a2d-4929-8d52-e0813ba353a2 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:52.968002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ee68d-9a2d-4929-8d52-e0813ba353a2 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:52.968281 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ee68d-9a2d-4929-8d52-e0813ba353a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:52.987113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-690ee68d-9a2d-4929-8d52-e0813ba353a2 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:52.988721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-690ee68d-9a2d-4929-8d52-e0813ba353a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:52.997189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1137/2263] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:53.002186 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0f3c8-9fe5-4776-b470-24d9ff6f3a2f None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:53.011928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0f3c8-9fe5-4776-b470-24d9ff6f3a2f None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:53.016568 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61f4b7-74a6-462a-b6e6-df175cc8469b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:53.017881 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61f4b7-74a6-462a-b6e6-df175cc8469b admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:53.018194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61f4b7-74a6-462a-b6e6-df175cc8469b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:53.018548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61f4b7-74a6-462a-b6e6-df175cc8469b admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:53.019197 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61f4b7-74a6-462a-b6e6-df175cc8469b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:58:53.019505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61f4b7-74a6-462a-b6e6-df175cc8469b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:53.021105 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61f4b7-74a6-462a-b6e6-df175cc8469b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:53.034496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1127/2264] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:58:53.039051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ee68d-9a2d-4929-8d52-e0813ba353a2 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:53.049464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ee68d-9a2d-4929-8d52-e0813ba353a2 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:53.054637 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a0f02-9ab1-404c-afa7-9bd4a8852981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:53.055348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a0f02-9ab1-404c-afa7-9bd4a8852981 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:53.055637 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a0f02-9ab1-404c-afa7-9bd4a8852981 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:53.055915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a0f02-9ab1-404c-afa7-9bd4a8852981 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:53.056625 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a0f02-9ab1-404c-afa7-9bd4a8852981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:53.058605 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a0f02-9ab1-404c-afa7-9bd4a8852981 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:53.159559 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1138/2265] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:58:53 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:53.163848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61f4b7-74a6-462a-b6e6-df175cc8469b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:53.174148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61f4b7-74a6-462a-b6e6-df175cc8469b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:53.207341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:58:53.239796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde5cb6-cf3d-486a-a6b3-45a31458df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:53.240463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5cb6-cf3d-486a-a6b3-45a31458df4e admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:53.240794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5cb6-cf3d-486a-a6b3-45a31458df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:53.241076 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5cb6-cf3d-486a-a6b3-45a31458df4e admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:53.241764 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde5cb6-cf3d-486a-a6b3-45a31458df4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:53.243707 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde5cb6-cf3d-486a-a6b3-45a31458df4e admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:53.368741 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1128/2266] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:58:53 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:58:53.372875 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a0f02-9ab1-404c-afa7-9bd4a8852981 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:53.383365 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a0f02-9ab1-404c-afa7-9bd4a8852981 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:53.388637 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beea666-d399-4361-930e-9588fbccc066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:53.389607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea666-d399-4361-930e-9588fbccc066 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:53.389931 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea666-d399-4361-930e-9588fbccc066 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:53.390171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea666-d399-4361-930e-9588fbccc066 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:53.390960 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beea666-d399-4361-930e-9588fbccc066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:53.393278 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beea666-d399-4361-930e-9588fbccc066 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:53.404931 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1139/2267] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:58:53.409143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde5cb6-cf3d-486a-a6b3-45a31458df4e admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:53.419185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde5cb6-cf3d-486a-a6b3-45a31458df4e admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:53.424584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915ee35-7ffc-4928-b4f4-c2a3eda681b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:53.425259 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915ee35-7ffc-4928-b4f4-c2a3eda681b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:53.425538 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915ee35-7ffc-4928-b4f4-c2a3eda681b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:53.425809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915ee35-7ffc-4928-b4f4-c2a3eda681b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:53.426583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915ee35-7ffc-4928-b4f4-c2a3eda681b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:53.428844 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915ee35-7ffc-4928-b4f4-c2a3eda681b7 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:53.439817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1129/2268] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 14:58:53.444043 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beea666-d399-4361-930e-9588fbccc066 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:53.456010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beea666-d399-4361-930e-9588fbccc066 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:53.460525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd5825-b81b-4cf9-871b-5b04a19049a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:53.461493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd5825-b81b-4cf9-871b-5b04a19049a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:53.461776 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd5825-b81b-4cf9-871b-5b04a19049a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:53.466258 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd5825-b81b-4cf9-871b-5b04a19049a4 admin admin] PATH_INFO: `/v3/projects/b53448d1066c4a09920b8c2d1924d253/users/75c749edf6fc49188b2e838f8cc64310/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:53.477165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd5825-b81b-4cf9-871b-5b04a19049a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b53448d1066c4a09920b8c2d1924d253, user_id=75c749edf6fc49188b2e838f8cc64310, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:53.479860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd5825-b81b-4cf9-871b-5b04a19049a4 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:53.554050 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1140/2269] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:58:53 2022] PUT /identity/v3/projects/b53448d1066c4a09920b8c2d1924d253/users/75c749edf6fc49188b2e838f8cc64310/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:58:53.564104 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39769-8a9c-4314-bacd-cf29f09aefaa None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:53.564635 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39769-8a9c-4314-bacd-cf29f09aefaa None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:53.565136 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39769-8a9c-4314-bacd-cf29f09aefaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:53.592435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-afd39769-8a9c-4314-bacd-cf29f09aefaa None None] MFA Rules not processed for user `75c749edf6fc49188b2e838f8cc64310`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:58:53.593715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-afd39769-8a9c-4314-bacd-cf29f09aefaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:53.660873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1130/2270] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:58:53.671662 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd5825-b81b-4cf9-871b-5b04a19049a4 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:53.674028 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-59cd5825-b81b-4cf9-871b-5b04a19049a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:53.731189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd5825-b81b-4cf9-871b-5b04a19049a4 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:53.734877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879a0ae-a0ca-4bac-8d49-f712cf765ab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:53.736154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879a0ae-a0ca-4bac-8d49-f712cf765ab2 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:53.736446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879a0ae-a0ca-4bac-8d49-f712cf765ab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:53.736916 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879a0ae-a0ca-4bac-8d49-f712cf765ab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:53.747080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879a0ae-a0ca-4bac-8d49-f712cf765ab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:53.749255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879a0ae-a0ca-4bac-8d49-f712cf765ab2 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:53.757676 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1141/2271] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:58:58.744113 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd39769-8a9c-4314-bacd-cf29f09aefaa None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:58:58.744113 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-afd39769-8a9c-4314-bacd-cf29f09aefaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:58.871072 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd39769-8a9c-4314-bacd-cf29f09aefaa None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:58:58.877006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9675d89-1636-4bef-b348-896878686804 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:58:58.877990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9675d89-1636-4bef-b348-896878686804 service placement] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:58:58.877990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9675d89-1636-4bef-b348-896878686804 service placement] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:58:58.878278 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9675d89-1636-4bef-b348-896878686804 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:58:58.880215 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-d9675d89-1636-4bef-b348-896878686804 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:58:58.892881 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9675d89-1636-4bef-b348-896878686804 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:58:58.894605 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9675d89-1636-4bef-b348-896878686804 service placement] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:58:58.906872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1131/2272] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:58:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:59:03.753604 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=63,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:08.901596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:11.249205 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879a0ae-a0ca-4bac-8d49-f712cf765ab2 service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:11.328006 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879a0ae-a0ca-4bac-8d49-f712cf765ab2 service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:11.335431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c925d-59c0-4f1e-9660-ac45900459bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:11.337734 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c925d-59c0-4f1e-9660-ac45900459bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:11.338036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c925d-59c0-4f1e-9660-ac45900459bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:11.338306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c925d-59c0-4f1e-9660-ac45900459bc admin admin] PATH_INFO: `/v3/users/75c749edf6fc49188b2e838f8cc64310` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:11.339654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c925d-59c0-4f1e-9660-ac45900459bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=75c749edf6fc49188b2e838f8cc64310)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:11.341720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c925d-59c0-4f1e-9660-ac45900459bc admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:59:11.565187 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-078c925d-59c0-4f1e-9660-ac45900459bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75c749edf6fc49188b2e838f8cc64310'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:59:11.578446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-078c925d-59c0-4f1e-9660-ac45900459bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75c749edf6fc49188b2e838f8cc64310'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:59:11.670144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-078c925d-59c0-4f1e-9660-ac45900459bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75c749edf6fc49188b2e838f8cc64310'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:59:11.670854 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-078c925d-59c0-4f1e-9660-ac45900459bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75c749edf6fc49188b2e838f8cc64310'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:59:11.680080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-078c925d-59c0-4f1e-9660-ac45900459bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75c749edf6fc49188b2e838f8cc64310'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:59:11.686996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1142/2273] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:59:11 2022] DELETE /identity/v3/users/75c749edf6fc49188b2e838f8cc64310 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:59:11.691933 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5147a8-3f4e-4d98-873d-a64e335772ca None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:11.692431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5147a8-3f4e-4d98-873d-a64e335772ca None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:11.693127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5147a8-3f4e-4d98-873d-a64e335772ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:11.715080 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-6a5147a8-3f4e-4d98-873d-a64e335772ca None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:59:11.716676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6a5147a8-3f4e-4d98-873d-a64e335772ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:59:11.779904 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1132/2274] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:59:11.789934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c925d-59c0-4f1e-9660-ac45900459bc admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:11.791349 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-078c925d-59c0-4f1e-9660-ac45900459bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:59:11.855766 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c925d-59c0-4f1e-9660-ac45900459bc admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:11.864160 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a116c5-f630-49d7-85b2-a778fe2311e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:11.864851 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a116c5-f630-49d7-85b2-a778fe2311e5 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:11.865167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a116c5-f630-49d7-85b2-a778fe2311e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:11.865444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a116c5-f630-49d7-85b2-a778fe2311e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:11.875463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a116c5-f630-49d7-85b2-a778fe2311e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:11.878035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a116c5-f630-49d7-85b2-a778fe2311e5 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:59:11.888264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1143/2275] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 14:59:12.318725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5147a8-3f4e-4d98-873d-a64e335772ca None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:12.320368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6a5147a8-3f4e-4d98-873d-a64e335772ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:59:12.332858 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5147a8-3f4e-4d98-873d-a64e335772ca None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:12.337416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a13a71-cddd-4efc-994e-2cd058b8683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:12.338264 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a13a71-cddd-4efc-994e-2cd058b8683e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:12.338540 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a13a71-cddd-4efc-994e-2cd058b8683e admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:12.338815 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a13a71-cddd-4efc-994e-2cd058b8683e admin admin] PATH_INFO: `/v3/projects/b53448d1066c4a09920b8c2d1924d253` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:12.339988 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a13a71-cddd-4efc-994e-2cd058b8683e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b53448d1066c4a09920b8c2d1924d253)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:12.341906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a13a71-cddd-4efc-994e-2cd058b8683e admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:59:12.467377 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a9a13a71-cddd-4efc-994e-2cd058b8683e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b53448d1066c4a09920b8c2d1924d253', 'request_id': 'req-a9a13a71-cddd-4efc-994e-2cd058b8683e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:59:12.542376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a9a13a71-cddd-4efc-994e-2cd058b8683e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b53448d1066c4a09920b8c2d1924d253', 'request_id': 'req-a9a13a71-cddd-4efc-994e-2cd058b8683e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:59:12.550478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a9a13a71-cddd-4efc-994e-2cd058b8683e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b53448d1066c4a09920b8c2d1924d253', 'request_id': 'req-a9a13a71-cddd-4efc-994e-2cd058b8683e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:59:12.565359 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a9a13a71-cddd-4efc-994e-2cd058b8683e admin admin] The token cache is being invalidate because project b53448d1066c4a09920b8c2d1924d253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 14:59:12.565359 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a9a13a71-cddd-4efc-994e-2cd058b8683e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:59:12.566021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a9a13a71-cddd-4efc-994e-2cd058b8683e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 14:59:12.567695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1133/2276] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 14:59:12 2022] DELETE /identity/v3/projects/b53448d1066c4a09920b8c2d1924d253 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 14:59:12.574411 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a234f-3622-4cc6-b803-72570622d57e None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:12.574890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a234f-3622-4cc6-b803-72570622d57e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:12.575193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a234f-3622-4cc6-b803-72570622d57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:12.594736 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-7c6a234f-3622-4cc6-b803-72570622d57e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:59:12.596000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7c6a234f-3622-4cc6-b803-72570622d57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:59:12.614423 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:12.659211 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1144/2277] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:59:12.666967 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bcdeb-b97c-4438-a750-ac80b6aba552 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:12.667194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bcdeb-b97c-4438-a750-ac80b6aba552 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:12.667476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bcdeb-b97c-4438-a750-ac80b6aba552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:12.687742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-9e3bcdeb-b97c-4438-a750-ac80b6aba552 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:59:12.689411 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-9e3bcdeb-b97c-4438-a750-ac80b6aba552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:59:12.697687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1134/2278] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:59:12.701911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a234f-3622-4cc6-b803-72570622d57e None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:12.713817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a234f-3622-4cc6-b803-72570622d57e None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:12.718539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8992242-eccb-40b6-a66a-99eec74022bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:12.720137 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8992242-eccb-40b6-a66a-99eec74022bf admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:12.720619 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8992242-eccb-40b6-a66a-99eec74022bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:12.726061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8992242-eccb-40b6-a66a-99eec74022bf admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:12.726061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8992242-eccb-40b6-a66a-99eec74022bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 14:59:12.726061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8992242-eccb-40b6-a66a-99eec74022bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:12.726061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8992242-eccb-40b6-a66a-99eec74022bf admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:59:12.738947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1145/2279] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 14:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 14:59:12.740007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bcdeb-b97c-4438-a750-ac80b6aba552 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:12.749408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bcdeb-b97c-4438-a750-ac80b6aba552 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:12.754436 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac08315-aa82-4407-80db-be47b0dd70f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:12.755091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac08315-aa82-4407-80db-be47b0dd70f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:12.755371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac08315-aa82-4407-80db-be47b0dd70f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:12.755647 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac08315-aa82-4407-80db-be47b0dd70f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:12.756381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac08315-aa82-4407-80db-be47b0dd70f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:12.758377 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac08315-aa82-4407-80db-be47b0dd70f7 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:59:12.861280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1135/2280] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 14:59:12 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 14:59:12.865466 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8992242-eccb-40b6-a66a-99eec74022bf admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:12.875521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8992242-eccb-40b6-a66a-99eec74022bf admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:12.933289 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953835b-c2fa-4ce9-a168-1463557d1894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:12.933904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953835b-c2fa-4ce9-a168-1463557d1894 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:12.934187 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953835b-c2fa-4ce9-a168-1463557d1894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:12.934463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953835b-c2fa-4ce9-a168-1463557d1894 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:12.935144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953835b-c2fa-4ce9-a168-1463557d1894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:12.937076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953835b-c2fa-4ce9-a168-1463557d1894 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:59:13.021503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1146/2281] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 14:59:12 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 14:59:13.025798 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac08315-aa82-4407-80db-be47b0dd70f7 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:13.036359 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac08315-aa82-4407-80db-be47b0dd70f7 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:13.040985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a42440-6148-499b-84d9-93f1721cbde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:13.041679 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a42440-6148-499b-84d9-93f1721cbde0 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:13.041958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a42440-6148-499b-84d9-93f1721cbde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:13.042229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a42440-6148-499b-84d9-93f1721cbde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:13.042954 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a42440-6148-499b-84d9-93f1721cbde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:13.044574 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a42440-6148-499b-84d9-93f1721cbde0 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:59:13.056166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1136/2282] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:59:13.060069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953835b-c2fa-4ce9-a168-1463557d1894 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:13.071009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953835b-c2fa-4ce9-a168-1463557d1894 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:13.075850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cb93d-6273-4ed3-ba68-56c08ef4175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:13.076514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cb93d-6273-4ed3-ba68-56c08ef4175b admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:13.076836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cb93d-6273-4ed3-ba68-56c08ef4175b admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:13.077114 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cb93d-6273-4ed3-ba68-56c08ef4175b admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:13.077876 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cb93d-6273-4ed3-ba68-56c08ef4175b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:13.080102 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cb93d-6273-4ed3-ba68-56c08ef4175b admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:59:13.095081 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1147/2283] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 14:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 14:59:13.099127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a42440-6148-499b-84d9-93f1721cbde0 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:13.114598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a42440-6148-499b-84d9-93f1721cbde0 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:13.119306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9af8d2-bcb4-4408-a836-35ae4ac80c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:13.120175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9af8d2-bcb4-4408-a836-35ae4ac80c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:13.120455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9af8d2-bcb4-4408-a836-35ae4ac80c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:13.120770 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9af8d2-bcb4-4408-a836-35ae4ac80c49 admin admin] PATH_INFO: `/v3/projects/cb53805867534e8c89773fcea5587c74/users/7fd65bbf41c74caa981c6b29c84a4393/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:13.135659 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9af8d2-bcb4-4408-a836-35ae4ac80c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb53805867534e8c89773fcea5587c74, user_id=7fd65bbf41c74caa981c6b29c84a4393, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:13.138323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9af8d2-bcb4-4408-a836-35ae4ac80c49 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:59:13.208470 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1137/2284] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 14:59:13 2022] PUT /identity/v3/projects/cb53805867534e8c89773fcea5587c74/users/7fd65bbf41c74caa981c6b29c84a4393/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 14:59:13.219542 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f21f1-9364-4ddf-b7ec-ac8e9bf788f8 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:13.220008 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f21f1-9364-4ddf-b7ec-ac8e9bf788f8 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:13.220293 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f21f1-9364-4ddf-b7ec-ac8e9bf788f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:13.246751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-c96f21f1-9364-4ddf-b7ec-ac8e9bf788f8 None None] MFA Rules not processed for user `7fd65bbf41c74caa981c6b29c84a4393`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:59:13.247999 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-c96f21f1-9364-4ddf-b7ec-ac8e9bf788f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:59:13.309923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1148/2285] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:59:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:59:13.322047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9af8d2-bcb4-4408-a836-35ae4ac80c49 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:13.323746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2a9af8d2-bcb4-4408-a836-35ae4ac80c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:59:13.345881 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:13.381728 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9af8d2-bcb4-4408-a836-35ae4ac80c49 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:13.385383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5bdbb-8822-4bdb-b9e7-9aa429483970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:13.386021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5bdbb-8822-4bdb-b9e7-9aa429483970 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:13.386302 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5bdbb-8822-4bdb-b9e7-9aa429483970 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:13.386578 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5bdbb-8822-4bdb-b9e7-9aa429483970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:13.395239 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5bdbb-8822-4bdb-b9e7-9aa429483970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:13.396670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5bdbb-8822-4bdb-b9e7-9aa429483970 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:59:13.406100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1138/2286] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 14:59:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 14:59:23.307051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:23.455842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=17 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 14:59:51.613917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd3307-e328-462e-bde4-8b81d584117d None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:51.614440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd3307-e328-462e-bde4-8b81d584117d None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:51.614533 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd3307-e328-462e-bde4-8b81d584117d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:51.672288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-45cd3307-e328-462e-bde4-8b81d584117d None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:59:51.673635 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-45cd3307-e328-462e-bde4-8b81d584117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:59:51.736135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1149/2287] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Jun 27 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:59:51.776197 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5bdbb-8822-4bdb-b9e7-9aa429483970 service cinder] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:51.777608 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-33b5bdbb-8822-4bdb-b9e7-9aa429483970 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:59:51.865979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5bdbb-8822-4bdb-b9e7-9aa429483970 service cinder] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:51.871012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b8fe3-e7da-467f-8e57-ad3e11f7fc75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:51.871638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b8fe3-e7da-467f-8e57-ad3e11f7fc75 service swift] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:51.871917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b8fe3-e7da-467f-8e57-ad3e11f7fc75 service swift] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:51.872189 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b8fe3-e7da-467f-8e57-ad3e11f7fc75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:51.882316 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b8fe3-e7da-467f-8e57-ad3e11f7fc75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:51.884043 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b8fe3-e7da-467f-8e57-ad3e11f7fc75 service swift] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:59:51.893000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1139/2288] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 14:59:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 14:59:52.731280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa40978-530c-457d-8828-87adf5a3515e None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:52.731752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa40978-530c-457d-8828-87adf5a3515e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:52.731849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa40978-530c-457d-8828-87adf5a3515e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:52.750396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-3fa40978-530c-457d-8828-87adf5a3515e None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:59:52.752075 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-3fa40978-530c-457d-8828-87adf5a3515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:59:52.761557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1150/2289] 10.222.0.44 () {58 vars in 967 bytes} [Mon Jun 27 14:59:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:59:52.775708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b8fe3-e7da-467f-8e57-ad3e11f7fc75 service swift] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:52.786298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b8fe3-e7da-467f-8e57-ad3e11f7fc75 service swift] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:52.791944 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f380016-9803-41bc-9338-906808a3edf4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:52.792577 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f380016-9803-41bc-9338-906808a3edf4 service swift] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:52.792929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f380016-9803-41bc-9338-906808a3edf4 service swift] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:52.793526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f380016-9803-41bc-9338-906808a3edf4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:52.801970 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f380016-9803-41bc-9338-906808a3edf4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:52.803663 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f380016-9803-41bc-9338-906808a3edf4 service swift] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:59:52.811665 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1140/2290] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 14:59:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 14:59:53.237699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3250d-61df-46b9-b2e7-1db4b9b056dd None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:53.237980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3250d-61df-46b9-b2e7-1db4b9b056dd None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:53.238264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3250d-61df-46b9-b2e7-1db4b9b056dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:53.260927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-bee3250d-61df-46b9-b2e7-1db4b9b056dd None None] MFA Rules not processed for user `e7c4678d1aa9425db97adc6cce76e74f`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:59:53.263004 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-bee3250d-61df-46b9-b2e7-1db4b9b056dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:59:53.329221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1151/2291] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 14:59:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:59:53.450356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed330b1-705e-4f7b-8b21-fd725d5a5cb6 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:53.450646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed330b1-705e-4f7b-8b21-fd725d5a5cb6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:53.450918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed330b1-705e-4f7b-8b21-fd725d5a5cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:53.473762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-bed330b1-705e-4f7b-8b21-fd725d5a5cb6 None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:59:53.475060 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-bed330b1-705e-4f7b-8b21-fd725d5a5cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:59:53.482876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1141/2292] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Jun 27 14:59:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:59:53.496110 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3250d-61df-46b9-b2e7-1db4b9b056dd None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:53.508390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3250d-61df-46b9-b2e7-1db4b9b056dd None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:53.513552 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9247ca1-ecd2-415a-a0ed-1e114e1bb8af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:53.514230 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247ca1-ecd2-415a-a0ed-1e114e1bb8af service swift] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:53.514514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247ca1-ecd2-415a-a0ed-1e114e1bb8af service swift] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:53.514795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247ca1-ecd2-415a-a0ed-1e114e1bb8af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:53.523870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9247ca1-ecd2-415a-a0ed-1e114e1bb8af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:53.525491 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9247ca1-ecd2-415a-a0ed-1e114e1bb8af service swift] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:59:53.534770 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1152/2293] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 14:59:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 14:59:54.178738 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ce09-b868-4e15-b7cd-c76eec059769 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:54.179273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ce09-b868-4e15-b7cd-c76eec059769 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:54.179273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ce09-b868-4e15-b7cd-c76eec059769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:54.199789 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-ace0ce09-b868-4e15-b7cd-c76eec059769 None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:59:54.201046 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ace0ce09-b868-4e15-b7cd-c76eec059769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:59:54.208558 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1142/2294] 10.222.0.44 () {58 vars in 967 bytes} [Mon Jun 27 14:59:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:59:54.221470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9247ca1-ecd2-415a-a0ed-1e114e1bb8af service swift] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:54.231904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9247ca1-ecd2-415a-a0ed-1e114e1bb8af service swift] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:54.237938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65124eec-da80-49a4-8b7a-e6f593cc682c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:54.238570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65124eec-da80-49a4-8b7a-e6f593cc682c service swift] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:54.238857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65124eec-da80-49a4-8b7a-e6f593cc682c service swift] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:54.239132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65124eec-da80-49a4-8b7a-e6f593cc682c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:54.247333 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65124eec-da80-49a4-8b7a-e6f593cc682c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:54.248980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65124eec-da80-49a4-8b7a-e6f593cc682c service swift] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:59:54.259175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1153/2295] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 14:59:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 14:59:59.228473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a39d4-43de-4127-9f75-e851a8652d1a None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:59.228962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a39d4-43de-4127-9f75-e851a8652d1a None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:59.229059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a39d4-43de-4127-9f75-e851a8652d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:59.247561 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f12a39d4-43de-4127-9f75-e851a8652d1a None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 14:59:59.248822 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f12a39d4-43de-4127-9f75-e851a8652d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 14:59:59.256757 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1143/2296] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Jun 27 14:59:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 14:59:59.269383 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65124eec-da80-49a4-8b7a-e6f593cc682c service swift] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:59.280437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65124eec-da80-49a4-8b7a-e6f593cc682c service swift] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:59.286421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d77aa8-b5bf-4439-8d90-6226b8d7ae28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:59.287070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d77aa8-b5bf-4439-8d90-6226b8d7ae28 service swift] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:59.287355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d77aa8-b5bf-4439-8d90-6226b8d7ae28 service swift] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:59.287628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d77aa8-b5bf-4439-8d90-6226b8d7ae28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:59.306027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d77aa8-b5bf-4439-8d90-6226b8d7ae28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:59.307674 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d77aa8-b5bf-4439-8d90-6226b8d7ae28 service swift] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 14:59:59.317150 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1154/2297] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 14:59:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 14:59:59.708700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a39d4-43de-4127-9f75-e851a8652d1a None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 14:59:59.790806 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a39d4-43de-4127-9f75-e851a8652d1a None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 14:59:59.796369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69472015-2944-4f99-9ead-65e6d663e41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 14:59:59.797645 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69472015-2944-4f99-9ead-65e6d663e41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 14:59:59.798044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69472015-2944-4f99-9ead-65e6d663e41a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 14:59:59.798340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69472015-2944-4f99-9ead-65e6d663e41a admin admin] PATH_INFO: `/v3/users/7fd65bbf41c74caa981c6b29c84a4393` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 14:59:59.799614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69472015-2944-4f99-9ead-65e6d663e41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd65bbf41c74caa981c6b29c84a4393)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 14:59:59.801761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69472015-2944-4f99-9ead-65e6d663e41a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:00.071589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d77aa8-b5bf-4439-8d90-6226b8d7ae28 service swift] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:00.073390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-12d77aa8-b5bf-4439-8d90-6226b8d7ae28 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:00.110068 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d77aa8-b5bf-4439-8d90-6226b8d7ae28 service swift] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:00.113711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:00.117337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c72c13-0c75-4ced-b7af-20e13fef26ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:00.118511 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c72c13-0c75-4ced-b7af-20e13fef26ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:00.119000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c72c13-0c75-4ced-b7af-20e13fef26ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:00.119526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c72c13-0c75-4ced-b7af-20e13fef26ac admin admin] PATH_INFO: `/v3/users/c150fadafc3944159dfbf11f15bb1ba5` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:00.121132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c72c13-0c75-4ced-b7af-20e13fef26ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c150fadafc3944159dfbf11f15bb1ba5)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:00.123321 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c72c13-0c75-4ced-b7af-20e13fef26ac admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:00.124092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-69472015-2944-4f99-9ead-65e6d663e41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd65bbf41c74caa981c6b29c84a4393'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:00.159399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:00.189959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-69472015-2944-4f99-9ead-65e6d663e41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd65bbf41c74caa981c6b29c84a4393'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:00.301891 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-69472015-2944-4f99-9ead-65e6d663e41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd65bbf41c74caa981c6b29c84a4393'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:00.302974 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-69472015-2944-4f99-9ead-65e6d663e41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd65bbf41c74caa981c6b29c84a4393'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:00.316805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-69472015-2944-4f99-9ead-65e6d663e41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd65bbf41c74caa981c6b29c84a4393'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:00.329255 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1144/2298] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 14:59:59 2022] DELETE /identity/v3/users/7fd65bbf41c74caa981c6b29c84a4393 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:00:00.334305 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a60515-dd6b-48d7-8a1e-cc8b8349d9d9 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:00.334872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a60515-dd6b-48d7-8a1e-cc8b8349d9d9 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:00.335382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a60515-dd6b-48d7-8a1e-cc8b8349d9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:00.357396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-36a60515-dd6b-48d7-8a1e-cc8b8349d9d9 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:00.361227 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-36a60515-dd6b-48d7-8a1e-cc8b8349d9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:00.412421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a0c72c13-0c75-4ced-b7af-20e13fef26ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c150fadafc3944159dfbf11f15bb1ba5'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:00.441039 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a0c72c13-0c75-4ced-b7af-20e13fef26ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c150fadafc3944159dfbf11f15bb1ba5'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:00.491127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1145/2299] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:00:00.503363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a60515-dd6b-48d7-8a1e-cc8b8349d9d9 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:00.506363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-36a60515-dd6b-48d7-8a1e-cc8b8349d9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:00.548723 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a0c72c13-0c75-4ced-b7af-20e13fef26ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c150fadafc3944159dfbf11f15bb1ba5'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:00.549896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a0c72c13-0c75-4ced-b7af-20e13fef26ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c150fadafc3944159dfbf11f15bb1ba5'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:00.575714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a0c72c13-0c75-4ced-b7af-20e13fef26ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c150fadafc3944159dfbf11f15bb1ba5'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:00.594228 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1155/2300] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:00:00 2022] DELETE /identity/v3/users/c150fadafc3944159dfbf11f15bb1ba5 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:00:00.599684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e72a8d-0697-4fcd-8460-bc0dbe6cc42f None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:00.604009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e72a8d-0697-4fcd-8460-bc0dbe6cc42f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:00.604009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e72a8d-0697-4fcd-8460-bc0dbe6cc42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:00.626651 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a60515-dd6b-48d7-8a1e-cc8b8349d9d9 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:00.645739 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-e9e72a8d-0697-4fcd-8460-bc0dbe6cc42f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:00.648830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e9e72a8d-0697-4fcd-8460-bc0dbe6cc42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:00.687588 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd388557-e427-4719-898c-0f877987c2dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:00.689138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd388557-e427-4719-898c-0f877987c2dc service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:00.689593 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd388557-e427-4719-898c-0f877987c2dc service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:00.689732 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd388557-e427-4719-898c-0f877987c2dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:00.691735 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-dd388557-e427-4719-898c-0f877987c2dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:00.749129 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:00.809806 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1156/2301] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:00:00.823974 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd388557-e427-4719-898c-0f877987c2dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:00.826390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e72a8d-0697-4fcd-8460-bc0dbe6cc42f None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:00.826534 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd388557-e427-4719-898c-0f877987c2dc service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:00.826626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e9e72a8d-0697-4fcd-8460-bc0dbe6cc42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:00.849676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1146/2302] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:00:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:00:00.849907 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e72a8d-0697-4fcd-8460-bc0dbe6cc42f None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:00.855159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cad4c4-e514-4456-b964-5fda7211cade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:00.855939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cad4c4-e514-4456-b964-5fda7211cade service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:00.856226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cad4c4-e514-4456-b964-5fda7211cade service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:00.856502 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cad4c4-e514-4456-b964-5fda7211cade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:00.884881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cad4c4-e514-4456-b964-5fda7211cade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:00.886486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cad4c4-e514-4456-b964-5fda7211cade service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:00.899591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1157/2303] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:00:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:00:01.579565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd388557-e427-4719-898c-0f877987c2dc service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:01.583057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-dd388557-e427-4719-898c-0f877987c2dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:01.607208 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd388557-e427-4719-898c-0f877987c2dc service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:01.615406 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20dc87-e3d9-4b17-b521-cb2854ff259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:01.616385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20dc87-e3d9-4b17-b521-cb2854ff259f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:01.616687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20dc87-e3d9-4b17-b521-cb2854ff259f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:01.616975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20dc87-e3d9-4b17-b521-cb2854ff259f admin admin] PATH_INFO: `/v3/projects/773c5d27e2b24590922802937bf9db1b` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:01.618350 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20dc87-e3d9-4b17-b521-cb2854ff259f admin admin] RBAC: Authorizing `identity:delete_project(project_id=773c5d27e2b24590922802937bf9db1b)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:01.621575 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20dc87-e3d9-4b17-b521-cb2854ff259f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:01.720510 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cad4c4-e514-4456-b964-5fda7211cade service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:01.722935 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e8cad4c4-e514-4456-b964-5fda7211cade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:01.739413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cad4c4-e514-4456-b964-5fda7211cade service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:01.776483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47357cf5-f559-4db1-b4fc-0bf64dc45a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:01.776483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47357cf5-f559-4db1-b4fc-0bf64dc45a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:01.776483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47357cf5-f559-4db1-b4fc-0bf64dc45a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:01.776483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47357cf5-f559-4db1-b4fc-0bf64dc45a72 admin admin] PATH_INFO: `/v3/projects/cb53805867534e8c89773fcea5587c74` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:01.794402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47357cf5-f559-4db1-b4fc-0bf64dc45a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb53805867534e8c89773fcea5587c74)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:01.805119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0e20dc87-e3d9-4b17-b521-cb2854ff259f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773c5d27e2b24590922802937bf9db1b', 'request_id': 'req-0e20dc87-e3d9-4b17-b521-cb2854ff259f'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:01.806322 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47357cf5-f559-4db1-b4fc-0bf64dc45a72 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:01.887760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0e20dc87-e3d9-4b17-b521-cb2854ff259f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773c5d27e2b24590922802937bf9db1b', 'request_id': 'req-0e20dc87-e3d9-4b17-b521-cb2854ff259f'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:01.900712 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0e20dc87-e3d9-4b17-b521-cb2854ff259f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773c5d27e2b24590922802937bf9db1b', 'request_id': 'req-0e20dc87-e3d9-4b17-b521-cb2854ff259f'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:01.917689 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0e20dc87-e3d9-4b17-b521-cb2854ff259f admin admin] The token cache is being invalidate because project 773c5d27e2b24590922802937bf9db1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:00:01.918049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0e20dc87-e3d9-4b17-b521-cb2854ff259f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:01.918646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0e20dc87-e3d9-4b17-b521-cb2854ff259f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:01.921304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1147/2304] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:00:01 2022] DELETE /identity/v3/projects/773c5d27e2b24590922802937bf9db1b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:00:01.926698 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d0032-aef2-43d1-a5fb-0bb365b1f1bf None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:01.926927 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d0032-aef2-43d1-a5fb-0bb365b1f1bf None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:01.927266 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d0032-aef2-43d1-a5fb-0bb365b1f1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:01.949472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-47357cf5-f559-4db1-b4fc-0bf64dc45a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb53805867534e8c89773fcea5587c74', 'request_id': 'req-47357cf5-f559-4db1-b4fc-0bf64dc45a72'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:01.953605 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-275d0032-aef2-43d1-a5fb-0bb365b1f1bf None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:01.955159 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-275d0032-aef2-43d1-a5fb-0bb365b1f1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:01.967800 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-47357cf5-f559-4db1-b4fc-0bf64dc45a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb53805867534e8c89773fcea5587c74', 'request_id': 'req-47357cf5-f559-4db1-b4fc-0bf64dc45a72'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:02.040728 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1148/2305] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:00:02.048558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-47357cf5-f559-4db1-b4fc-0bf64dc45a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb53805867534e8c89773fcea5587c74', 'request_id': 'req-47357cf5-f559-4db1-b4fc-0bf64dc45a72'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:02.051303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0e3d7-a80c-4821-91d5-4fa285afa705 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:02.051303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0e3d7-a80c-4821-91d5-4fa285afa705 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:02.051303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0e3d7-a80c-4821-91d5-4fa285afa705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:02.060548 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-47357cf5-f559-4db1-b4fc-0bf64dc45a72 admin admin] The token cache is being invalidate because project cb53805867534e8c89773fcea5587c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:00:02.060888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-47357cf5-f559-4db1-b4fc-0bf64dc45a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:02.061544 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-47357cf5-f559-4db1-b4fc-0bf64dc45a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:02.068155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1158/2306] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:00:01 2022] DELETE /identity/v3/projects/cb53805867534e8c89773fcea5587c74 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:00:02.070303 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdb218-f30f-4316-9245-15e03378a995 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:02.070600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdb218-f30f-4316-9245-15e03378a995 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:02.074269 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdb218-f30f-4316-9245-15e03378a995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:02.077486 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-62e0e3d7-a80c-4821-91d5-4fa285afa705 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:02.079618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-62e0e3d7-a80c-4821-91d5-4fa285afa705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:02.080192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:02.089885 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1149/2307] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:00:02.096521 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0e3d7-a80c-4821-91d5-4fa285afa705 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:02.108274 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0e3d7-a80c-4821-91d5-4fa285afa705 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:02.109744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a8fdb218-f30f-4316-9245-15e03378a995 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:02.111336 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a8fdb218-f30f-4316-9245-15e03378a995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:02.113617 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ffdcb-87f1-4115-9b2e-7976de9d156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:02.114293 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ffdcb-87f1-4115-9b2e-7976de9d156d admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:02.114676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ffdcb-87f1-4115-9b2e-7976de9d156d admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:02.115060 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ffdcb-87f1-4115-9b2e-7976de9d156d admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:02.116011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ffdcb-87f1-4115-9b2e-7976de9d156d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:00:02.116387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ffdcb-87f1-4115-9b2e-7976de9d156d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:02.118103 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ffdcb-87f1-4115-9b2e-7976de9d156d admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:02.120276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1159/2308] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:00:02.128723 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b948b-d8b5-48bf-8d87-fb405ac613b6 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:02.137955 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b948b-d8b5-48bf-8d87-fb405ac613b6 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:02.137955 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b948b-d8b5-48bf-8d87-fb405ac613b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:02.151292 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1150/2309] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:00:02.155393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ffdcb-87f1-4115-9b2e-7976de9d156d admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:02.164731 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-319b948b-d8b5-48bf-8d87-fb405ac613b6 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:02.166447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-319b948b-d8b5-48bf-8d87-fb405ac613b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:02.179148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1160/2310] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:00:02.186036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ffdcb-87f1-4115-9b2e-7976de9d156d admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:02.191309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b948b-d8b5-48bf-8d87-fb405ac613b6 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:02.191525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074159c-5582-4dbf-b48e-58d152062195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:02.192272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074159c-5582-4dbf-b48e-58d152062195 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:02.193530 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074159c-5582-4dbf-b48e-58d152062195 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:02.193820 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074159c-5582-4dbf-b48e-58d152062195 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:02.194578 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074159c-5582-4dbf-b48e-58d152062195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:02.196595 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074159c-5582-4dbf-b48e-58d152062195 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:02.209873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b948b-d8b5-48bf-8d87-fb405ac613b6 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:02.233898 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267629b-96a5-434c-8a3d-0ae143dc7b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:02.235567 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267629b-96a5-434c-8a3d-0ae143dc7b77 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:02.236101 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267629b-96a5-434c-8a3d-0ae143dc7b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:02.238110 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267629b-96a5-434c-8a3d-0ae143dc7b77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:02.238110 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267629b-96a5-434c-8a3d-0ae143dc7b77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:00:02.242558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267629b-96a5-434c-8a3d-0ae143dc7b77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:02.242558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267629b-96a5-434c-8a3d-0ae143dc7b77 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:02.260812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1161/2311] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:00:02.262452 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267629b-96a5-434c-8a3d-0ae143dc7b77 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:02.285390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267629b-96a5-434c-8a3d-0ae143dc7b77 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:02.291704 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1f125-8b70-4d64-a3e9-7ef53fd6a748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:02.294531 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1f125-8b70-4d64-a3e9-7ef53fd6a748 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:02.294531 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1f125-8b70-4d64-a3e9-7ef53fd6a748 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:02.294531 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1f125-8b70-4d64-a3e9-7ef53fd6a748 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:02.294531 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1f125-8b70-4d64-a3e9-7ef53fd6a748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:02.297288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1f125-8b70-4d64-a3e9-7ef53fd6a748 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:02.299466 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1151/2312] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:00:02 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:00:02.303324 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074159c-5582-4dbf-b48e-58d152062195 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:02.311548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:02.379461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074159c-5582-4dbf-b48e-58d152062195 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:02.384877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031cdd9-519b-4fba-8c05-bb29223208a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:02.385687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031cdd9-519b-4fba-8c05-bb29223208a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:02.385976 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031cdd9-519b-4fba-8c05-bb29223208a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:02.386249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031cdd9-519b-4fba-8c05-bb29223208a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:02.386955 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031cdd9-519b-4fba-8c05-bb29223208a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:02.389248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031cdd9-519b-4fba-8c05-bb29223208a0 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:02.413537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1162/2313] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:00:02 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:00:02.414399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1f125-8b70-4d64-a3e9-7ef53fd6a748 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:02.498087 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1152/2314] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:00:02 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:00:02.499143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031cdd9-519b-4fba-8c05-bb29223208a0 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:02.515499 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031cdd9-519b-4fba-8c05-bb29223208a0 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:02.519228 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1f125-8b70-4d64-a3e9-7ef53fd6a748 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:02.521031 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9231c08-8224-4f83-8ae2-95565a4c77d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:02.521717 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9231c08-8224-4f83-8ae2-95565a4c77d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:02.522003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9231c08-8224-4f83-8ae2-95565a4c77d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:02.522300 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9231c08-8224-4f83-8ae2-95565a4c77d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:02.523031 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9231c08-8224-4f83-8ae2-95565a4c77d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:02.524606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9231c08-8224-4f83-8ae2-95565a4c77d0 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:02.526542 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7aefb-5abf-406d-9470-8b4355113eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:02.527927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7aefb-5abf-406d-9470-8b4355113eeb admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:02.528432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7aefb-5abf-406d-9470-8b4355113eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:02.528949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7aefb-5abf-406d-9470-8b4355113eeb admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:02.529863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7aefb-5abf-406d-9470-8b4355113eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:02.533462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7aefb-5abf-406d-9470-8b4355113eeb admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:02.542135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1153/2315] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:00:02.543034 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9231c08-8224-4f83-8ae2-95565a4c77d0 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:02.559309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9231c08-8224-4f83-8ae2-95565a4c77d0 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:02.567315 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2655e7-cc25-4fef-ae9d-5d3349ad6d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:02.568165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2655e7-cc25-4fef-ae9d-5d3349ad6d24 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:02.568541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2655e7-cc25-4fef-ae9d-5d3349ad6d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:02.570500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2655e7-cc25-4fef-ae9d-5d3349ad6d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:02.570500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2655e7-cc25-4fef-ae9d-5d3349ad6d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:02.571865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2655e7-cc25-4fef-ae9d-5d3349ad6d24 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:02.589510 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1154/2316] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:00:02.606929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2655e7-cc25-4fef-ae9d-5d3349ad6d24 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:02.631346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2655e7-cc25-4fef-ae9d-5d3349ad6d24 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:02.640156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dcbdb-98ea-45c5-8faf-404f18433888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:02.641449 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dcbdb-98ea-45c5-8faf-404f18433888 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:02.641892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dcbdb-98ea-45c5-8faf-404f18433888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:02.653936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dcbdb-98ea-45c5-8faf-404f18433888 admin admin] PATH_INFO: `/v3/projects/63f6e59e76d642afaa9db58152919f87/users/de1ab057c70d4f3f8f2a4b05e48d7f99/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:02.674018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1163/2317] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:00:02 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:00:02.674018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7aefb-5abf-406d-9470-8b4355113eeb admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:02.689380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7aefb-5abf-406d-9470-8b4355113eeb admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:02.711408 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a0342-d91f-4fe4-a9d9-c5dd0340ccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:02.713494 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a0342-d91f-4fe4-a9d9-c5dd0340ccd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:02.713883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a0342-d91f-4fe4-a9d9-c5dd0340ccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:02.715158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a0342-d91f-4fe4-a9d9-c5dd0340ccd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:02.716039 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a0342-d91f-4fe4-a9d9-c5dd0340ccd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:02.720556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a0342-d91f-4fe4-a9d9-c5dd0340ccd6 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:02.722203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dcbdb-98ea-45c5-8faf-404f18433888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f6e59e76d642afaa9db58152919f87, user_id=de1ab057c70d4f3f8f2a4b05e48d7f99, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:02.732008 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dcbdb-98ea-45c5-8faf-404f18433888 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:02.747587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1164/2318] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:00:02.751341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a0342-d91f-4fe4-a9d9-c5dd0340ccd6 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:02.776083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a0342-d91f-4fe4-a9d9-c5dd0340ccd6 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:02.791823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20011b6-b701-4c01-b5dd-91007aaeeebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:02.792224 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20011b6-b701-4c01-b5dd-91007aaeeebd admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:02.802306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20011b6-b701-4c01-b5dd-91007aaeeebd admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:02.802306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20011b6-b701-4c01-b5dd-91007aaeeebd admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:02.802306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20011b6-b701-4c01-b5dd-91007aaeeebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:02.802306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20011b6-b701-4c01-b5dd-91007aaeeebd admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:02.826447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1165/2319] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:00:02.828711 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20011b6-b701-4c01-b5dd-91007aaeeebd admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:02.845373 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1155/2320] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:00:02 2022] PUT /identity/v3/projects/63f6e59e76d642afaa9db58152919f87/users/de1ab057c70d4f3f8f2a4b05e48d7f99/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:00:02.849405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5f256-cd22-4972-ba9b-d170159811b6 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:02.849612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20011b6-b701-4c01-b5dd-91007aaeeebd admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:02.851279 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5f256-cd22-4972-ba9b-d170159811b6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:02.851550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5f256-cd22-4972-ba9b-d170159811b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:02.905223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-fde5f256-cd22-4972-ba9b-d170159811b6 None None] MFA Rules not processed for user `de1ab057c70d4f3f8f2a4b05e48d7f99`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:02.908880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-fde5f256-cd22-4972-ba9b-d170159811b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:03.013448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d21c2-2afe-41c3-bf21-cc9ff41d7c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:03.014830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d21c2-2afe-41c3-bf21-cc9ff41d7c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:03.015009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d21c2-2afe-41c3-bf21-cc9ff41d7c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:03.015900 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d21c2-2afe-41c3-bf21-cc9ff41d7c20 admin admin] PATH_INFO: `/v3/projects/51e6f52c6a854f65aaa7f0a3f706c83c/users/e03bcfa7f95d4266ac02a457e14d0c01/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:03.050380 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1156/2321] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:00:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:00:03.051878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d21c2-2afe-41c3-bf21-cc9ff41d7c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e6f52c6a854f65aaa7f0a3f706c83c, user_id=e03bcfa7f95d4266ac02a457e14d0c01, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:03.060915 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5f256-cd22-4972-ba9b-d170159811b6 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:03.063257 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d21c2-2afe-41c3-bf21-cc9ff41d7c20 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:03.063626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-fde5f256-cd22-4972-ba9b-d170159811b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:03.161378 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:03.195729 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5f256-cd22-4972-ba9b-d170159811b6 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:03.199294 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1166/2322] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:00:02 2022] PUT /identity/v3/projects/51e6f52c6a854f65aaa7f0a3f706c83c/users/e03bcfa7f95d4266ac02a457e14d0c01/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:00:03.206034 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f34298-6f9f-44ea-bb64-be22f6af3dfb None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:03.206979 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f34298-6f9f-44ea-bb64-be22f6af3dfb None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:03.207434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f34298-6f9f-44ea-bb64-be22f6af3dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:03.265077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:03.276964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-05f34298-6f9f-44ea-bb64-be22f6af3dfb None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:03.276964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-05f34298-6f9f-44ea-bb64-be22f6af3dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:03.347012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a674d05-2eda-46e2-bfb1-26ae32e3e796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:03.347682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a674d05-2eda-46e2-bfb1-26ae32e3e796 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:03.347974 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a674d05-2eda-46e2-bfb1-26ae32e3e796 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:03.348253 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a674d05-2eda-46e2-bfb1-26ae32e3e796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:03.418218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1167/2323] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:00:03.434357 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f34298-6f9f-44ea-bb64-be22f6af3dfb None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:03.436379 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-05f34298-6f9f-44ea-bb64-be22f6af3dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:03.479199 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a674d05-2eda-46e2-bfb1-26ae32e3e796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:03.480957 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a674d05-2eda-46e2-bfb1-26ae32e3e796 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:03.491403 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1157/2324] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:00:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:00:03.505881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f34298-6f9f-44ea-bb64-be22f6af3dfb None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:03.510495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a13e0-2d58-4ced-b86f-3547931c4aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:03.511951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a13e0-2d58-4ced-b86f-3547931c4aca service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:03.512626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a13e0-2d58-4ced-b86f-3547931c4aca service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:03.513031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a13e0-2d58-4ced-b86f-3547931c4aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:03.526904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a13e0-2d58-4ced-b86f-3547931c4aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:03.528637 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a13e0-2d58-4ced-b86f-3547931c4aca service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:03.540825 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1168/2325] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:00:08.031981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a674d05-2eda-46e2-bfb1-26ae32e3e796 service cinder] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:08.044937 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a674d05-2eda-46e2-bfb1-26ae32e3e796 service cinder] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:08.054545 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231b5be-a65a-4618-b3d6-9f2e933ae2e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:08.055220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231b5be-a65a-4618-b3d6-9f2e933ae2e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:08.055506 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231b5be-a65a-4618-b3d6-9f2e933ae2e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:08.055784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231b5be-a65a-4618-b3d6-9f2e933ae2e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:08.065103 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-4231b5be-a65a-4618-b3d6-9f2e933ae2e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:08.201552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231b5be-a65a-4618-b3d6-9f2e933ae2e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:08.204781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231b5be-a65a-4618-b3d6-9f2e933ae2e9 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:08.217414 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1158/2326] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:00:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:00:11.427151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963585ec-fbfb-49ad-818c-c4729f2b19a3 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:11.427752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963585ec-fbfb-49ad-818c-c4729f2b19a3 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:11.427752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963585ec-fbfb-49ad-818c-c4729f2b19a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:11.481033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-963585ec-fbfb-49ad-818c-c4729f2b19a3 None None] MFA Rules not processed for user `e03bcfa7f95d4266ac02a457e14d0c01`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:11.483038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-963585ec-fbfb-49ad-818c-c4729f2b19a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:11.587640 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231b5be-a65a-4618-b3d6-9f2e933ae2e9 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:11.599398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1169/2327] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:00:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:00:11.614315 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231b5be-a65a-4618-b3d6-9f2e933ae2e9 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:11.633097 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2cf31-1e8c-4c7b-9815-60ed5e6b0d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:11.634036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2cf31-1e8c-4c7b-9815-60ed5e6b0d9d admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:11.634430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2cf31-1e8c-4c7b-9815-60ed5e6b0d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:11.634814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2cf31-1e8c-4c7b-9815-60ed5e6b0d9d admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:11.635628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2cf31-1e8c-4c7b-9815-60ed5e6b0d9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:11.637681 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2cf31-1e8c-4c7b-9815-60ed5e6b0d9d admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:11.752186 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1159/2328] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:00:11 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:00:11.753639 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963585ec-fbfb-49ad-818c-c4729f2b19a3 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:11.767562 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963585ec-fbfb-49ad-818c-c4729f2b19a3 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:11.825613 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:11.848049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027f761-a144-42bb-93e2-6498ca7c36dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:11.848789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027f761-a144-42bb-93e2-6498ca7c36dc admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:11.849530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027f761-a144-42bb-93e2-6498ca7c36dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:11.849884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027f761-a144-42bb-93e2-6498ca7c36dc admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:11.850659 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027f761-a144-42bb-93e2-6498ca7c36dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:11.853020 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027f761-a144-42bb-93e2-6498ca7c36dc admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:11.940476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2cf31-1e8c-4c7b-9815-60ed5e6b0d9d admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:11.951502 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1170/2329] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:00:11 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:00:11.960807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2cf31-1e8c-4c7b-9815-60ed5e6b0d9d admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:11.976165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97431e26-0d44-4f32-a5df-eacc857e84a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:11.977238 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97431e26-0d44-4f32-a5df-eacc857e84a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:11.977583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97431e26-0d44-4f32-a5df-eacc857e84a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:11.977868 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97431e26-0d44-4f32-a5df-eacc857e84a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:11.978623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97431e26-0d44-4f32-a5df-eacc857e84a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:11.982624 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97431e26-0d44-4f32-a5df-eacc857e84a3 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:12.020802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027f761-a144-42bb-93e2-6498ca7c36dc admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:12.028769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1160/2330] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:00:12.034970 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027f761-a144-42bb-93e2-6498ca7c36dc admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:12.040247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c97bc-ed6c-400c-a077-7b14c6a71982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:12.041205 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c97bc-ed6c-400c-a077-7b14c6a71982 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:12.041489 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c97bc-ed6c-400c-a077-7b14c6a71982 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:12.041766 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c97bc-ed6c-400c-a077-7b14c6a71982 admin admin] PATH_INFO: `/v3/projects/c7aaae29f47e433bae017072baed0851/users/eb4b7d1f9d2a4059b95610a42e94c3c7/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:12.068958 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c97bc-ed6c-400c-a077-7b14c6a71982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7aaae29f47e433bae017072baed0851, user_id=eb4b7d1f9d2a4059b95610a42e94c3c7, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:12.072874 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c97bc-ed6c-400c-a077-7b14c6a71982 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:12.268919 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1171/2331] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:00:12 2022] PUT /identity/v3/projects/c7aaae29f47e433bae017072baed0851/users/eb4b7d1f9d2a4059b95610a42e94c3c7/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:00:12.273088 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97431e26-0d44-4f32-a5df-eacc857e84a3 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:12.288842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97431e26-0d44-4f32-a5df-eacc857e84a3 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:12.301191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:12.374131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2224adf-b0c1-45cb-b33c-bd2483591b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:12.374884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2224adf-b0c1-45cb-b33c-bd2483591b6a admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:12.375397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2224adf-b0c1-45cb-b33c-bd2483591b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:12.375825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2224adf-b0c1-45cb-b33c-bd2483591b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:12.376535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2224adf-b0c1-45cb-b33c-bd2483591b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:12.378201 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2224adf-b0c1-45cb-b33c-bd2483591b6a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:12.390383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1161/2332] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:00:12.394447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c97bc-ed6c-400c-a077-7b14c6a71982 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:12.406885 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c97bc-ed6c-400c-a077-7b14c6a71982 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:12.412050 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe40d5-4585-4d3b-b1a0-02bf85429558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:12.412970 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe40d5-4585-4d3b-b1a0-02bf85429558 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:12.413247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe40d5-4585-4d3b-b1a0-02bf85429558 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:12.413514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe40d5-4585-4d3b-b1a0-02bf85429558 admin admin] PATH_INFO: `/v3/projects/c7aaae29f47e433bae017072baed0851/users/eb4b7d1f9d2a4059b95610a42e94c3c7/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:12.415649 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe40d5-4585-4d3b-b1a0-02bf85429558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7aaae29f47e433bae017072baed0851, user_id=eb4b7d1f9d2a4059b95610a42e94c3c7, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:12.418587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe40d5-4585-4d3b-b1a0-02bf85429558 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:12.433943 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1172/2333] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:00:12 2022] PUT /identity/v3/projects/c7aaae29f47e433bae017072baed0851/users/eb4b7d1f9d2a4059b95610a42e94c3c7/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:00:19.032039 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c7734-a413-40f2-8e37-add8f6171357 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:19.032539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c7734-a413-40f2-8e37-add8f6171357 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:19.035151 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c7734-a413-40f2-8e37-add8f6171357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:19.068257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b33c7734-a413-40f2-8e37-add8f6171357 None None] MFA Rules not processed for user `eb4b7d1f9d2a4059b95610a42e94c3c7`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:19.069304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b33c7734-a413-40f2-8e37-add8f6171357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:19.172718 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1162/2334] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:00:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:00:19.186170 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe40d5-4585-4d3b-b1a0-02bf85429558 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:19.188608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-68fe40d5-4585-4d3b-b1a0-02bf85429558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:19.396090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe40d5-4585-4d3b-b1a0-02bf85429558 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:19.415451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b48a-0445-45fe-8f92-cba2dcf532db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e93d0321eaa4936a55390155d5aab0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:19.416123 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b48a-0445-45fe-8f92-cba2dcf532db service glance] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:19.416420 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b48a-0445-45fe-8f92-cba2dcf532db service glance] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:19.416830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b48a-0445-45fe-8f92-cba2dcf532db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:19.511869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6b48a-0445-45fe-8f92-cba2dcf532db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:19.513451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6b48a-0445-45fe-8f92-cba2dcf532db service glance] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:19.524519 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1173/2335] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:00:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:00:19.779691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734cd2e-dd55-462c-ad2f-20d7c9a239d3 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:19.779976 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734cd2e-dd55-462c-ad2f-20d7c9a239d3 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:19.780248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734cd2e-dd55-462c-ad2f-20d7c9a239d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:19.799033 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b734cd2e-dd55-462c-ad2f-20d7c9a239d3 None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:19.800874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b734cd2e-dd55-462c-ad2f-20d7c9a239d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:19.876567 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1163/2336] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Jun 27 15:00:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:00:19.888962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b48a-0445-45fe-8f92-cba2dcf532db service glance] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:19.890986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2eb6b48a-0445-45fe-8f92-cba2dcf532db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:19.925461 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:19.969324 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b48a-0445-45fe-8f92-cba2dcf532db service glance] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:19.974619 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e0a1b-49c2-4ce2-80f4-1a2649ff99a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:19.975279 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e0a1b-49c2-4ce2-80f4-1a2649ff99a9 service swift] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:19.975562 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e0a1b-49c2-4ce2-80f4-1a2649ff99a9 service swift] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:19.975847 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e0a1b-49c2-4ce2-80f4-1a2649ff99a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:19.986099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e0a1b-49c2-4ce2-80f4-1a2649ff99a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:19.987708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e0a1b-49c2-4ce2-80f4-1a2649ff99a9 service swift] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:19.997399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1174/2337] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 15:00:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:00:27.453896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d486cc-f4fe-40d9-b512-236937eb8713 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:27.454866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d486cc-f4fe-40d9-b512-236937eb8713 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:27.455143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d486cc-f4fe-40d9-b512-236937eb8713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:27.518068 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-50d486cc-f4fe-40d9-b512-236937eb8713 None None] MFA Rules not processed for user `27b0e2428571450ea1d5edfd1c3b0f80`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:27.519075 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-50d486cc-f4fe-40d9-b512-236937eb8713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:27.614751 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:27.662313 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1164/2338] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:00:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:00:28.670959 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541735b-c096-4a85-b6a3-55eec0834dee None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:28.671503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541735b-c096-4a85-b6a3-55eec0834dee None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:28.671771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541735b-c096-4a85-b6a3-55eec0834dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:28.694694 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-c541735b-c096-4a85-b6a3-55eec0834dee None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:28.696920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-c541735b-c096-4a85-b6a3-55eec0834dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:28.709450 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1175/2339] 10.222.0.44 () {58 vars in 967 bytes} [Mon Jun 27 15:00:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:00:28.737761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d486cc-f4fe-40d9-b512-236937eb8713 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:28.761551 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d486cc-f4fe-40d9-b512-236937eb8713 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:28.772776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9e0fa-4b8a-487f-908e-bc52704a381b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:28.774267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9e0fa-4b8a-487f-908e-bc52704a381b service swift] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:28.774555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9e0fa-4b8a-487f-908e-bc52704a381b service swift] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:28.774889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9e0fa-4b8a-487f-908e-bc52704a381b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:28.787514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9e0fa-4b8a-487f-908e-bc52704a381b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:28.790085 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9e0fa-4b8a-487f-908e-bc52704a381b service swift] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:28.807396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1165/2340] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 15:00:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:00:33.898126 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ad3d8-f596-4984-a903-1eedc4249d86 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:33.899811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ad3d8-f596-4984-a903-1eedc4249d86 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:33.900096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ad3d8-f596-4984-a903-1eedc4249d86 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:33.901578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1176/2341] 10.222.0.44 () {54 vars in 921 bytes} [Mon Jun 27 15:00:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:00:33.911496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128e9c1-d52c-4d27-9072-44cb143d2147 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:33.920762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128e9c1-d52c-4d27-9072-44cb143d2147 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:33.920762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128e9c1-d52c-4d27-9072-44cb143d2147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:33.965516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-d128e9c1-d52c-4d27-9072-44cb143d2147 None None] MFA Rules not processed for user `f3ced893407a484e8ed0c4918438edf0`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:33.966762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-d128e9c1-d52c-4d27-9072-44cb143d2147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:34.046193 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1166/2342] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Jun 27 15:00:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:00:34.060069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ad3d8-f596-4984-a903-1eedc4249d86 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:34.063171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9c4ad3d8-f596-4984-a903-1eedc4249d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:34.090965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ad3d8-f596-4984-a903-1eedc4249d86 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:34.098101 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1513a2c-5851-4dd3-85a1-06f18551004d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:34.098834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513a2c-5851-4dd3-85a1-06f18551004d service placement] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:34.099119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513a2c-5851-4dd3-85a1-06f18551004d service placement] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:34.099397 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513a2c-5851-4dd3-85a1-06f18551004d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:34.119473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128e9c1-d52c-4d27-9072-44cb143d2147 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:34.120735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1513a2c-5851-4dd3-85a1-06f18551004d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:34.122645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1513a2c-5851-4dd3-85a1-06f18551004d service placement] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:34.156319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1177/2343] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:00:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:00:34.166994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1513a2c-5851-4dd3-85a1-06f18551004d service placement] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:34.170437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f1513a2c-5851-4dd3-85a1-06f18551004d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:34.212474 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128e9c1-d52c-4d27-9072-44cb143d2147 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:34.219138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f0344-e374-4da4-b3db-be05935245be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:34.228853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f0344-e374-4da4-b3db-be05935245be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:34.229315 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f0344-e374-4da4-b3db-be05935245be admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:34.230692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f0344-e374-4da4-b3db-be05935245be admin admin] PATH_INFO: `/v3/users/de1ab057c70d4f3f8f2a4b05e48d7f99` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:34.233542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f0344-e374-4da4-b3db-be05935245be admin admin] RBAC: Authorizing `identity:delete_user(user_id=de1ab057c70d4f3f8f2a4b05e48d7f99)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:34.237437 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f0344-e374-4da4-b3db-be05935245be admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:34.266410 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1513a2c-5851-4dd3-85a1-06f18551004d service placement] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:34.278708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88afbe-9ecc-4f97-a4a3-acf1642374b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:34.279810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88afbe-9ecc-4f97-a4a3-acf1642374b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:34.280689 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88afbe-9ecc-4f97-a4a3-acf1642374b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:34.280689 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88afbe-9ecc-4f97-a4a3-acf1642374b1 admin admin] PATH_INFO: `/v3/users/ef044785763a4bc4be4a1ffd4ea5290f` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:34.285438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88afbe-9ecc-4f97-a4a3-acf1642374b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef044785763a4bc4be4a1ffd4ea5290f)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:34.285438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88afbe-9ecc-4f97-a4a3-acf1642374b1 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:34.455594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3a2f0344-e374-4da4-b3db-be05935245be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de1ab057c70d4f3f8f2a4b05e48d7f99'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:34.461879 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:34.471616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3a2f0344-e374-4da4-b3db-be05935245be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de1ab057c70d4f3f8f2a4b05e48d7f99'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:34.570029 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-da88afbe-9ecc-4f97-a4a3-acf1642374b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef044785763a4bc4be4a1ffd4ea5290f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:34.572699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3a2f0344-e374-4da4-b3db-be05935245be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de1ab057c70d4f3f8f2a4b05e48d7f99'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:34.574116 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3a2f0344-e374-4da4-b3db-be05935245be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de1ab057c70d4f3f8f2a4b05e48d7f99'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:34.589522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3a2f0344-e374-4da4-b3db-be05935245be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de1ab057c70d4f3f8f2a4b05e48d7f99'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:34.596547 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-da88afbe-9ecc-4f97-a4a3-acf1642374b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef044785763a4bc4be4a1ffd4ea5290f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:34.604174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1167/2344] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:00:34 2022] DELETE /identity/v3/users/de1ab057c70d4f3f8f2a4b05e48d7f99 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:00:34.608591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4f256-c161-4b5a-9b4e-7b1ec0e49425 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:34.610626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4f256-c161-4b5a-9b4e-7b1ec0e49425 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:34.610626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4f256-c161-4b5a-9b4e-7b1ec0e49425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:34.630659 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b9d4f256-c161-4b5a-9b4e-7b1ec0e49425 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:34.632326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b9d4f256-c161-4b5a-9b4e-7b1ec0e49425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:34.690026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-da88afbe-9ecc-4f97-a4a3-acf1642374b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef044785763a4bc4be4a1ffd4ea5290f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:34.693773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-da88afbe-9ecc-4f97-a4a3-acf1642374b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef044785763a4bc4be4a1ffd4ea5290f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:34.706441 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-da88afbe-9ecc-4f97-a4a3-acf1642374b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef044785763a4bc4be4a1ffd4ea5290f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:34.717839 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1178/2345] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:00:34 2022] DELETE /identity/v3/users/ef044785763a4bc4be4a1ffd4ea5290f => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:00:34.731456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1168/2346] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:00:34.742479 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88afbe-9ecc-4f97-a4a3-acf1642374b1 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:34.744978 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-da88afbe-9ecc-4f97-a4a3-acf1642374b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:34.785752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:34.831232 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88afbe-9ecc-4f97-a4a3-acf1642374b1 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:34.835675 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba6d59-d25b-42e1-98ba-60e63694477a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:34.836343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba6d59-d25b-42e1-98ba-60e63694477a service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:34.836630 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba6d59-d25b-42e1-98ba-60e63694477a service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:34.836935 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba6d59-d25b-42e1-98ba-60e63694477a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:34.918230 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba6d59-d25b-42e1-98ba-60e63694477a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:34.920304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba6d59-d25b-42e1-98ba-60e63694477a service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:34.932312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1179/2347] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:00:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:00:35.407223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4f256-c161-4b5a-9b4e-7b1ec0e49425 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:35.409076 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b9d4f256-c161-4b5a-9b4e-7b1ec0e49425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:35.424813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4f256-c161-4b5a-9b4e-7b1ec0e49425 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:35.430866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b9e2c-add7-4a00-8738-9fb8eface1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:35.432173 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b9e2c-add7-4a00-8738-9fb8eface1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:35.442769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b9e2c-add7-4a00-8738-9fb8eface1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:35.442769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b9e2c-add7-4a00-8738-9fb8eface1a8 admin admin] PATH_INFO: `/v3/projects/0b79598ec54243258d2f2f589be4940d` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:35.442769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b9e2c-add7-4a00-8738-9fb8eface1a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b79598ec54243258d2f2f589be4940d)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:35.442769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b9e2c-add7-4a00-8738-9fb8eface1a8 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:35.477649 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de1d33-c4b7-42a8-b4f3-e7731fdfc64b None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:35.478011 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de1d33-c4b7-42a8-b4f3-e7731fdfc64b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:35.478301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de1d33-c4b7-42a8-b4f3-e7731fdfc64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:35.519178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a0de1d33-c4b7-42a8-b4f3-e7731fdfc64b None None] MFA Rules not processed for user `e03bcfa7f95d4266ac02a457e14d0c01`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:35.522321 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a0de1d33-c4b7-42a8-b4f3-e7731fdfc64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:35.597097 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1b0b9e2c-add7-4a00-8738-9fb8eface1a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b79598ec54243258d2f2f589be4940d', 'request_id': 'req-1b0b9e2c-add7-4a00-8738-9fb8eface1a8'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:35.633574 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1180/2348] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:00:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:00:35.709607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1b0b9e2c-add7-4a00-8738-9fb8eface1a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b79598ec54243258d2f2f589be4940d', 'request_id': 'req-1b0b9e2c-add7-4a00-8738-9fb8eface1a8'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:35.723701 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1b0b9e2c-add7-4a00-8738-9fb8eface1a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b79598ec54243258d2f2f589be4940d', 'request_id': 'req-1b0b9e2c-add7-4a00-8738-9fb8eface1a8'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:35.739197 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1b0b9e2c-add7-4a00-8738-9fb8eface1a8 admin admin] The token cache is being invalidate because project 0b79598ec54243258d2f2f589be4940d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:00:35.739391 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1b0b9e2c-add7-4a00-8738-9fb8eface1a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:35.741182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1b0b9e2c-add7-4a00-8738-9fb8eface1a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:35.749121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1169/2349] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:00:35 2022] DELETE /identity/v3/projects/0b79598ec54243258d2f2f589be4940d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:00:35.760657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de1d33-c4b7-42a8-b4f3-e7731fdfc64b None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:35.762114 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a0de1d33-c4b7-42a8-b4f3-e7731fdfc64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:35.776969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de1d33-c4b7-42a8-b4f3-e7731fdfc64b None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:35.858299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b361dc6-b7d1-4524-a69a-8edda15e7b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:35.859306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b361dc6-b7d1-4524-a69a-8edda15e7b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:35.859588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b361dc6-b7d1-4524-a69a-8edda15e7b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:35.859861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b361dc6-b7d1-4524-a69a-8edda15e7b55 admin admin] PATH_INFO: `/v3/projects/63f6e59e76d642afaa9db58152919f87` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:35.861211 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b361dc6-b7d1-4524-a69a-8edda15e7b55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f6e59e76d642afaa9db58152919f87)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:35.863817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b361dc6-b7d1-4524-a69a-8edda15e7b55 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:35.878659 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:35.991946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-2b361dc6-b7d1-4524-a69a-8edda15e7b55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f6e59e76d642afaa9db58152919f87', 'request_id': 'req-2b361dc6-b7d1-4524-a69a-8edda15e7b55'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:35.998905 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-2b361dc6-b7d1-4524-a69a-8edda15e7b55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f6e59e76d642afaa9db58152919f87', 'request_id': 'req-2b361dc6-b7d1-4524-a69a-8edda15e7b55'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:36.102182 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-2b361dc6-b7d1-4524-a69a-8edda15e7b55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f6e59e76d642afaa9db58152919f87', 'request_id': 'req-2b361dc6-b7d1-4524-a69a-8edda15e7b55'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:36.118247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-2b361dc6-b7d1-4524-a69a-8edda15e7b55 admin admin] The token cache is being invalidate because project 63f6e59e76d642afaa9db58152919f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:00:36.118247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-2b361dc6-b7d1-4524-a69a-8edda15e7b55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:36.118761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-2b361dc6-b7d1-4524-a69a-8edda15e7b55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:00:36.120593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1181/2350] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:00:35 2022] DELETE /identity/v3/projects/63f6e59e76d642afaa9db58152919f87 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:00:38.912137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee1137-5681-4eed-b9cb-2431d93f0ae3 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:38.913370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee1137-5681-4eed-b9cb-2431d93f0ae3 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:38.913646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee1137-5681-4eed-b9cb-2431d93f0ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:38.931593 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-a4ee1137-5681-4eed-b9cb-2431d93f0ae3 None None] MFA Rules not processed for user `d93abd4361d240919ec85cf4b92347fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:38.932845 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-a4ee1137-5681-4eed-b9cb-2431d93f0ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:38.984921 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:38.993378 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1170/2351] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:00:43.181952 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fcde1-2b7b-4403-844d-00ff79fed5ab None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:43.182864 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fcde1-2b7b-4403-844d-00ff79fed5ab None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:43.183291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fcde1-2b7b-4403-844d-00ff79fed5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:43.212813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-0e7fcde1-2b7b-4403-844d-00ff79fed5ab None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:00:43.214362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-0e7fcde1-2b7b-4403-844d-00ff79fed5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:43.284611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1182/2352] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Jun 27 15:00:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:00:43.296426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee1137-5681-4eed-b9cb-2431d93f0ae3 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:43.297985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-a4ee1137-5681-4eed-b9cb-2431d93f0ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:43.374227 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee1137-5681-4eed-b9cb-2431d93f0ae3 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:43.379171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343ff7d-d586-46f7-b013-32d825b0df5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:43.381733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343ff7d-d586-46f7-b013-32d825b0df5c service swift] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:43.381733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343ff7d-d586-46f7-b013-32d825b0df5c service swift] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:43.381733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343ff7d-d586-46f7-b013-32d825b0df5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:43.389890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343ff7d-d586-46f7-b013-32d825b0df5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:43.391501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343ff7d-d586-46f7-b013-32d825b0df5c service swift] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:43.399586 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1171/2353] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 15:00:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:00:51.635842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fcde1-2b7b-4403-844d-00ff79fed5ab None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:51.637320 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-0e7fcde1-2b7b-4403-844d-00ff79fed5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:51.734723 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fcde1-2b7b-4403-844d-00ff79fed5ab None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:51.742756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88f27f-0607-4722-b42d-dec6d2325471 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:51.742756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88f27f-0607-4722-b42d-dec6d2325471 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:51.742756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88f27f-0607-4722-b42d-dec6d2325471 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:51.742756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88f27f-0607-4722-b42d-dec6d2325471 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:51.744438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-6b88f27f-0607-4722-b42d-dec6d2325471 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:51.756696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88f27f-0607-4722-b42d-dec6d2325471 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:51.776071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88f27f-0607-4722-b42d-dec6d2325471 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:51.776071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1183/2354] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:00:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:00:53.396322 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=33 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:55.402424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343ff7d-d586-46f7-b013-32d825b0df5c service swift] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:55.414777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343ff7d-d586-46f7-b013-32d825b0df5c service swift] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:55.420222 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e531a32-69d4-4c19-a9d1-57c261755e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:55.420881 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531a32-69d4-4c19-a9d1-57c261755e82 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:55.421165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531a32-69d4-4c19-a9d1-57c261755e82 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:55.421440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531a32-69d4-4c19-a9d1-57c261755e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:55.423219 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-9e531a32-69d4-4c19-a9d1-57c261755e82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:55.487643 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e531a32-69d4-4c19-a9d1-57c261755e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:55.489189 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e531a32-69d4-4c19-a9d1-57c261755e82 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:55.508212 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1172/2355] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:00:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:00:59.122437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88f27f-0607-4722-b42d-dec6d2325471 service nova] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:59.123941 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-6b88f27f-0607-4722-b42d-dec6d2325471 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:59.160654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:00:59.184999 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88f27f-0607-4722-b42d-dec6d2325471 service nova] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:59.191691 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b8846-4e6f-4296-acc0-453a8b00cec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:59.192440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b8846-4e6f-4296-acc0-453a8b00cec7 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:59.192816 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b8846-4e6f-4296-acc0-453a8b00cec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:59.193301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b8846-4e6f-4296-acc0-453a8b00cec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:59.196030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-230b8846-4e6f-4296-acc0-453a8b00cec7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:59.210353 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b8846-4e6f-4296-acc0-453a8b00cec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:59.211783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b8846-4e6f-4296-acc0-453a8b00cec7 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:59.223757 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1184/2356] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:00:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:00:59.289905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e531a32-69d4-4c19-a9d1-57c261755e82 service nova] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:00:59.301226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e531a32-69d4-4c19-a9d1-57c261755e82 service nova] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:00:59.307811 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f96bdb-8242-4f21-99cb-92a09cfee802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:00:59.308455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f96bdb-8242-4f21-99cb-92a09cfee802 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:00:59.308801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f96bdb-8242-4f21-99cb-92a09cfee802 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:00:59.309081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f96bdb-8242-4f21-99cb-92a09cfee802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:00:59.310851 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-85f96bdb-8242-4f21-99cb-92a09cfee802 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:00:59.371012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f96bdb-8242-4f21-99cb-92a09cfee802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:00:59.372496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f96bdb-8242-4f21-99cb-92a09cfee802 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:00:59.381360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1173/2357] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:00:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:01:09.377958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=56 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:09.391691 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=12 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:23.073785 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b8846-4e6f-4296-acc0-453a8b00cec7 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:01:23.075230 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-230b8846-4e6f-4296-acc0-453a8b00cec7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:01:23.086034 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b8846-4e6f-4296-acc0-453a8b00cec7 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:01:23.087801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f96bdb-8242-4f21-99cb-92a09cfee802 service nova] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:01:23.089934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418c89e-08ed-4634-bdbf-e45109a04a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:01:23.090587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418c89e-08ed-4634-bdbf-e45109a04a85 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:01:23.090963 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418c89e-08ed-4634-bdbf-e45109a04a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:01:23.091246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418c89e-08ed-4634-bdbf-e45109a04a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:01:23.093310 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-0418c89e-08ed-4634-bdbf-e45109a04a85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:01:23.099808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f96bdb-8242-4f21-99cb-92a09cfee802 service nova] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:01:23.107355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418c89e-08ed-4634-bdbf-e45109a04a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:01:23.108227 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d53735-7a65-4710-89c7-326846a4dfbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:01:23.108839 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418c89e-08ed-4634-bdbf-e45109a04a85 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:01:23.109856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d53735-7a65-4710-89c7-326846a4dfbc service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:01:23.110209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d53735-7a65-4710-89c7-326846a4dfbc service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:01:23.110589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d53735-7a65-4710-89c7-326846a4dfbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:01:23.118994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1185/2358] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:01:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:01:23.120929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d53735-7a65-4710-89c7-326846a4dfbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:01:23.122470 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d53735-7a65-4710-89c7-326846a4dfbc service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:01:23.131305 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1174/2359] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:01:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:01:30.960134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418c89e-08ed-4634-bdbf-e45109a04a85 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:01:30.971593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418c89e-08ed-4634-bdbf-e45109a04a85 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:01:30.977896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e75e9c-086d-4653-a30e-cfa886749a4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:01:30.978541 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75e9c-086d-4653-a30e-cfa886749a4b service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:01:30.978827 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75e9c-086d-4653-a30e-cfa886749a4b service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:01:30.979102 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75e9c-086d-4653-a30e-cfa886749a4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:01:30.981072 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-90e75e9c-086d-4653-a30e-cfa886749a4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:01:30.994920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e75e9c-086d-4653-a30e-cfa886749a4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:01:30.996432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e75e9c-086d-4653-a30e-cfa886749a4b service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:01:31.007171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1186/2360] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:01:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:01:31.059513 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d53735-7a65-4710-89c7-326846a4dfbc service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:01:31.073117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d53735-7a65-4710-89c7-326846a4dfbc service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:01:31.078605 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437242c4-3c3d-4322-a806-c2bf5ea80c48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:01:31.082785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437242c4-3c3d-4322-a806-c2bf5ea80c48 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:01:31.082785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437242c4-3c3d-4322-a806-c2bf5ea80c48 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:01:31.082785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437242c4-3c3d-4322-a806-c2bf5ea80c48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:01:31.082785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-437242c4-3c3d-4322-a806-c2bf5ea80c48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:01:31.098742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437242c4-3c3d-4322-a806-c2bf5ea80c48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:01:31.101100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437242c4-3c3d-4322-a806-c2bf5ea80c48 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:01:31.112741 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1175/2361] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:01:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:01:38.027755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15f9c1-87b1-4013-b6e0-f3625b23ead0 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:01:38.028330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15f9c1-87b1-4013-b6e0-f3625b23ead0 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:01:38.028330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15f9c1-87b1-4013-b6e0-f3625b23ead0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:01:38.052775 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-bc15f9c1-87b1-4013-b6e0-f3625b23ead0 None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:01:38.054219 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-bc15f9c1-87b1-4013-b6e0-f3625b23ead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:01:38.062207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1187/2362] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Jun 27 15:01:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:01:38.085356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437242c4-3c3d-4322-a806-c2bf5ea80c48 service nova] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:01:38.101389 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437242c4-3c3d-4322-a806-c2bf5ea80c48 service nova] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:01:38.106552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382469a-05f7-48f6-a82b-ab6b415fd8c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:01:38.107257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382469a-05f7-48f6-a82b-ab6b415fd8c7 service swift] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:01:38.107482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382469a-05f7-48f6-a82b-ab6b415fd8c7 service swift] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:01:38.107750 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382469a-05f7-48f6-a82b-ab6b415fd8c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:01:38.116348 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382469a-05f7-48f6-a82b-ab6b415fd8c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:01:38.117960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382469a-05f7-48f6-a82b-ab6b415fd8c7 service swift] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:01:38.127405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1176/2363] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 15:01:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:01:39.321259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15f9c1-87b1-4013-b6e0-f3625b23ead0 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:01:39.323522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-bc15f9c1-87b1-4013-b6e0-f3625b23ead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:01:39.418058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15f9c1-87b1-4013-b6e0-f3625b23ead0 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:01:39.423294 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dfe8f-7147-4d50-ae5f-44076e1b893a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:01:39.428842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dfe8f-7147-4d50-ae5f-44076e1b893a service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:01:39.428842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dfe8f-7147-4d50-ae5f-44076e1b893a service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:01:39.428842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dfe8f-7147-4d50-ae5f-44076e1b893a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:01:39.429602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b31dfe8f-7147-4d50-ae5f-44076e1b893a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:01:39.531492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dfe8f-7147-4d50-ae5f-44076e1b893a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:01:39.532987 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dfe8f-7147-4d50-ae5f-44076e1b893a service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:01:39.551485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1188/2364] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:01:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:01:48.126860 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=18 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:49.538617 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=63 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:01:52.108830 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382469a-05f7-48f6-a82b-ab6b415fd8c7 service swift] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:01:52.118059 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382469a-05f7-48f6-a82b-ab6b415fd8c7 service swift] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:01:52.121604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d35b7-546b-4fa6-b15a-3cd7aafed056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:01:52.122230 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d35b7-546b-4fa6-b15a-3cd7aafed056 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:01:52.122507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d35b7-546b-4fa6-b15a-3cd7aafed056 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:01:52.122778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d35b7-546b-4fa6-b15a-3cd7aafed056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:01:52.124496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7f3d35b7-546b-4fa6-b15a-3cd7aafed056 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:01:52.186519 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d35b7-546b-4fa6-b15a-3cd7aafed056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:01:52.187920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d35b7-546b-4fa6-b15a-3cd7aafed056 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:01:52.197344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1177/2365] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:01:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:01:55.791949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dfe8f-7147-4d50-ae5f-44076e1b893a service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:01:55.809912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dfe8f-7147-4d50-ae5f-44076e1b893a service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:01:55.812393 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511961de-b208-41f9-aae4-701f07d45bd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:01:55.813163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511961de-b208-41f9-aae4-701f07d45bd2 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:01:55.813443 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511961de-b208-41f9-aae4-701f07d45bd2 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:01:55.813758 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511961de-b208-41f9-aae4-701f07d45bd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:01:55.815760 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-511961de-b208-41f9-aae4-701f07d45bd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:01:55.828960 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511961de-b208-41f9-aae4-701f07d45bd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:01:55.830628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511961de-b208-41f9-aae4-701f07d45bd2 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:01:55.842678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1189/2366] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:01:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:02:00.195429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d35b7-546b-4fa6-b15a-3cd7aafed056 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:00.203839 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d35b7-546b-4fa6-b15a-3cd7aafed056 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:00.207611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386aa169-9b33-478f-81fd-2cc93f780e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:00.208238 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386aa169-9b33-478f-81fd-2cc93f780e61 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:00.208516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386aa169-9b33-478f-81fd-2cc93f780e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:00.208823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386aa169-9b33-478f-81fd-2cc93f780e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:00.211103 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-386aa169-9b33-478f-81fd-2cc93f780e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:00.220571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386aa169-9b33-478f-81fd-2cc93f780e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:00.221996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386aa169-9b33-478f-81fd-2cc93f780e61 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:00.230232 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1178/2367] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:02:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:02:00.598683 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b274-fb59-4b23-b75a-1d1ddde39e8b None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:00.599235 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b274-fb59-4b23-b75a-1d1ddde39e8b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:00.599235 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b274-fb59-4b23-b75a-1d1ddde39e8b None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:00.600781 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1190/2368] 10.222.0.44 () {54 vars in 921 bytes} [Mon Jun 27 15:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:02:00.606737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426afef0-0c09-4f05-a47d-76cac30b04fa None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:00.607094 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426afef0-0c09-4f05-a47d-76cac30b04fa None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:00.607479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426afef0-0c09-4f05-a47d-76cac30b04fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:00.646296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-426afef0-0c09-4f05-a47d-76cac30b04fa None None] MFA Rules not processed for user `08529776af224c36ab560c13f5941e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:02:00.647589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-426afef0-0c09-4f05-a47d-76cac30b04fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:00.657500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1179/2369] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Jun 27 15:02:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:02:00.672020 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9b274-fb59-4b23-b75a-1d1ddde39e8b None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:00.673867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-c1a9b274-fb59-4b23-b75a-1d1ddde39e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:00.734604 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9b274-fb59-4b23-b75a-1d1ddde39e8b None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:00.738179 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b42d1-2775-4e49-af5c-6dda0c68da5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e93d0321eaa4936a55390155d5aab0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:00.741808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b42d1-2775-4e49-af5c-6dda0c68da5a service glance] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:00.741808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b42d1-2775-4e49-af5c-6dda0c68da5a service glance] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:00.741808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b42d1-2775-4e49-af5c-6dda0c68da5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:00.750360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b42d1-2775-4e49-af5c-6dda0c68da5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:00.751770 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b42d1-2775-4e49-af5c-6dda0c68da5a service glance] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:00.762580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1191/2370] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:02:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:02:00.972548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f2a1b-bb1b-45d6-bb13-0e37a0af11a4 None None] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:00.972880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f2a1b-bb1b-45d6-bb13-0e37a0af11a4 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:00.973159 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f2a1b-bb1b-45d6-bb13-0e37a0af11a4 None None] PATH_INFO: `/` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:00.974541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1180/2371] 10.222.0.44 () {54 vars in 921 bytes} [Mon Jun 27 15:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:02:00.980203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02479028-3b3e-4686-b5c6-e37c7988b16c None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:00.980565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02479028-3b3e-4686-b5c6-e37c7988b16c None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:00.980937 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02479028-3b3e-4686-b5c6-e37c7988b16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:00.999947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-02479028-3b3e-4686-b5c6-e37c7988b16c None None] MFA Rules not processed for user `bdf31d7d8c164809bde0e12b71ecfca0`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:02:01.001200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-02479028-3b3e-4686-b5c6-e37c7988b16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:01.007907 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1192/2372] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Jun 27 15:02:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:02:01.020549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f2a1b-bb1b-45d6-bb13-0e37a0af11a4 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:01.031701 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f2a1b-bb1b-45d6-bb13-0e37a0af11a4 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:01.035254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d58ab2-181d-42bd-9031-e3006bf53640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:01.035882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d58ab2-181d-42bd-9031-e3006bf53640 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:01.036166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d58ab2-181d-42bd-9031-e3006bf53640 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:01.036437 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d58ab2-181d-42bd-9031-e3006bf53640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:01.044671 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d58ab2-181d-42bd-9031-e3006bf53640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:01.046108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d58ab2-181d-42bd-9031-e3006bf53640 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:01.054512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1181/2373] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:02:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:02:01.149316 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31ec7-1df4-4c74-b14b-6b183ac66af2 None None] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:01.149602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31ec7-1df4-4c74-b14b-6b183ac66af2 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:01.149884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31ec7-1df4-4c74-b14b-6b183ac66af2 None None] PATH_INFO: `/` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:01.151261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1193/2374] 10.222.0.44 () {54 vars in 921 bytes} [Mon Jun 27 15:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 15:02:01.156092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b798a-3aa2-45aa-8775-d8af3a90a930 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:01.156404 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b798a-3aa2-45aa-8775-d8af3a90a930 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:01.156707 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b798a-3aa2-45aa-8775-d8af3a90a930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:01.175638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-511b798a-3aa2-45aa-8775-d8af3a90a930 None None] MFA Rules not processed for user `08529776af224c36ab560c13f5941e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:02:01.176854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-511b798a-3aa2-45aa-8775-d8af3a90a930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:01.186511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1182/2375] 10.222.0.44 () {58 vars in 1018 bytes} [Mon Jun 27 15:02:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:02:01.196778 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31ec7-1df4-4c74-b14b-6b183ac66af2 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:01.207601 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31ec7-1df4-4c74-b14b-6b183ac66af2 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:01.211636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c68d2-bce1-4705-bce2-2eacae465259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:01.212261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c68d2-bce1-4705-bce2-2eacae465259 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:01.217280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c68d2-bce1-4705-bce2-2eacae465259 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:01.217280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c68d2-bce1-4705-bce2-2eacae465259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:01.222921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c68d2-bce1-4705-bce2-2eacae465259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:01.224383 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c68d2-bce1-4705-bce2-2eacae465259 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:01.235533 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1194/2376] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:02:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:02:01.301354 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b798a-3aa2-45aa-8775-d8af3a90a930 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:01.302826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-511b798a-3aa2-45aa-8775-d8af3a90a930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:01.371298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b798a-3aa2-45aa-8775-d8af3a90a930 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:01.376376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5e6d8-8242-41e2-9b22-db6d81782696 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:01.377063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e6d8-8242-41e2-9b22-db6d81782696 service placement] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:01.377357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e6d8-8242-41e2-9b22-db6d81782696 service placement] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:01.377664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e6d8-8242-41e2-9b22-db6d81782696 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:01.379443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7de5e6d8-8242-41e2-9b22-db6d81782696 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:01.391245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5e6d8-8242-41e2-9b22-db6d81782696 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:01.392947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5e6d8-8242-41e2-9b22-db6d81782696 service placement] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:01.404046 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1183/2377] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:02:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:02:05.410193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2da38-7f90-41c3-8d4d-0c2695d76e50 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:05.410691 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2da38-7f90-41c3-8d4d-0c2695d76e50 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:05.410785 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2da38-7f90-41c3-8d4d-0c2695d76e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:05.430857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a9d2da38-7f90-41c3-8d4d-0c2695d76e50 None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:02:05.433681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a9d2da38-7f90-41c3-8d4d-0c2695d76e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:05.439684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1195/2378] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Jun 27 15:02:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:02:05.451865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5e6d8-8242-41e2-9b22-db6d81782696 service placement] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:05.463179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5e6d8-8242-41e2-9b22-db6d81782696 service placement] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:05.468332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673c6d-010d-4be3-bf98-14c3436a15cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:05.469095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673c6d-010d-4be3-bf98-14c3436a15cb service swift] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:05.469469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673c6d-010d-4be3-bf98-14c3436a15cb service swift] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:05.469744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673c6d-010d-4be3-bf98-14c3436a15cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:05.479357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b673c6d-010d-4be3-bf98-14c3436a15cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:05.480995 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b673c6d-010d-4be3-bf98-14c3436a15cb service swift] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:05.489427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1184/2379] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 15:02:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:02:08.559991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2da38-7f90-41c3-8d4d-0c2695d76e50 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:08.571112 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2da38-7f90-41c3-8d4d-0c2695d76e50 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:08.575050 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ff106-33ae-4acf-9d61-e6a1fe3896d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:08.575952 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ff106-33ae-4acf-9d61-e6a1fe3896d5 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:08.576236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ff106-33ae-4acf-9d61-e6a1fe3896d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:08.576514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ff106-33ae-4acf-9d61-e6a1fe3896d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:08.578354 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b69ff106-33ae-4acf-9d61-e6a1fe3896d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:08.645742 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ff106-33ae-4acf-9d61-e6a1fe3896d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:08.647158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ff106-33ae-4acf-9d61-e6a1fe3896d5 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:08.657278 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1196/2380] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:02:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:02:09.423912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673c6d-010d-4be3-bf98-14c3436a15cb service swift] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:09.436227 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673c6d-010d-4be3-bf98-14c3436a15cb service swift] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:09.442498 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63452da8-b499-47d5-811e-73e6d85727ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:09.443259 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63452da8-b499-47d5-811e-73e6d85727ee service placement] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:09.443536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63452da8-b499-47d5-811e-73e6d85727ee service placement] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:09.444002 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63452da8-b499-47d5-811e-73e6d85727ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:09.446464 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-63452da8-b499-47d5-811e-73e6d85727ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:09.458657 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63452da8-b499-47d5-811e-73e6d85727ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:09.460420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63452da8-b499-47d5-811e-73e6d85727ee service placement] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:09.470990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1185/2381] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:02:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:02:09.537416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ff106-33ae-4acf-9d61-e6a1fe3896d5 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:09.538990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b69ff106-33ae-4acf-9d61-e6a1fe3896d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:09.552448 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ff106-33ae-4acf-9d61-e6a1fe3896d5 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:09.558102 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bae086-ec21-498c-94e5-d7bdb3182ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:09.559021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bae086-ec21-498c-94e5-d7bdb3182ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:09.559308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bae086-ec21-498c-94e5-d7bdb3182ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:09.559713 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bae086-ec21-498c-94e5-d7bdb3182ae5 admin admin] PATH_INFO: `/v3/users/e7c4678d1aa9425db97adc6cce76e74f` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:09.561222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bae086-ec21-498c-94e5-d7bdb3182ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c4678d1aa9425db97adc6cce76e74f)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:09.563433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bae086-ec21-498c-94e5-d7bdb3182ae5 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:09.725058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-51bae086-ec21-498c-94e5-d7bdb3182ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c4678d1aa9425db97adc6cce76e74f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:09.730014 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:02:09.737781 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-51bae086-ec21-498c-94e5-d7bdb3182ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c4678d1aa9425db97adc6cce76e74f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:09.873818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-51bae086-ec21-498c-94e5-d7bdb3182ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c4678d1aa9425db97adc6cce76e74f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:09.874764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-51bae086-ec21-498c-94e5-d7bdb3182ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c4678d1aa9425db97adc6cce76e74f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:09.885201 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-51bae086-ec21-498c-94e5-d7bdb3182ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c4678d1aa9425db97adc6cce76e74f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:09.909888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1197/2382] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:02:09 2022] DELETE /identity/v3/users/e7c4678d1aa9425db97adc6cce76e74f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:02:10.446307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63452da8-b499-47d5-811e-73e6d85727ee service placement] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:10.459120 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:02:10.464289 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63452da8-b499-47d5-811e-73e6d85727ee service placement] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:10.523887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c34816-12f2-4719-bd19-4cb6f6a02a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:10.524775 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c34816-12f2-4719-bd19-4cb6f6a02a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:10.525062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c34816-12f2-4719-bd19-4cb6f6a02a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:10.525343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c34816-12f2-4719-bd19-4cb6f6a02a4a admin admin] PATH_INFO: `/v3/projects/88f69fa608db4724a066a8dde7efe38a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:10.526748 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c34816-12f2-4719-bd19-4cb6f6a02a4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f69fa608db4724a066a8dde7efe38a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:10.529111 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c34816-12f2-4719-bd19-4cb6f6a02a4a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:10.650874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-29c34816-12f2-4719-bd19-4cb6f6a02a4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f69fa608db4724a066a8dde7efe38a', 'request_id': 'req-29c34816-12f2-4719-bd19-4cb6f6a02a4a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:10.716939 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-29c34816-12f2-4719-bd19-4cb6f6a02a4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f69fa608db4724a066a8dde7efe38a', 'request_id': 'req-29c34816-12f2-4719-bd19-4cb6f6a02a4a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:10.723817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-29c34816-12f2-4719-bd19-4cb6f6a02a4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f69fa608db4724a066a8dde7efe38a', 'request_id': 'req-29c34816-12f2-4719-bd19-4cb6f6a02a4a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:10.734381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-29c34816-12f2-4719-bd19-4cb6f6a02a4a admin admin] The token cache is being invalidate because project 88f69fa608db4724a066a8dde7efe38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:02:10.734666 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-29c34816-12f2-4719-bd19-4cb6f6a02a4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:10.735319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-29c34816-12f2-4719-bd19-4cb6f6a02a4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:10.736923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1186/2383] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:02:10 2022] DELETE /identity/v3/projects/88f69fa608db4724a066a8dde7efe38a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:02:10.742484 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2853758-fd53-49be-aba7-9daa4f593744 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:10.743021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2853758-fd53-49be-aba7-9daa4f593744 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:10.743127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2853758-fd53-49be-aba7-9daa4f593744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:10.762251 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-f2853758-fd53-49be-aba7-9daa4f593744 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:02:10.763475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f2853758-fd53-49be-aba7-9daa4f593744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:10.825276 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1198/2384] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:02:10.832880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc84ad-f0cc-4ecc-86d5-9cd976a95457 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:10.833179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc84ad-f0cc-4ecc-86d5-9cd976a95457 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:10.833465 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc84ad-f0cc-4ecc-86d5-9cd976a95457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:10.852621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-5dcc84ad-f0cc-4ecc-86d5-9cd976a95457 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:02:10.853858 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-5dcc84ad-f0cc-4ecc-86d5-9cd976a95457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:10.861922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1187/2385] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:02:10.866018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2853758-fd53-49be-aba7-9daa4f593744 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:10.876394 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2853758-fd53-49be-aba7-9daa4f593744 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:10.881389 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb78c93-a177-4484-bda9-a0f4cd80e972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:10.882105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb78c93-a177-4484-bda9-a0f4cd80e972 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:10.882374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb78c93-a177-4484-bda9-a0f4cd80e972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:10.882653 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb78c93-a177-4484-bda9-a0f4cd80e972 admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:10.883378 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb78c93-a177-4484-bda9-a0f4cd80e972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:02:10.883682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb78c93-a177-4484-bda9-a0f4cd80e972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:10.885314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb78c93-a177-4484-bda9-a0f4cd80e972 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:10.900202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1199/2386] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:02:10.901552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc84ad-f0cc-4ecc-86d5-9cd976a95457 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:10.916887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc84ad-f0cc-4ecc-86d5-9cd976a95457 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:10.922677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19368ca8-de07-4069-b9ef-5fe759ac783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:10.923489 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19368ca8-de07-4069-b9ef-5fe759ac783b admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:10.923784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19368ca8-de07-4069-b9ef-5fe759ac783b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:10.924064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19368ca8-de07-4069-b9ef-5fe759ac783b admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:10.924801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19368ca8-de07-4069-b9ef-5fe759ac783b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:10.926906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19368ca8-de07-4069-b9ef-5fe759ac783b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:11.049954 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1188/2387] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:02:10 2022] POST /identity/v3/projects => generated 397 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:02:11.054624 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb78c93-a177-4484-bda9-a0f4cd80e972 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:11.065320 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb78c93-a177-4484-bda9-a0f4cd80e972 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:11.137687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f78e05-aa52-427b-940a-1fa0e0bc16e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:11.138451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f78e05-aa52-427b-940a-1fa0e0bc16e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:11.138733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f78e05-aa52-427b-940a-1fa0e0bc16e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:11.139010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f78e05-aa52-427b-940a-1fa0e0bc16e6 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:11.139789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f78e05-aa52-427b-940a-1fa0e0bc16e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:11.141977 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f78e05-aa52-427b-940a-1fa0e0bc16e6 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:11.213080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1200/2388] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:02:11 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:02:11.219676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19368ca8-de07-4069-b9ef-5fe759ac783b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:11.226051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19368ca8-de07-4069-b9ef-5fe759ac783b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:11.231658 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180cfed-cb67-44f3-b28d-dfe0355c0234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:11.232326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180cfed-cb67-44f3-b28d-dfe0355c0234 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:11.233417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180cfed-cb67-44f3-b28d-dfe0355c0234 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:11.233699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180cfed-cb67-44f3-b28d-dfe0355c0234 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:11.234443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180cfed-cb67-44f3-b28d-dfe0355c0234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:11.237237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180cfed-cb67-44f3-b28d-dfe0355c0234 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:11.249163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1189/2389] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:02:11.253433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f78e05-aa52-427b-940a-1fa0e0bc16e6 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:11.268515 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f78e05-aa52-427b-940a-1fa0e0bc16e6 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:11.273496 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80bd97-f32e-40bc-82a3-69459ed9d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:11.274757 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80bd97-f32e-40bc-82a3-69459ed9d5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:11.275117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80bd97-f32e-40bc-82a3-69459ed9d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:11.275510 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80bd97-f32e-40bc-82a3-69459ed9d5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:11.276301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80bd97-f32e-40bc-82a3-69459ed9d5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:11.278283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80bd97-f32e-40bc-82a3-69459ed9d5a1 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:11.294637 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1201/2390] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:02:11.298855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180cfed-cb67-44f3-b28d-dfe0355c0234 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:11.309623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180cfed-cb67-44f3-b28d-dfe0355c0234 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:11.314502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5661e4-d2a1-46ac-a019-0dfad2ae4c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:11.315507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5661e4-d2a1-46ac-a019-0dfad2ae4c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:11.315646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5661e4-d2a1-46ac-a019-0dfad2ae4c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:11.316107 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5661e4-d2a1-46ac-a019-0dfad2ae4c97 admin admin] PATH_INFO: `/v3/projects/f8e464c4f0574ebfb5ab6ed506e8bbab/users/990c1371f8964b0ea1e04d5929cba148/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:11.333439 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5661e4-d2a1-46ac-a019-0dfad2ae4c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e464c4f0574ebfb5ab6ed506e8bbab, user_id=990c1371f8964b0ea1e04d5929cba148, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:11.337556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5661e4-d2a1-46ac-a019-0dfad2ae4c97 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:11.455568 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1190/2391] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:02:11 2022] PUT /identity/v3/projects/f8e464c4f0574ebfb5ab6ed506e8bbab/users/990c1371f8964b0ea1e04d5929cba148/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:02:11.467535 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c30d76-3216-4b5e-9c22-80c101169718 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:11.467877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c30d76-3216-4b5e-9c22-80c101169718 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:11.468163 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c30d76-3216-4b5e-9c22-80c101169718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:11.499154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-02c30d76-3216-4b5e-9c22-80c101169718 None None] MFA Rules not processed for user `990c1371f8964b0ea1e04d5929cba148`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:02:11.500412 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-02c30d76-3216-4b5e-9c22-80c101169718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:11.527729 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:02:11.572934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1202/2392] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:02:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:02:11.585462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5661e4-d2a1-46ac-a019-0dfad2ae4c97 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:11.588275 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-9b5661e4-d2a1-46ac-a019-0dfad2ae4c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:11.619678 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:02:11.652528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5661e4-d2a1-46ac-a019-0dfad2ae4c97 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:11.656380 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b88b1c-7421-4bf8-80ff-1d9adf971d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:11.657215 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b88b1c-7421-4bf8-80ff-1d9adf971d99 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:11.658651 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b88b1c-7421-4bf8-80ff-1d9adf971d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:11.658651 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b88b1c-7421-4bf8-80ff-1d9adf971d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:11.667326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b88b1c-7421-4bf8-80ff-1d9adf971d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:11.668828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b88b1c-7421-4bf8-80ff-1d9adf971d99 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:11.678068 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1191/2393] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:02:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:02:21.613750 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=16 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:02:21.705243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=16 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:02:26.076546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c30d76-3216-4b5e-9c22-80c101169718 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:26.139405 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c30d76-3216-4b5e-9c22-80c101169718 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:26.143915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e37182-8957-45f9-a95c-2695160c7ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:26.144832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e37182-8957-45f9-a95c-2695160c7ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:26.145112 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e37182-8957-45f9-a95c-2695160c7ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:26.145385 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e37182-8957-45f9-a95c-2695160c7ba5 admin admin] PATH_INFO: `/v3/users/990c1371f8964b0ea1e04d5929cba148` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:26.146601 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e37182-8957-45f9-a95c-2695160c7ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=990c1371f8964b0ea1e04d5929cba148)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:26.148510 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e37182-8957-45f9-a95c-2695160c7ba5 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:26.327012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f4e37182-8957-45f9-a95c-2695160c7ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '990c1371f8964b0ea1e04d5929cba148'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:26.338794 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f4e37182-8957-45f9-a95c-2695160c7ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '990c1371f8964b0ea1e04d5929cba148'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:26.402070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f4e37182-8957-45f9-a95c-2695160c7ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '990c1371f8964b0ea1e04d5929cba148'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:26.403578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f4e37182-8957-45f9-a95c-2695160c7ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '990c1371f8964b0ea1e04d5929cba148'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:26.410923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f4e37182-8957-45f9-a95c-2695160c7ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '990c1371f8964b0ea1e04d5929cba148'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:26.416850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1203/2394] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:02:26 2022] DELETE /identity/v3/users/990c1371f8964b0ea1e04d5929cba148 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:02:26.422027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429befba-d387-40ef-b852-b7a21227b092 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:26.422505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429befba-d387-40ef-b852-b7a21227b092 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:26.422615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429befba-d387-40ef-b852-b7a21227b092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:26.439985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-429befba-d387-40ef-b852-b7a21227b092 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:02:26.441252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-429befba-d387-40ef-b852-b7a21227b092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:26.501662 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1192/2395] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:02:26.511402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e37182-8957-45f9-a95c-2695160c7ba5 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:26.513418 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f4e37182-8957-45f9-a95c-2695160c7ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:26.576990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e37182-8957-45f9-a95c-2695160c7ba5 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:26.580833 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078e5d-8816-45c2-bf47-291046a3936b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:26.581435 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078e5d-8816-45c2-bf47-291046a3936b service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:26.581723 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078e5d-8816-45c2-bf47-291046a3936b service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:26.582002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078e5d-8816-45c2-bf47-291046a3936b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:26.592462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64078e5d-8816-45c2-bf47-291046a3936b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:26.593918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64078e5d-8816-45c2-bf47-291046a3936b service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:26.603811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1204/2396] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:02:27.021164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429befba-d387-40ef-b852-b7a21227b092 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:27.022737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-429befba-d387-40ef-b852-b7a21227b092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:27.035367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429befba-d387-40ef-b852-b7a21227b092 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:27.040774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:27.045769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:27.045769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:27.045769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea admin admin] PATH_INFO: `/v3/projects/f8e464c4f0574ebfb5ab6ed506e8bbab` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:27.045769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e464c4f0574ebfb5ab6ed506e8bbab)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:27.045769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:27.187907 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e464c4f0574ebfb5ab6ed506e8bbab', 'request_id': 'req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:27.255654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e464c4f0574ebfb5ab6ed506e8bbab', 'request_id': 'req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:27.262866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e464c4f0574ebfb5ab6ed506e8bbab', 'request_id': 'req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:27.273353 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea admin admin] The token cache is being invalidate because project f8e464c4f0574ebfb5ab6ed506e8bbab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:02:27.273639 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:27.274323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:02:27.275877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1193/2397] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:02:27 2022] DELETE /identity/v3/projects/f8e464c4f0574ebfb5ab6ed506e8bbab => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:02:36.599246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:02:36.670933 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91cfd3-bb8b-4234-82af-d46d2aaba962 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:36.671220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91cfd3-bb8b-4234-82af-d46d2aaba962 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:36.671549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91cfd3-bb8b-4234-82af-d46d2aaba962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:36.690119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-8e91cfd3-bb8b-4234-82af-d46d2aaba962 None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:02:36.691324 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-8e91cfd3-bb8b-4234-82af-d46d2aaba962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:36.746782 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1205/2398] 10.222.0.44 () {58 vars in 967 bytes} [Mon Jun 27 15:02:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:02:36.768394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:02:36.769808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:02:36.838940 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62bad9-fbb2-4286-bfb5-41eebb96b0ea admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:02:36.844181 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b2d1a-d780-4459-a89d-34a9ff738290 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:02:36.844869 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b2d1a-d780-4459-a89d-34a9ff738290 service swift] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:02:36.845153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b2d1a-d780-4459-a89d-34a9ff738290 service swift] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:02:36.845428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b2d1a-d780-4459-a89d-34a9ff738290 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:02:36.853507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b2d1a-d780-4459-a89d-34a9ff738290 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:02:36.855195 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b2d1a-d780-4459-a89d-34a9ff738290 service swift] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:02:36.863147 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1194/2399] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 15:02:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:02:46.739402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=25 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:02:46.859938 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:33.725159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febbe33-2f33-4812-8f32-2b2ea712521e None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:03:33.725728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febbe33-2f33-4812-8f32-2b2ea712521e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:03:33.725728 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febbe33-2f33-4812-8f32-2b2ea712521e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:03:33.744564 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-7febbe33-2f33-4812-8f32-2b2ea712521e None None] MFA Rules not processed for user `d93abd4361d240919ec85cf4b92347fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:03:33.745794 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7febbe33-2f33-4812-8f32-2b2ea712521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:03:33.803891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1206/2400] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:03:37.632956 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b2d1a-d780-4459-a89d-34a9ff738290 service swift] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:03:37.634459 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-563b2d1a-d780-4459-a89d-34a9ff738290 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:03:37.712980 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b2d1a-d780-4459-a89d-34a9ff738290 service swift] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:03:37.718677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49168e-b902-45d9-8de8-e3354304ef2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:03:37.720138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49168e-b902-45d9-8de8-e3354304ef2b service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:03:37.720427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49168e-b902-45d9-8de8-e3354304ef2b service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:03:37.720735 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49168e-b902-45d9-8de8-e3354304ef2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:03:37.722639 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8b49168e-b902-45d9-8de8-e3354304ef2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:03:37.767177 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febbe33-2f33-4812-8f32-2b2ea712521e None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:03:37.768744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7febbe33-2f33-4812-8f32-2b2ea712521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:03:37.804843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49168e-b902-45d9-8de8-e3354304ef2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:03:37.806839 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49168e-b902-45d9-8de8-e3354304ef2b service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:03:37.820831 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1195/2401] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:03:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:03:37.834188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febbe33-2f33-4812-8f32-2b2ea712521e None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:03:37.837833 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c61400-71d1-479a-a71d-0b189968f3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:03:37.838473 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c61400-71d1-479a-a71d-0b189968f3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:03:37.838756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c61400-71d1-479a-a71d-0b189968f3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:03:37.839027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c61400-71d1-479a-a71d-0b189968f3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:03:37.848730 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c61400-71d1-479a-a71d-0b189968f3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:03:37.850085 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c61400-71d1-479a-a71d-0b189968f3b0 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:03:37.859491 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1207/2402] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:03:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:03:47.813465 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=56 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:47.855002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=51 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:48.070879 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5083ab-8ac7-445c-beb2-e417878e9b49 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:03:48.071190 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5083ab-8ac7-445c-beb2-e417878e9b49 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:03:48.071473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5083ab-8ac7-445c-beb2-e417878e9b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:03:48.088766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-3f5083ab-8ac7-445c-beb2-e417878e9b49 None None] MFA Rules not processed for user `27b0e2428571450ea1d5edfd1c3b0f80`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:03:48.089960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-3f5083ab-8ac7-445c-beb2-e417878e9b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:03:48.147354 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1196/2403] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:03:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:03:58.139709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=25 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:03:59.829010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c61400-71d1-479a-a71d-0b189968f3b0 service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:03:59.831288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-85c61400-71d1-479a-a71d-0b189968f3b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:03:59.908071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c61400-71d1-479a-a71d-0b189968f3b0 service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:03:59.913622 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ef6c3-16a4-4f04-b133-9fa2dd9eb6cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:03:59.914394 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ef6c3-16a4-4f04-b133-9fa2dd9eb6cf service placement] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:03:59.914796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ef6c3-16a4-4f04-b133-9fa2dd9eb6cf service placement] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:03:59.915171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ef6c3-16a4-4f04-b133-9fa2dd9eb6cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:03:59.917325 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9d7ef6c3-16a4-4f04-b133-9fa2dd9eb6cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:03:59.932994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ef6c3-16a4-4f04-b133-9fa2dd9eb6cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:03:59.934942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ef6c3-16a4-4f04-b133-9fa2dd9eb6cf service placement] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:03:59.946192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1208/2404] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:03:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:04:03.396495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c8ee5-de2b-4a01-ac81-2e3dfd9d226e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:04:03.397040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c8ee5-de2b-4a01-ac81-2e3dfd9d226e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:04:03.397138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c8ee5-de2b-4a01-ac81-2e3dfd9d226e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:04:03.415167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-0e9c8ee5-de2b-4a01-ac81-2e3dfd9d226e None None] MFA Rules not processed for user `29e7fc2290a641bcb6f1f96501f98d69`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:04:03.416364 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0e9c8ee5-de2b-4a01-ac81-2e3dfd9d226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:04:03.470255 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1197/2405] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:04:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:04:09.941770 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=32 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:04:13.463149 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=25 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:03.898576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4310d1c-ffff-4d47-8160-a4e5b21c24e7 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:03.899142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4310d1c-ffff-4d47-8160-a4e5b21c24e7 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:03.899679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4310d1c-ffff-4d47-8160-a4e5b21c24e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:03.917590 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-e4310d1c-ffff-4d47-8160-a4e5b21c24e7 None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:03.921671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e4310d1c-ffff-4d47-8160-a4e5b21c24e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:03.926404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1209/2406] 10.222.0.44 () {58 vars in 967 bytes} [Mon Jun 27 15:05:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:05:04.064217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c8ee5-de2b-4a01-ac81-2e3dfd9d226e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:04.076753 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c8ee5-de2b-4a01-ac81-2e3dfd9d226e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:04.081743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6cad4-a420-4784-9a90-b42b6f14cb7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:04.082387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6cad4-a420-4784-9a90-b42b6f14cb7d service swift] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:04.082669 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6cad4-a420-4784-9a90-b42b6f14cb7d service swift] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:04.082947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6cad4-a420-4784-9a90-b42b6f14cb7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:04.092144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6cad4-a420-4784-9a90-b42b6f14cb7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:04.093960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6cad4-a420-4784-9a90-b42b6f14cb7d service swift] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:04.102502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1198/2407] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 15:05:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:05:05.044380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4310d1c-ffff-4d47-8160-a4e5b21c24e7 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:05.045878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e4310d1c-ffff-4d47-8160-a4e5b21c24e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:05.105047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4310d1c-ffff-4d47-8160-a4e5b21c24e7 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:05.108769 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1983f-cdb3-4e41-acbe-0808bfc02151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:05.109470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1983f-cdb3-4e41-acbe-0808bfc02151 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:05.109691 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1983f-cdb3-4e41-acbe-0808bfc02151 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:05.109963 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1983f-cdb3-4e41-acbe-0808bfc02151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:05.111757 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-3ea1983f-cdb3-4e41-acbe-0808bfc02151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:05.173018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1983f-cdb3-4e41-acbe-0808bfc02151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:05.174439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1983f-cdb3-4e41-acbe-0808bfc02151 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:05.184088 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1210/2408] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:05:13.320161 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6cad4-a420-4784-9a90-b42b6f14cb7d service swift] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:13.321740 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-33f6cad4-a420-4784-9a90-b42b6f14cb7d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:13.342746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6cad4-a420-4784-9a90-b42b6f14cb7d service swift] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:13.342746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8db66-6487-4b7a-beba-68e097b0a042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:13.343852 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8db66-6487-4b7a-beba-68e097b0a042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:13.344204 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8db66-6487-4b7a-beba-68e097b0a042 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:13.344610 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8db66-6487-4b7a-beba-68e097b0a042 admin admin] PATH_INFO: `/v3/users/e03bcfa7f95d4266ac02a457e14d0c01` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:13.345966 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8db66-6487-4b7a-beba-68e097b0a042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e03bcfa7f95d4266ac02a457e14d0c01)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:13.347988 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8db66-6487-4b7a-beba-68e097b0a042 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:13.524042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5cb8db66-6487-4b7a-beba-68e097b0a042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e03bcfa7f95d4266ac02a457e14d0c01'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:13.536013 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5cb8db66-6487-4b7a-beba-68e097b0a042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e03bcfa7f95d4266ac02a457e14d0c01'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:13.589836 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5cb8db66-6487-4b7a-beba-68e097b0a042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e03bcfa7f95d4266ac02a457e14d0c01'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:13.590455 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5cb8db66-6487-4b7a-beba-68e097b0a042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e03bcfa7f95d4266ac02a457e14d0c01'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:13.597935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5cb8db66-6487-4b7a-beba-68e097b0a042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e03bcfa7f95d4266ac02a457e14d0c01'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:13.604666 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1199/2409] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:05:13 2022] DELETE /identity/v3/users/e03bcfa7f95d4266ac02a457e14d0c01 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:13.831455 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1983f-cdb3-4e41-acbe-0808bfc02151 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:13.842623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1983f-cdb3-4e41-acbe-0808bfc02151 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:13.899486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d760f-dd22-4215-862f-c50c3a2a872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:13.900348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d760f-dd22-4215-862f-c50c3a2a872f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:13.900627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d760f-dd22-4215-862f-c50c3a2a872f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:13.900932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d760f-dd22-4215-862f-c50c3a2a872f admin admin] PATH_INFO: `/v3/projects/51e6f52c6a854f65aaa7f0a3f706c83c` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:13.902115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d760f-dd22-4215-862f-c50c3a2a872f admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e6f52c6a854f65aaa7f0a3f706c83c)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:13.904009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d760f-dd22-4215-862f-c50c3a2a872f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:14.066867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:14.070070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-944d760f-dd22-4215-862f-c50c3a2a872f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e6f52c6a854f65aaa7f0a3f706c83c', 'request_id': 'req-944d760f-dd22-4215-862f-c50c3a2a872f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:14.076344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-944d760f-dd22-4215-862f-c50c3a2a872f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e6f52c6a854f65aaa7f0a3f706c83c', 'request_id': 'req-944d760f-dd22-4215-862f-c50c3a2a872f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:14.155473 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-944d760f-dd22-4215-862f-c50c3a2a872f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e6f52c6a854f65aaa7f0a3f706c83c', 'request_id': 'req-944d760f-dd22-4215-862f-c50c3a2a872f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:14.166571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-944d760f-dd22-4215-862f-c50c3a2a872f admin admin] The token cache is being invalidate because project 51e6f52c6a854f65aaa7f0a3f706c83c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:05:14.166868 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-944d760f-dd22-4215-862f-c50c3a2a872f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:14.167524 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-944d760f-dd22-4215-862f-c50c3a2a872f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:14.169153 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1211/2410] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:05:13 2022] DELETE /identity/v3/projects/51e6f52c6a854f65aaa7f0a3f706c83c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:14.173151 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8db66-6487-4b7a-beba-68e097b0a042 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:14.174540 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-5cb8db66-6487-4b7a-beba-68e097b0a042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:14.187789 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8db66-6487-4b7a-beba-68e097b0a042 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:14.244340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c69b7-e217-423a-876c-5486b1e1c0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:14.245241 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c69b7-e217-423a-876c-5486b1e1c0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:14.245527 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c69b7-e217-423a-876c-5486b1e1c0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:14.245806 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c69b7-e217-423a-876c-5486b1e1c0a5 admin admin] PATH_INFO: `/v3/users/eb4b7d1f9d2a4059b95610a42e94c3c7` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:14.247008 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c69b7-e217-423a-876c-5486b1e1c0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb4b7d1f9d2a4059b95610a42e94c3c7)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:14.248948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c69b7-e217-423a-876c-5486b1e1c0a5 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:14.398936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-cd1c69b7-e217-423a-876c-5486b1e1c0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb4b7d1f9d2a4059b95610a42e94c3c7'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:14.410066 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:14.412115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-cd1c69b7-e217-423a-876c-5486b1e1c0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb4b7d1f9d2a4059b95610a42e94c3c7'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:14.452444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-cd1c69b7-e217-423a-876c-5486b1e1c0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb4b7d1f9d2a4059b95610a42e94c3c7'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:14.453227 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-cd1c69b7-e217-423a-876c-5486b1e1c0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb4b7d1f9d2a4059b95610a42e94c3c7'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:14.461171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-cd1c69b7-e217-423a-876c-5486b1e1c0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb4b7d1f9d2a4059b95610a42e94c3c7'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:14.467221 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1200/2411] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:05:14 2022] DELETE /identity/v3/users/eb4b7d1f9d2a4059b95610a42e94c3c7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:14.700590 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d760f-dd22-4215-862f-c50c3a2a872f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:14.701884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-944d760f-dd22-4215-862f-c50c3a2a872f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:14.719319 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d760f-dd22-4215-862f-c50c3a2a872f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:14.787883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972148ad-197b-4af3-8b3a-5c84c97094c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:14.789029 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972148ad-197b-4af3-8b3a-5c84c97094c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:14.789379 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972148ad-197b-4af3-8b3a-5c84c97094c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:14.789660 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972148ad-197b-4af3-8b3a-5c84c97094c4 admin admin] PATH_INFO: `/v3/projects/c7aaae29f47e433bae017072baed0851` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:14.790890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972148ad-197b-4af3-8b3a-5c84c97094c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7aaae29f47e433bae017072baed0851)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:14.794911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972148ad-197b-4af3-8b3a-5c84c97094c4 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:14.886857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-972148ad-197b-4af3-8b3a-5c84c97094c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7aaae29f47e433bae017072baed0851', 'request_id': 'req-972148ad-197b-4af3-8b3a-5c84c97094c4'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:14.892988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-972148ad-197b-4af3-8b3a-5c84c97094c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7aaae29f47e433bae017072baed0851', 'request_id': 'req-972148ad-197b-4af3-8b3a-5c84c97094c4'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:14.984209 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-972148ad-197b-4af3-8b3a-5c84c97094c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7aaae29f47e433bae017072baed0851', 'request_id': 'req-972148ad-197b-4af3-8b3a-5c84c97094c4'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:14.996505 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-972148ad-197b-4af3-8b3a-5c84c97094c4 admin admin] The token cache is being invalidate because project c7aaae29f47e433bae017072baed0851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:05:14.996820 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-972148ad-197b-4af3-8b3a-5c84c97094c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:14.997439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-972148ad-197b-4af3-8b3a-5c84c97094c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:14.999025 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1212/2412] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:05:14 2022] DELETE /identity/v3/projects/c7aaae29f47e433bae017072baed0851 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:15.003929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaf2ea-d2f9-470f-8084-89a3444d3c36 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:15.004221 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaf2ea-d2f9-470f-8084-89a3444d3c36 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:15.009352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaf2ea-d2f9-470f-8084-89a3444d3c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:15.029684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-0aeaf2ea-d2f9-470f-8084-89a3444d3c36 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:15.030910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0aeaf2ea-d2f9-470f-8084-89a3444d3c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:15.099823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1201/2413] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:05:15.107949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fb742-35eb-400c-aef8-5504e3fe2882 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:15.109135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fb742-35eb-400c-aef8-5504e3fe2882 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:15.109418 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fb742-35eb-400c-aef8-5504e3fe2882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:15.129325 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a09fb742-35eb-400c-aef8-5504e3fe2882 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:15.130522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a09fb742-35eb-400c-aef8-5504e3fe2882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:15.139222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1213/2414] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:05:15.143665 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaf2ea-d2f9-470f-8084-89a3444d3c36 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:15.154328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaf2ea-d2f9-470f-8084-89a3444d3c36 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:15.158842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf8779-dec7-47a1-8f09-f448a7452782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:15.159477 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf8779-dec7-47a1-8f09-f448a7452782 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:15.159756 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf8779-dec7-47a1-8f09-f448a7452782 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:15.160027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf8779-dec7-47a1-8f09-f448a7452782 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:15.160776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf8779-dec7-47a1-8f09-f448a7452782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:05:15.161078 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf8779-dec7-47a1-8f09-f448a7452782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:15.162657 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf8779-dec7-47a1-8f09-f448a7452782 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:15.174237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1202/2415] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:05:15.178506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fb742-35eb-400c-aef8-5504e3fe2882 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:15.188313 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fb742-35eb-400c-aef8-5504e3fe2882 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:15.192940 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b101b-55c6-4c9b-a45b-7a54fefe63e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:15.193580 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b101b-55c6-4c9b-a45b-7a54fefe63e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:15.193862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b101b-55c6-4c9b-a45b-7a54fefe63e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:15.194808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b101b-55c6-4c9b-a45b-7a54fefe63e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:15.195508 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b101b-55c6-4c9b-a45b-7a54fefe63e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:15.197426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b101b-55c6-4c9b-a45b-7a54fefe63e6 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:15.324067 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1214/2416] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:05:15 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:05:15.328474 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf8779-dec7-47a1-8f09-f448a7452782 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:15.338638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf8779-dec7-47a1-8f09-f448a7452782 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:15.395880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079fd70-1fd2-44c7-9765-1f064591e8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:15.396576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079fd70-1fd2-44c7-9765-1f064591e8fa admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:15.396890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079fd70-1fd2-44c7-9765-1f064591e8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:15.397199 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079fd70-1fd2-44c7-9765-1f064591e8fa admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:15.397904 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079fd70-1fd2-44c7-9765-1f064591e8fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:15.399801 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079fd70-1fd2-44c7-9765-1f064591e8fa admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:15.469599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1203/2417] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:05:15 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:05:15.473654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b101b-55c6-4c9b-a45b-7a54fefe63e6 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:15.484665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b101b-55c6-4c9b-a45b-7a54fefe63e6 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:15.490053 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f69d6-2a4b-423f-b247-30fdf8749a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:15.490708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f69d6-2a4b-423f-b247-30fdf8749a39 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:15.491686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f69d6-2a4b-423f-b247-30fdf8749a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:15.491983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f69d6-2a4b-423f-b247-30fdf8749a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:15.492741 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f69d6-2a4b-423f-b247-30fdf8749a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:15.494475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f69d6-2a4b-423f-b247-30fdf8749a39 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:15.504991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1215/2418] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:05:15.509518 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079fd70-1fd2-44c7-9765-1f064591e8fa admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:15.519746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079fd70-1fd2-44c7-9765-1f064591e8fa admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:15.525199 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d5d43-05f2-4716-9940-fc68e132e6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:15.528376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d5d43-05f2-4716-9940-fc68e132e6ab admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:15.528376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d5d43-05f2-4716-9940-fc68e132e6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:15.528376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d5d43-05f2-4716-9940-fc68e132e6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:15.528376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d5d43-05f2-4716-9940-fc68e132e6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:15.528848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d5d43-05f2-4716-9940-fc68e132e6ab admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:15.539502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1204/2419] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:05:15.543560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f69d6-2a4b-423f-b247-30fdf8749a39 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:15.553906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f69d6-2a4b-423f-b247-30fdf8749a39 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:15.558790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242805ba-3da4-4dd0-bb14-56dfbb85a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:15.562811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242805ba-3da4-4dd0-bb14-56dfbb85a60e admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:15.562811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242805ba-3da4-4dd0-bb14-56dfbb85a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:15.562811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242805ba-3da4-4dd0-bb14-56dfbb85a60e admin admin] PATH_INFO: `/v3/projects/2bba2dfe000d427b9ab9dff2601436f1/users/e6357e83df904ea09221cfc374d776c4/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:15.575112 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242805ba-3da4-4dd0-bb14-56dfbb85a60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bba2dfe000d427b9ab9dff2601436f1, user_id=e6357e83df904ea09221cfc374d776c4, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:15.577817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242805ba-3da4-4dd0-bb14-56dfbb85a60e admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:15.666584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:15.671587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1216/2420] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:05:15 2022] PUT /identity/v3/projects/2bba2dfe000d427b9ab9dff2601436f1/users/e6357e83df904ea09221cfc374d776c4/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:05:15.676913 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d8dc-7f1d-4bb9-bd3b-2b44922436a1 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:15.680713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d8dc-7f1d-4bb9-bd3b-2b44922436a1 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:15.680713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d8dc-7f1d-4bb9-bd3b-2b44922436a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:15.696888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-0937d8dc-7f1d-4bb9-bd3b-2b44922436a1 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:15.698177 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0937d8dc-7f1d-4bb9-bd3b-2b44922436a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:15.737716 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:15.756930 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1205/2421] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:05:15.766457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242805ba-3da4-4dd0-bb14-56dfbb85a60e admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:15.768144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-242805ba-3da4-4dd0-bb14-56dfbb85a60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:15.824862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242805ba-3da4-4dd0-bb14-56dfbb85a60e admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:15.828686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c21d4-40a3-4c6b-b00a-6f79e06eeec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:15.829338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c21d4-40a3-4c6b-b00a-6f79e06eeec6 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:15.829883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c21d4-40a3-4c6b-b00a-6f79e06eeec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:15.830542 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c21d4-40a3-4c6b-b00a-6f79e06eeec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:15.839988 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c21d4-40a3-4c6b-b00a-6f79e06eeec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:15.841445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c21d4-40a3-4c6b-b00a-6f79e06eeec6 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:15.851285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1217/2422] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:05:21.631887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8615f-2d44-42fa-a535-ce0d5f6a06bd None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:21.632593 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8615f-2d44-42fa-a535-ce0d5f6a06bd None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:21.632593 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8615f-2d44-42fa-a535-ce0d5f6a06bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:21.660082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-71c8615f-2d44-42fa-a535-ce0d5f6a06bd None None] MFA Rules not processed for user `e6357e83df904ea09221cfc374d776c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:21.661346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-71c8615f-2d44-42fa-a535-ce0d5f6a06bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:21.728964 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1206/2423] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:05:21.733657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c21d4-40a3-4c6b-b00a-6f79e06eeec6 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:21.743455 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c21d4-40a3-4c6b-b00a-6f79e06eeec6 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:21.748852 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db441c6-413c-494f-b33c-b8a6dda292fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:21.749500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db441c6-413c-494f-b33c-b8a6dda292fc admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:21.749785 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db441c6-413c-494f-b33c-b8a6dda292fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:21.750059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db441c6-413c-494f-b33c-b8a6dda292fc admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:21.750855 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db441c6-413c-494f-b33c-b8a6dda292fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:21.752829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db441c6-413c-494f-b33c-b8a6dda292fc admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:21.825625 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1218/2424] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:05:21 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:05:21.829729 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8615f-2d44-42fa-a535-ce0d5f6a06bd None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:21.841688 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8615f-2d44-42fa-a535-ce0d5f6a06bd None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:21.900715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f21b7-0890-4cfd-b7c9-58c73a33f43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:21.901380 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f21b7-0890-4cfd-b7c9-58c73a33f43c admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:21.901660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f21b7-0890-4cfd-b7c9-58c73a33f43c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:21.901938 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f21b7-0890-4cfd-b7c9-58c73a33f43c admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:21.902632 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f21b7-0890-4cfd-b7c9-58c73a33f43c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:21.904855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f21b7-0890-4cfd-b7c9-58c73a33f43c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:22.009885 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1207/2425] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:05:21 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:05:22.011323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db441c6-413c-494f-b33c-b8a6dda292fc admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:22.022641 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db441c6-413c-494f-b33c-b8a6dda292fc admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:22.027501 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5544e19-3d4a-4d1a-be4a-c927d8b344bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:22.028175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5544e19-3d4a-4d1a-be4a-c927d8b344bc admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:22.028462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5544e19-3d4a-4d1a-be4a-c927d8b344bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:22.028792 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5544e19-3d4a-4d1a-be4a-c927d8b344bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:22.029528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5544e19-3d4a-4d1a-be4a-c927d8b344bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:22.031136 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5544e19-3d4a-4d1a-be4a-c927d8b344bc admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:22.043856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1219/2426] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:05:22.048209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f21b7-0890-4cfd-b7c9-58c73a33f43c admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:22.059459 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f21b7-0890-4cfd-b7c9-58c73a33f43c admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:22.064132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ff240-5c43-4772-bced-15bef616527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:22.067464 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff240-5c43-4772-bced-15bef616527f admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:22.067464 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff240-5c43-4772-bced-15bef616527f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:22.067464 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff240-5c43-4772-bced-15bef616527f admin admin] PATH_INFO: `/v3/projects/c18eff6a350c4ae898fca69a92227024/users/42f7b953d44a41208339e3d1a9dd6efb/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:22.080442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ff240-5c43-4772-bced-15bef616527f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18eff6a350c4ae898fca69a92227024, user_id=42f7b953d44a41208339e3d1a9dd6efb, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:22.083166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ff240-5c43-4772-bced-15bef616527f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:22.159643 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1208/2427] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:05:22 2022] PUT /identity/v3/projects/c18eff6a350c4ae898fca69a92227024/users/42f7b953d44a41208339e3d1a9dd6efb/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:22.161012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5544e19-3d4a-4d1a-be4a-c927d8b344bc admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:22.172392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5544e19-3d4a-4d1a-be4a-c927d8b344bc admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:22.232350 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe8db0-52b9-458a-8623-070ad551b255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:22.233057 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe8db0-52b9-458a-8623-070ad551b255 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:22.233341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe8db0-52b9-458a-8623-070ad551b255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:22.233616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe8db0-52b9-458a-8623-070ad551b255 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:22.234344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe8db0-52b9-458a-8623-070ad551b255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:22.235991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe8db0-52b9-458a-8623-070ad551b255 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:22.247498 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1220/2428] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:05:22.251653 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ff240-5c43-4772-bced-15bef616527f admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:22.262240 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ff240-5c43-4772-bced-15bef616527f admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:22.266803 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0eb03-a1d7-4049-b292-2a79ecff486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:22.267670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0eb03-a1d7-4049-b292-2a79ecff486f admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:22.267955 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0eb03-a1d7-4049-b292-2a79ecff486f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:22.268244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0eb03-a1d7-4049-b292-2a79ecff486f admin admin] PATH_INFO: `/v3/projects/c18eff6a350c4ae898fca69a92227024/users/42f7b953d44a41208339e3d1a9dd6efb/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:22.270232 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0eb03-a1d7-4049-b292-2a79ecff486f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18eff6a350c4ae898fca69a92227024, user_id=42f7b953d44a41208339e3d1a9dd6efb, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:22.276145 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0eb03-a1d7-4049-b292-2a79ecff486f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:22.283788 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1209/2429] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:05:22 2022] PUT /identity/v3/projects/c18eff6a350c4ae898fca69a92227024/users/42f7b953d44a41208339e3d1a9dd6efb/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:25.346998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe8db0-52b9-458a-8623-070ad551b255 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:25.443260 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe8db0-52b9-458a-8623-070ad551b255 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:25.474528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:25.533390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d18f0-d34c-4a72-9158-e7b0b124105c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:25.534182 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d18f0-d34c-4a72-9158-e7b0b124105c service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:25.534559 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d18f0-d34c-4a72-9158-e7b0b124105c service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:25.535148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d18f0-d34c-4a72-9158-e7b0b124105c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:25.539877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-394d18f0-d34c-4a72-9158-e7b0b124105c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:25.677521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d18f0-d34c-4a72-9158-e7b0b124105c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:25.679908 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d18f0-d34c-4a72-9158-e7b0b124105c service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:25.704793 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1221/2430] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:05:28.833046 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b43751-230c-4fd6-b65b-e8b718c92675 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:28.834137 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b43751-230c-4fd6-b65b-e8b718c92675 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:28.835086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b43751-230c-4fd6-b65b-e8b718c92675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:28.867605 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-d0b43751-230c-4fd6-b65b-e8b718c92675 None None] MFA Rules not processed for user `42f7b953d44a41208339e3d1a9dd6efb`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:28.868905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-d0b43751-230c-4fd6-b65b-e8b718c92675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:28.886199 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:28.953645 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1210/2431] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:05:28.968841 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d18f0-d34c-4a72-9158-e7b0b124105c service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:28.972129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-394d18f0-d34c-4a72-9158-e7b0b124105c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:29.053071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d18f0-d34c-4a72-9158-e7b0b124105c service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:29.070525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd3da9-85a6-43bc-9082-ae834171f77c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:29.071431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd3da9-85a6-43bc-9082-ae834171f77c service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:29.075421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd3da9-85a6-43bc-9082-ae834171f77c service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:29.075421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd3da9-85a6-43bc-9082-ae834171f77c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:29.167573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd3da9-85a6-43bc-9082-ae834171f77c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:29.169428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd3da9-85a6-43bc-9082-ae834171f77c service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:29.193148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1222/2432] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:05:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:05:30.567903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b43751-230c-4fd6-b65b-e8b718c92675 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:30.569512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-d0b43751-230c-4fd6-b65b-e8b718c92675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:30.597165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b43751-230c-4fd6-b65b-e8b718c92675 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:30.602462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ede2c-0145-4dda-adb0-d440f91c4e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:30.603360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ede2c-0145-4dda-adb0-d440f91c4e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:30.603787 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ede2c-0145-4dda-adb0-d440f91c4e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:30.604067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ede2c-0145-4dda-adb0-d440f91c4e8b admin admin] PATH_INFO: `/v3/users/27b0e2428571450ea1d5edfd1c3b0f80` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:30.606182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ede2c-0145-4dda-adb0-d440f91c4e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b0e2428571450ea1d5edfd1c3b0f80)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:30.609780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ede2c-0145-4dda-adb0-d440f91c4e8b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:30.849776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-2c2ede2c-0145-4dda-adb0-d440f91c4e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b0e2428571450ea1d5edfd1c3b0f80'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:30.862063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-2c2ede2c-0145-4dda-adb0-d440f91c4e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b0e2428571450ea1d5edfd1c3b0f80'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:30.989683 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-2c2ede2c-0145-4dda-adb0-d440f91c4e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b0e2428571450ea1d5edfd1c3b0f80'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:30.991651 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-2c2ede2c-0145-4dda-adb0-d440f91c4e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b0e2428571450ea1d5edfd1c3b0f80'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:31.001713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-2c2ede2c-0145-4dda-adb0-d440f91c4e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b0e2428571450ea1d5edfd1c3b0f80'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:31.009505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1211/2433] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:05:30 2022] DELETE /identity/v3/users/27b0e2428571450ea1d5edfd1c3b0f80 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:31.300076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd3da9-85a6-43bc-9082-ae834171f77c service nova] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:31.321810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd3da9-85a6-43bc-9082-ae834171f77c service nova] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:31.341131 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:31.428335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650ac64-c7a9-45c1-a346-a79b33ba4b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:31.435889 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650ac64-c7a9-45c1-a346-a79b33ba4b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:31.436495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650ac64-c7a9-45c1-a346-a79b33ba4b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:31.436955 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650ac64-c7a9-45c1-a346-a79b33ba4b6e admin admin] PATH_INFO: `/v3/projects/c73553ee127a469b9cad0eda54e8c4a2` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:31.438635 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650ac64-c7a9-45c1-a346-a79b33ba4b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73553ee127a469b9cad0eda54e8c4a2)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:31.441351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650ac64-c7a9-45c1-a346-a79b33ba4b6e admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:31.605643 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3650ac64-c7a9-45c1-a346-a79b33ba4b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73553ee127a469b9cad0eda54e8c4a2', 'request_id': 'req-3650ac64-c7a9-45c1-a346-a79b33ba4b6e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:31.618037 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3650ac64-c7a9-45c1-a346-a79b33ba4b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73553ee127a469b9cad0eda54e8c4a2', 'request_id': 'req-3650ac64-c7a9-45c1-a346-a79b33ba4b6e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:31.687830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3650ac64-c7a9-45c1-a346-a79b33ba4b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73553ee127a469b9cad0eda54e8c4a2', 'request_id': 'req-3650ac64-c7a9-45c1-a346-a79b33ba4b6e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:31.721525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3650ac64-c7a9-45c1-a346-a79b33ba4b6e admin admin] The token cache is being invalidate because project c73553ee127a469b9cad0eda54e8c4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:05:31.724896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3650ac64-c7a9-45c1-a346-a79b33ba4b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:31.726018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3650ac64-c7a9-45c1-a346-a79b33ba4b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:31.731687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1223/2434] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:05:31 2022] DELETE /identity/v3/projects/c73553ee127a469b9cad0eda54e8c4a2 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:31.733490 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61e49-1965-49b0-8af1-441ba62b2c68 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:31.733980 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61e49-1965-49b0-8af1-441ba62b2c68 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:31.734078 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61e49-1965-49b0-8af1-441ba62b2c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:31.757875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-55e61e49-1965-49b0-8af1-441ba62b2c68 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:31.759107 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-55e61e49-1965-49b0-8af1-441ba62b2c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:31.891844 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1212/2435] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:05:31.894627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309b97-b5ed-4659-8071-f68aea34701b None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:31.894918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309b97-b5ed-4659-8071-f68aea34701b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:31.895711 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309b97-b5ed-4659-8071-f68aea34701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:31.915736 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-9b309b97-b5ed-4659-8071-f68aea34701b None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:31.917023 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9b309b97-b5ed-4659-8071-f68aea34701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:31.925702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1224/2436] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:05:31.930141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e61e49-1965-49b0-8af1-441ba62b2c68 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:31.945823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e61e49-1965-49b0-8af1-441ba62b2c68 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:31.951052 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e123c-d374-42f2-b7de-bf71b8a1a452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:31.951860 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e123c-d374-42f2-b7de-bf71b8a1a452 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:31.952243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e123c-d374-42f2-b7de-bf71b8a1a452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:31.952606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e123c-d374-42f2-b7de-bf71b8a1a452 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:31.953605 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e123c-d374-42f2-b7de-bf71b8a1a452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:05:31.954158 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e123c-d374-42f2-b7de-bf71b8a1a452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:31.956074 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e123c-d374-42f2-b7de-bf71b8a1a452 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:31.976142 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1213/2437] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:05:31.980529 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b309b97-b5ed-4659-8071-f68aea34701b None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:31.989891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b309b97-b5ed-4659-8071-f68aea34701b None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:31.995890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753d596-7e5e-4080-a530-f23e2165bcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:31.995890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753d596-7e5e-4080-a530-f23e2165bcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:31.996355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753d596-7e5e-4080-a530-f23e2165bcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:31.996829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753d596-7e5e-4080-a530-f23e2165bcc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:31.997599 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753d596-7e5e-4080-a530-f23e2165bcc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:31.999928 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753d596-7e5e-4080-a530-f23e2165bcc7 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:32.107328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1225/2438] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:05:31 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:05:32.111158 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e123c-d374-42f2-b7de-bf71b8a1a452 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:32.122176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e123c-d374-42f2-b7de-bf71b8a1a452 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:32.133155 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:32.192397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf969ba-e854-4b54-a74d-b64ad84f8bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:32.195181 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf969ba-e854-4b54-a74d-b64ad84f8bac admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:32.195748 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf969ba-e854-4b54-a74d-b64ad84f8bac admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:32.196190 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf969ba-e854-4b54-a74d-b64ad84f8bac admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:32.197160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf969ba-e854-4b54-a74d-b64ad84f8bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:32.199211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf969ba-e854-4b54-a74d-b64ad84f8bac admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:32.271195 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1214/2439] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:05:32 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:05:32.276121 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753d596-7e5e-4080-a530-f23e2165bcc7 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:32.287144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753d596-7e5e-4080-a530-f23e2165bcc7 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:32.293012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5b565-ce7a-44b5-a7f4-93f3fce8d2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:32.293841 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5b565-ce7a-44b5-a7f4-93f3fce8d2ec admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:32.294011 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5b565-ce7a-44b5-a7f4-93f3fce8d2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:32.294315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5b565-ce7a-44b5-a7f4-93f3fce8d2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:32.295088 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5b565-ce7a-44b5-a7f4-93f3fce8d2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:32.296630 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5b565-ce7a-44b5-a7f4-93f3fce8d2ec admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:32.310480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1226/2440] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:05:32.319516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf969ba-e854-4b54-a74d-b64ad84f8bac admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:32.332461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf969ba-e854-4b54-a74d-b64ad84f8bac admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:32.337928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b8068-f09f-4465-b699-8ef99add19d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:32.338600 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b8068-f09f-4465-b699-8ef99add19d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:32.338884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b8068-f09f-4465-b699-8ef99add19d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:32.339158 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b8068-f09f-4465-b699-8ef99add19d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:32.339897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b8068-f09f-4465-b699-8ef99add19d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:32.341621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b8068-f09f-4465-b699-8ef99add19d2 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:32.353508 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1215/2441] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:05:32.357394 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5b565-ce7a-44b5-a7f4-93f3fce8d2ec admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:32.368240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5b565-ce7a-44b5-a7f4-93f3fce8d2ec admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:32.379284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812870d-c9eb-4814-bf4d-c3039d5c9d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:32.380583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812870d-c9eb-4814-bf4d-c3039d5c9d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:32.381685 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812870d-c9eb-4814-bf4d-c3039d5c9d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:32.382058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812870d-c9eb-4814-bf4d-c3039d5c9d43 admin admin] PATH_INFO: `/v3/projects/6846f495d288493a974434927c584949/users/bc7b5bd6b3154ea89e96d5e68f17fda8/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:32.407774 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812870d-c9eb-4814-bf4d-c3039d5c9d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6846f495d288493a974434927c584949, user_id=bc7b5bd6b3154ea89e96d5e68f17fda8, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:32.410818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812870d-c9eb-4814-bf4d-c3039d5c9d43 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:32.497043 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1227/2442] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:05:32 2022] PUT /identity/v3/projects/6846f495d288493a974434927c584949/users/bc7b5bd6b3154ea89e96d5e68f17fda8/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:32.498810 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cd2d7-4b5f-4fed-a80f-30c07c0c3bc0 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:32.499256 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cd2d7-4b5f-4fed-a80f-30c07c0c3bc0 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:32.499603 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cd2d7-4b5f-4fed-a80f-30c07c0c3bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:32.529950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-ad3cd2d7-4b5f-4fed-a80f-30c07c0c3bc0 None None] MFA Rules not processed for user `bc7b5bd6b3154ea89e96d5e68f17fda8`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:32.531165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ad3cd2d7-4b5f-4fed-a80f-30c07c0c3bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:32.604528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1216/2443] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:05:32.616612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812870d-c9eb-4814-bf4d-c3039d5c9d43 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:32.618647 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9812870d-c9eb-4814-bf4d-c3039d5c9d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:32.664930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:32.703622 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812870d-c9eb-4814-bf4d-c3039d5c9d43 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:32.709599 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bea134-0e23-43fb-b95b-faf64acd2880 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:32.710291 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bea134-0e23-43fb-b95b-faf64acd2880 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:32.710574 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bea134-0e23-43fb-b95b-faf64acd2880 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:32.710849 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bea134-0e23-43fb-b95b-faf64acd2880 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:32.721417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bea134-0e23-43fb-b95b-faf64acd2880 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:32.723122 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bea134-0e23-43fb-b95b-faf64acd2880 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:32.733115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1228/2444] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:05:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:05:33.020440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cd2d7-4b5f-4fed-a80f-30c07c0c3bc0 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:33.127199 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cd2d7-4b5f-4fed-a80f-30c07c0c3bc0 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:33.134348 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcca9ae-1963-4dbf-b3e3-bcdaa4f8fa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:33.135985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcca9ae-1963-4dbf-b3e3-bcdaa4f8fa6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:33.136333 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcca9ae-1963-4dbf-b3e3-bcdaa4f8fa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:33.136701 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcca9ae-1963-4dbf-b3e3-bcdaa4f8fa6e admin admin] PATH_INFO: `/v3/users/bc7b5bd6b3154ea89e96d5e68f17fda8` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:33.138385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcca9ae-1963-4dbf-b3e3-bcdaa4f8fa6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7b5bd6b3154ea89e96d5e68f17fda8)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:33.140414 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcca9ae-1963-4dbf-b3e3-bcdaa4f8fa6e admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:33.179289 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:33.375339 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-edcca9ae-1963-4dbf-b3e3-bcdaa4f8fa6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7b5bd6b3154ea89e96d5e68f17fda8'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:33.388359 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-edcca9ae-1963-4dbf-b3e3-bcdaa4f8fa6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7b5bd6b3154ea89e96d5e68f17fda8'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:33.465457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-edcca9ae-1963-4dbf-b3e3-bcdaa4f8fa6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7b5bd6b3154ea89e96d5e68f17fda8'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:33.466063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-edcca9ae-1963-4dbf-b3e3-bcdaa4f8fa6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7b5bd6b3154ea89e96d5e68f17fda8'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:33.473690 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-edcca9ae-1963-4dbf-b3e3-bcdaa4f8fa6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7b5bd6b3154ea89e96d5e68f17fda8'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:33.481112 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1217/2445] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:05:33 2022] DELETE /identity/v3/users/bc7b5bd6b3154ea89e96d5e68f17fda8 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:33.485869 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35e6af-5e83-4b22-be5c-972215129566 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:33.486336 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35e6af-5e83-4b22-be5c-972215129566 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:33.486419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35e6af-5e83-4b22-be5c-972215129566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:33.509796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1f35e6af-5e83-4b22-be5c-972215129566 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:33.511021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1f35e6af-5e83-4b22-be5c-972215129566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:33.577718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1229/2446] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:05:33.588420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcca9ae-1963-4dbf-b3e3-bcdaa4f8fa6e admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:33.589908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-edcca9ae-1963-4dbf-b3e3-bcdaa4f8fa6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:33.652157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcca9ae-1963-4dbf-b3e3-bcdaa4f8fa6e admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:33.655730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78e092-c6f2-4778-96dd-ea6ece128e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:33.656538 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78e092-c6f2-4778-96dd-ea6ece128e51 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:33.656864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78e092-c6f2-4778-96dd-ea6ece128e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:33.657143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78e092-c6f2-4778-96dd-ea6ece128e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:33.666717 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78e092-c6f2-4778-96dd-ea6ece128e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:33.668134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78e092-c6f2-4778-96dd-ea6ece128e51 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:33.677962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1218/2447] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:05:34.112667 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35e6af-5e83-4b22-be5c-972215129566 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:34.114190 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1f35e6af-5e83-4b22-be5c-972215129566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:34.128202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35e6af-5e83-4b22-be5c-972215129566 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:34.133606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bfb43-8de9-4848-bd67-7fa46a52c69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:34.134504 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bfb43-8de9-4848-bd67-7fa46a52c69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:34.134785 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bfb43-8de9-4848-bd67-7fa46a52c69a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:34.135061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bfb43-8de9-4848-bd67-7fa46a52c69a admin admin] PATH_INFO: `/v3/projects/6846f495d288493a974434927c584949` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:34.136367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bfb43-8de9-4848-bd67-7fa46a52c69a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6846f495d288493a974434927c584949)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:34.138403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bfb43-8de9-4848-bd67-7fa46a52c69a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:34.280922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f10bfb43-8de9-4848-bd67-7fa46a52c69a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6846f495d288493a974434927c584949', 'request_id': 'req-f10bfb43-8de9-4848-bd67-7fa46a52c69a'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:34.288114 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f10bfb43-8de9-4848-bd67-7fa46a52c69a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6846f495d288493a974434927c584949', 'request_id': 'req-f10bfb43-8de9-4848-bd67-7fa46a52c69a'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:34.389547 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f10bfb43-8de9-4848-bd67-7fa46a52c69a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6846f495d288493a974434927c584949', 'request_id': 'req-f10bfb43-8de9-4848-bd67-7fa46a52c69a'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:34.401679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f10bfb43-8de9-4848-bd67-7fa46a52c69a admin admin] The token cache is being invalidate because project 6846f495d288493a974434927c584949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:05:34.401975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f10bfb43-8de9-4848-bd67-7fa46a52c69a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:34.402655 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f10bfb43-8de9-4848-bd67-7fa46a52c69a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:34.404459 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1230/2448] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:05:34 2022] DELETE /identity/v3/projects/6846f495d288493a974434927c584949 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:34.409906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ee448-3e2c-4686-838b-8f8a88dc1a58 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:34.410425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ee448-3e2c-4686-838b-8f8a88dc1a58 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:34.410540 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ee448-3e2c-4686-838b-8f8a88dc1a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:34.428006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-906ee448-3e2c-4686-838b-8f8a88dc1a58 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:34.429399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-906ee448-3e2c-4686-838b-8f8a88dc1a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:34.491765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1219/2449] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:05:34.499933 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee20d36-337f-4e48-9835-dbec676c308d None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:34.500418 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee20d36-337f-4e48-9835-dbec676c308d None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:34.500532 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee20d36-337f-4e48-9835-dbec676c308d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:34.520072 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-4ee20d36-337f-4e48-9835-dbec676c308d None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:34.521329 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4ee20d36-337f-4e48-9835-dbec676c308d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:34.530189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1231/2450] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:05:34.534466 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ee448-3e2c-4686-838b-8f8a88dc1a58 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:34.544996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ee448-3e2c-4686-838b-8f8a88dc1a58 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:34.549725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda29e1-4498-48f7-9f9b-f9f5755bdbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:34.550386 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda29e1-4498-48f7-9f9b-f9f5755bdbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:34.550666 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda29e1-4498-48f7-9f9b-f9f5755bdbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:34.550939 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda29e1-4498-48f7-9f9b-f9f5755bdbd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:34.551678 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda29e1-4498-48f7-9f9b-f9f5755bdbd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:05:34.551984 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda29e1-4498-48f7-9f9b-f9f5755bdbd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:34.553662 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda29e1-4498-48f7-9f9b-f9f5755bdbd3 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:34.566291 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1220/2451] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:05:34.571277 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee20d36-337f-4e48-9835-dbec676c308d None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:34.582209 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee20d36-337f-4e48-9835-dbec676c308d None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:34.587760 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5b7d5-f7a2-4672-8b65-f3b7ec07eb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:34.588431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5b7d5-f7a2-4672-8b65-f3b7ec07eb2d admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:34.588762 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5b7d5-f7a2-4672-8b65-f3b7ec07eb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:34.589046 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5b7d5-f7a2-4672-8b65-f3b7ec07eb2d admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:34.589770 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5b7d5-f7a2-4672-8b65-f3b7ec07eb2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:34.591901 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5b7d5-f7a2-4672-8b65-f3b7ec07eb2d admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:34.694586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1232/2452] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:05:34 2022] POST /identity/v3/projects => generated 357 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:05:34.698645 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda29e1-4498-48f7-9f9b-f9f5755bdbd3 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:34.708932 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda29e1-4498-48f7-9f9b-f9f5755bdbd3 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:34.735966 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:34.768936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dec3b5-9b2b-41e3-ab6a-c1a4f498894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:34.769653 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dec3b5-9b2b-41e3-ab6a-c1a4f498894b admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:34.769962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dec3b5-9b2b-41e3-ab6a-c1a4f498894b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:34.770262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dec3b5-9b2b-41e3-ab6a-c1a4f498894b admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:34.770962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dec3b5-9b2b-41e3-ab6a-c1a4f498894b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:34.773343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dec3b5-9b2b-41e3-ab6a-c1a4f498894b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:34.876287 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1221/2453] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:05:34 2022] POST /identity/v3/users => generated 279 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:05:34.880000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5b7d5-f7a2-4672-8b65-f3b7ec07eb2d admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:34.891855 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5b7d5-f7a2-4672-8b65-f3b7ec07eb2d admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:34.897244 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b801c-fb9d-4ece-a474-7b36388fb749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:34.898124 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b801c-fb9d-4ece-a474-7b36388fb749 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:34.898415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b801c-fb9d-4ece-a474-7b36388fb749 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:34.898711 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b801c-fb9d-4ece-a474-7b36388fb749 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:34.899445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b801c-fb9d-4ece-a474-7b36388fb749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:34.901093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b801c-fb9d-4ece-a474-7b36388fb749 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:34.912885 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1233/2454] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:05:34.916779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dec3b5-9b2b-41e3-ab6a-c1a4f498894b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:34.927413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dec3b5-9b2b-41e3-ab6a-c1a4f498894b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:34.933778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4c074-bfb7-4db6-92d9-60024469e309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:34.934442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4c074-bfb7-4db6-92d9-60024469e309 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:34.934725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4c074-bfb7-4db6-92d9-60024469e309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:34.935063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4c074-bfb7-4db6-92d9-60024469e309 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:34.935802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4c074-bfb7-4db6-92d9-60024469e309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:34.937696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4c074-bfb7-4db6-92d9-60024469e309 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:34.949448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1222/2455] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:05:34.953607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b801c-fb9d-4ece-a474-7b36388fb749 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:34.960250 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:34.964002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b801c-fb9d-4ece-a474-7b36388fb749 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:34.968703 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d863cd-9207-4d86-9b84-80e5ffa4b64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:34.969577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d863cd-9207-4d86-9b84-80e5ffa4b64f admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:34.969863 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d863cd-9207-4d86-9b84-80e5ffa4b64f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:34.970138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d863cd-9207-4d86-9b84-80e5ffa4b64f admin admin] PATH_INFO: `/v3/projects/5051f58d35794665832a52c28afeeac0/users/170257f0c0864a4daff3ec39ad8fc50c/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:34.985656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d863cd-9207-4d86-9b84-80e5ffa4b64f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5051f58d35794665832a52c28afeeac0, user_id=170257f0c0864a4daff3ec39ad8fc50c, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:34.988384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d863cd-9207-4d86-9b84-80e5ffa4b64f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:35.101955 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1234/2456] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:05:34 2022] PUT /identity/v3/projects/5051f58d35794665832a52c28afeeac0/users/170257f0c0864a4daff3ec39ad8fc50c/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:35.113670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe825b7-4a31-42fc-9316-3a85c6051bb9 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:35.113966 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe825b7-4a31-42fc-9316-3a85c6051bb9 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:35.114250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe825b7-4a31-42fc-9316-3a85c6051bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:35.143121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-8fe825b7-4a31-42fc-9316-3a85c6051bb9 None None] MFA Rules not processed for user `170257f0c0864a4daff3ec39ad8fc50c`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:35.144344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8fe825b7-4a31-42fc-9316-3a85c6051bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:35.215703 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1223/2457] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:05:35.220255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d863cd-9207-4d86-9b84-80e5ffa4b64f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:35.293995 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d863cd-9207-4d86-9b84-80e5ffa4b64f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:35.298795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c3ace-c4c7-4b57-9cf9-8aa680f59bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:35.299452 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3ace-c4c7-4b57-9cf9-8aa680f59bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:35.299737 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3ace-c4c7-4b57-9cf9-8aa680f59bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:35.300012 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3ace-c4c7-4b57-9cf9-8aa680f59bb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:35.301064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c3ace-c4c7-4b57-9cf9-8aa680f59bb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:35.302664 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c3ace-c4c7-4b57-9cf9-8aa680f59bb9 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:35.411946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1235/2458] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:05:35 2022] POST /identity/v3/projects => generated 357 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:05:35.414236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe825b7-4a31-42fc-9316-3a85c6051bb9 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:35.427022 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe825b7-4a31-42fc-9316-3a85c6051bb9 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:35.488416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068f817-e71a-4dc4-9466-84175a0efb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:35.489192 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068f817-e71a-4dc4-9466-84175a0efb7b admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:35.497499 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068f817-e71a-4dc4-9466-84175a0efb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:35.497499 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068f817-e71a-4dc4-9466-84175a0efb7b admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:35.497499 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068f817-e71a-4dc4-9466-84175a0efb7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:35.497499 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068f817-e71a-4dc4-9466-84175a0efb7b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:35.606536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1224/2459] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:05:35 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:05:35.612158 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c3ace-c4c7-4b57-9cf9-8aa680f59bb9 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:35.624767 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c3ace-c4c7-4b57-9cf9-8aa680f59bb9 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:35.633601 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc48fc-57ed-4004-b118-2c36e5e37ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:35.634401 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc48fc-57ed-4004-b118-2c36e5e37ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:35.634765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc48fc-57ed-4004-b118-2c36e5e37ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:35.634960 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc48fc-57ed-4004-b118-2c36e5e37ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:35.635693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc48fc-57ed-4004-b118-2c36e5e37ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:35.637336 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc48fc-57ed-4004-b118-2c36e5e37ff4 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:35.649248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1236/2460] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:05:35.653676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068f817-e71a-4dc4-9466-84175a0efb7b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:35.664472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068f817-e71a-4dc4-9466-84175a0efb7b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:35.669696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41507de6-448b-4ad3-90ec-4adfaad991c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:35.670691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41507de6-448b-4ad3-90ec-4adfaad991c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:35.671066 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41507de6-448b-4ad3-90ec-4adfaad991c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:35.671391 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41507de6-448b-4ad3-90ec-4adfaad991c0 admin admin] PATH_INFO: `/v3/projects/f5b99998492c4eaab8b70d71a7df4983/users/38724b75470f4e47bc597abda3615fbe/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:35.688003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41507de6-448b-4ad3-90ec-4adfaad991c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b99998492c4eaab8b70d71a7df4983, user_id=38724b75470f4e47bc597abda3615fbe, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:35.690928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41507de6-448b-4ad3-90ec-4adfaad991c0 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:35.767360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1225/2461] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:05:35 2022] PUT /identity/v3/projects/f5b99998492c4eaab8b70d71a7df4983/users/38724b75470f4e47bc597abda3615fbe/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:05:35.771259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc48fc-57ed-4004-b118-2c36e5e37ff4 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:35.781744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc48fc-57ed-4004-b118-2c36e5e37ff4 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:35.840669 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849ef50-7cdd-4a60-bf14-70ede144f23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:35.841504 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849ef50-7cdd-4a60-bf14-70ede144f23a admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:35.841811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849ef50-7cdd-4a60-bf14-70ede144f23a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:35.842089 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849ef50-7cdd-4a60-bf14-70ede144f23a admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:35.842815 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849ef50-7cdd-4a60-bf14-70ede144f23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:35.844403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849ef50-7cdd-4a60-bf14-70ede144f23a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:35.855098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1237/2462] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:05:35.859478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41507de6-448b-4ad3-90ec-4adfaad991c0 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:35.865045 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:35.871118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41507de6-448b-4ad3-90ec-4adfaad991c0 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:35.877613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5795e-e92c-49cd-9a4d-dba0f7e7047c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:35.880941 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5795e-e92c-49cd-9a4d-dba0f7e7047c admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:35.880941 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5795e-e92c-49cd-9a4d-dba0f7e7047c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:35.880941 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5795e-e92c-49cd-9a4d-dba0f7e7047c admin admin] PATH_INFO: `/v3/projects/f5b99998492c4eaab8b70d71a7df4983/users/38724b75470f4e47bc597abda3615fbe/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:35.881237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5795e-e92c-49cd-9a4d-dba0f7e7047c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b99998492c4eaab8b70d71a7df4983, user_id=38724b75470f4e47bc597abda3615fbe, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:35.884078 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5795e-e92c-49cd-9a4d-dba0f7e7047c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:35.894457 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1226/2463] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:05:35 2022] PUT /identity/v3/projects/f5b99998492c4eaab8b70d71a7df4983/users/38724b75470f4e47bc597abda3615fbe/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:05:35.904967 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a4777-07f8-4e7b-b4c6-8b0d6e5b5866 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:35.905257 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a4777-07f8-4e7b-b4c6-8b0d6e5b5866 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:35.905542 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a4777-07f8-4e7b-b4c6-8b0d6e5b5866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:35.933096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-2b9a4777-07f8-4e7b-b4c6-8b0d6e5b5866 None None] MFA Rules not processed for user `38724b75470f4e47bc597abda3615fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:35.934302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2b9a4777-07f8-4e7b-b4c6-8b0d6e5b5866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:35.977266 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:36.008129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1238/2464] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:05:36.019344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5795e-e92c-49cd-9a4d-dba0f7e7047c admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:36.021237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-42f5795e-e92c-49cd-9a4d-dba0f7e7047c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:36.080759 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5795e-e92c-49cd-9a4d-dba0f7e7047c admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:36.084469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e1ec9-268f-4719-8b24-a9680d4142e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:36.085252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e1ec9-268f-4719-8b24-a9680d4142e8 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:36.085651 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e1ec9-268f-4719-8b24-a9680d4142e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:36.085929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e1ec9-268f-4719-8b24-a9680d4142e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:36.095606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e1ec9-268f-4719-8b24-a9680d4142e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:36.097110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e1ec9-268f-4719-8b24-a9680d4142e8 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:36.108157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1227/2465] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:05:36 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:05:36.294182 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a4777-07f8-4e7b-b4c6-8b0d6e5b5866 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:36.295563 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2b9a4777-07f8-4e7b-b4c6-8b0d6e5b5866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:36.309056 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a4777-07f8-4e7b-b4c6-8b0d6e5b5866 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:36.313175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33970cb7-672a-4891-8019-ce72d009cf00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:36.313857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33970cb7-672a-4891-8019-ce72d009cf00 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:36.314168 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33970cb7-672a-4891-8019-ce72d009cf00 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:36.314445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33970cb7-672a-4891-8019-ce72d009cf00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:36.376171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33970cb7-672a-4891-8019-ce72d009cf00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:36.377683 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33970cb7-672a-4891-8019-ce72d009cf00 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:36.387964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1239/2466] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:05:36 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:05:45.991705 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e1ec9-268f-4719-8b24-a9680d4142e8 service cinder] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:45.993185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-480e1ec9-268f-4719-8b24-a9680d4142e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:46.049709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e1ec9-268f-4719-8b24-a9680d4142e8 service cinder] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:46.053160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ffa10-cc73-46a0-bfa8-7743297fbebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:46.053790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ffa10-cc73-46a0-bfa8-7743297fbebb service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:46.054072 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ffa10-cc73-46a0-bfa8-7743297fbebb service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:46.054344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ffa10-cc73-46a0-bfa8-7743297fbebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:46.056712 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-171ffa10-cc73-46a0-bfa8-7743297fbebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:46.127806 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ffa10-cc73-46a0-bfa8-7743297fbebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:46.129280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ffa10-cc73-46a0-bfa8-7743297fbebb service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:46.138911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1228/2467] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:05:46.383390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=39 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:47.546113 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a60dc-14ec-439d-ab6e-145301c9813d None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:47.547879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a60dc-14ec-439d-ab6e-145301c9813d None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:47.548174 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a60dc-14ec-439d-ab6e-145301c9813d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:47.595498 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-297a60dc-14ec-439d-ab6e-145301c9813d None None] MFA Rules not processed for user `d93abd4361d240919ec85cf4b92347fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:47.597210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-297a60dc-14ec-439d-ab6e-145301c9813d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:47.674749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1240/2468] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:05:51.378885 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ffa10-cc73-46a0-bfa8-7743297fbebb service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:51.380408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-171ffa10-cc73-46a0-bfa8-7743297fbebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:51.392984 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ffa10-cc73-46a0-bfa8-7743297fbebb service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:51.396997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1adcb5-234b-40f2-9eac-44152a9d4ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:51.397827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1adcb5-234b-40f2-9eac-44152a9d4ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:51.397990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1adcb5-234b-40f2-9eac-44152a9d4ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:51.398181 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1adcb5-234b-40f2-9eac-44152a9d4ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:51.400332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6d1adcb5-234b-40f2-9eac-44152a9d4ad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:51.429815 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1adcb5-234b-40f2-9eac-44152a9d4ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:51.432023 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1adcb5-234b-40f2-9eac-44152a9d4ad3 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:51.445102 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a60dc-14ec-439d-ab6e-145301c9813d None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:51.448250 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-297a60dc-14ec-439d-ab6e-145301c9813d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:51.461120 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1229/2469] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:05:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:05:51.538488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a60dc-14ec-439d-ab6e-145301c9813d None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:51.545460 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83739fb-d504-410d-86fc-0bd4192edeeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:51.545829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83739fb-d504-410d-86fc-0bd4192edeeb service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:51.546110 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83739fb-d504-410d-86fc-0bd4192edeeb service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:51.546384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83739fb-d504-410d-86fc-0bd4192edeeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:51.554917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83739fb-d504-410d-86fc-0bd4192edeeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:51.557640 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83739fb-d504-410d-86fc-0bd4192edeeb service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:51.568214 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1241/2470] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:05:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:05:55.522028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1adcb5-234b-40f2-9eac-44152a9d4ad3 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:55.536366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1adcb5-234b-40f2-9eac-44152a9d4ad3 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:55.544520 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84336df-8715-49ca-9d39-424a74ef61fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:55.545904 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84336df-8715-49ca-9d39-424a74ef61fe service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:55.546360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84336df-8715-49ca-9d39-424a74ef61fe service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:55.546824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84336df-8715-49ca-9d39-424a74ef61fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:55.558890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f84336df-8715-49ca-9d39-424a74ef61fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:55.582614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:55.665074 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84336df-8715-49ca-9d39-424a74ef61fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:55.666895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84336df-8715-49ca-9d39-424a74ef61fe service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:55.687028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1230/2471] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:05:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:05:55.722513 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83739fb-d504-410d-86fc-0bd4192edeeb service nova] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:55.724193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-c83739fb-d504-410d-86fc-0bd4192edeeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:55.742368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83739fb-d504-410d-86fc-0bd4192edeeb service nova] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:55.749063 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724bab2-4d21-4092-9dc1-93d4ff1c38fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:55.750506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724bab2-4d21-4092-9dc1-93d4ff1c38fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:55.750947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724bab2-4d21-4092-9dc1-93d4ff1c38fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:55.751382 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724bab2-4d21-4092-9dc1-93d4ff1c38fa admin admin] PATH_INFO: `/v3/users/4f764a725deb405198f95d583035b371` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:55.752853 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724bab2-4d21-4092-9dc1-93d4ff1c38fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f764a725deb405198f95d583035b371)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:55.754822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724bab2-4d21-4092-9dc1-93d4ff1c38fa admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:55.917024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1724bab2-4d21-4092-9dc1-93d4ff1c38fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f764a725deb405198f95d583035b371'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:55.928840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1724bab2-4d21-4092-9dc1-93d4ff1c38fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f764a725deb405198f95d583035b371'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:55.931011 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:55.988005 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1724bab2-4d21-4092-9dc1-93d4ff1c38fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f764a725deb405198f95d583035b371'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:55.988550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1724bab2-4d21-4092-9dc1-93d4ff1c38fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f764a725deb405198f95d583035b371'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:55.996206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-1724bab2-4d21-4092-9dc1-93d4ff1c38fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f764a725deb405198f95d583035b371'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:56.002153 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1242/2472] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:05:55 2022] DELETE /identity/v3/users/4f764a725deb405198f95d583035b371 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:56.232576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84336df-8715-49ca-9d39-424a74ef61fe service nova] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:56.245512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84336df-8715-49ca-9d39-424a74ef61fe service nova] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:56.308404 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:56.309597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:56.309875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:56.310141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8 admin admin] PATH_INFO: `/v3/projects/253d5ed8735d445c930140b6d91136c8` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:56.311345 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=253d5ed8735d445c930140b6d91136c8)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:56.313268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:56.418886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253d5ed8735d445c930140b6d91136c8', 'request_id': 'req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:56.503286 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253d5ed8735d445c930140b6d91136c8', 'request_id': 'req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:56.510068 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253d5ed8735d445c930140b6d91136c8', 'request_id': 'req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:56.520720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8 admin admin] The token cache is being invalidate because project 253d5ed8735d445c930140b6d91136c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:05:56.521009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:56.521660 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:56.523269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1231/2473] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:05:56 2022] DELETE /identity/v3/projects/253d5ed8735d445c930140b6d91136c8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:56.527882 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724bab2-4d21-4092-9dc1-93d4ff1c38fa admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:56.529751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1724bab2-4d21-4092-9dc1-93d4ff1c38fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:56.543411 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724bab2-4d21-4092-9dc1-93d4ff1c38fa admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:56.603765 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199e752-f32c-4236-a5c8-29cffcb47421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:56.604923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199e752-f32c-4236-a5c8-29cffcb47421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:56.605206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199e752-f32c-4236-a5c8-29cffcb47421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:56.605480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199e752-f32c-4236-a5c8-29cffcb47421 admin admin] PATH_INFO: `/v3/users/f6ddd18eaf94495bb19903c96c75b691` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:56.606672 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199e752-f32c-4236-a5c8-29cffcb47421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ddd18eaf94495bb19903c96c75b691)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:56.608770 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199e752-f32c-4236-a5c8-29cffcb47421 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:56.837234 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6199e752-f32c-4236-a5c8-29cffcb47421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ddd18eaf94495bb19903c96c75b691'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:56.849753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6199e752-f32c-4236-a5c8-29cffcb47421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ddd18eaf94495bb19903c96c75b691'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:56.977633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6199e752-f32c-4236-a5c8-29cffcb47421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ddd18eaf94495bb19903c96c75b691'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:56.987505 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6199e752-f32c-4236-a5c8-29cffcb47421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ddd18eaf94495bb19903c96c75b691'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:56.987505 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6199e752-f32c-4236-a5c8-29cffcb47421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ddd18eaf94495bb19903c96c75b691'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:56.993064 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1243/2474] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:05:56 2022] DELETE /identity/v3/users/f6ddd18eaf94495bb19903c96c75b691 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:57.224769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:57.228301 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:57.241051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e387b-2e34-4a31-b67f-0df4aae48ec8 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:57.266273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:57.319478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f069471-7aff-487e-bb3c-ad1cb5c73a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:57.320445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f069471-7aff-487e-bb3c-ad1cb5c73a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:57.320761 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f069471-7aff-487e-bb3c-ad1cb5c73a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:57.321777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f069471-7aff-487e-bb3c-ad1cb5c73a56 admin admin] PATH_INFO: `/v3/projects/24596a0ec0e54c74b7360b116ac36144` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:57.323120 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f069471-7aff-487e-bb3c-ad1cb5c73a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24596a0ec0e54c74b7360b116ac36144)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:57.325145 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f069471-7aff-487e-bb3c-ad1cb5c73a56 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:57.449176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8f069471-7aff-487e-bb3c-ad1cb5c73a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24596a0ec0e54c74b7360b116ac36144', 'request_id': 'req-8f069471-7aff-487e-bb3c-ad1cb5c73a56'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:57.514702 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8f069471-7aff-487e-bb3c-ad1cb5c73a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24596a0ec0e54c74b7360b116ac36144', 'request_id': 'req-8f069471-7aff-487e-bb3c-ad1cb5c73a56'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:57.521444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8f069471-7aff-487e-bb3c-ad1cb5c73a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24596a0ec0e54c74b7360b116ac36144', 'request_id': 'req-8f069471-7aff-487e-bb3c-ad1cb5c73a56'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:57.532152 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8f069471-7aff-487e-bb3c-ad1cb5c73a56 admin admin] The token cache is being invalidate because project 24596a0ec0e54c74b7360b116ac36144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:05:57.532706 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8f069471-7aff-487e-bb3c-ad1cb5c73a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:57.533078 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8f069471-7aff-487e-bb3c-ad1cb5c73a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:57.534610 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1232/2475] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:05:57 2022] DELETE /identity/v3/projects/24596a0ec0e54c74b7360b116ac36144 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:57.728982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914522c-2a25-4d7b-977f-c267d92efdcb None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:57.729282 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914522c-2a25-4d7b-977f-c267d92efdcb None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:57.729569 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914522c-2a25-4d7b-977f-c267d92efdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:57.750264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-2914522c-2a25-4d7b-977f-c267d92efdcb None None] MFA Rules not processed for user `e6357e83df904ea09221cfc374d776c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:57.751529 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2914522c-2a25-4d7b-977f-c267d92efdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:57.810327 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1244/2476] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:05:58.432021 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f069471-7aff-487e-bb3c-ad1cb5c73a56 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:58.433676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8f069471-7aff-487e-bb3c-ad1cb5c73a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:58.498135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f069471-7aff-487e-bb3c-ad1cb5c73a56 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:58.503570 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ca4f3-d8b6-4622-a46a-a0e1a3432a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:58.504432 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ca4f3-d8b6-4622-a46a-a0e1a3432a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:58.506242 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ca4f3-d8b6-4622-a46a-a0e1a3432a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:58.506242 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ca4f3-d8b6-4622-a46a-a0e1a3432a9b admin admin] PATH_INFO: `/v3/users/170257f0c0864a4daff3ec39ad8fc50c` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:58.506242 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ca4f3-d8b6-4622-a46a-a0e1a3432a9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=170257f0c0864a4daff3ec39ad8fc50c)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:58.508090 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ca4f3-d8b6-4622-a46a-a0e1a3432a9b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:58.711220 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a54ca4f3-d8b6-4622-a46a-a0e1a3432a9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '170257f0c0864a4daff3ec39ad8fc50c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:58.715623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:58.723674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a54ca4f3-d8b6-4622-a46a-a0e1a3432a9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '170257f0c0864a4daff3ec39ad8fc50c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:58.823138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a54ca4f3-d8b6-4622-a46a-a0e1a3432a9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '170257f0c0864a4daff3ec39ad8fc50c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:58.823766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a54ca4f3-d8b6-4622-a46a-a0e1a3432a9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '170257f0c0864a4daff3ec39ad8fc50c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:58.831163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a54ca4f3-d8b6-4622-a46a-a0e1a3432a9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '170257f0c0864a4daff3ec39ad8fc50c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:58.837466 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1233/2477] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:05:58 2022] DELETE /identity/v3/users/170257f0c0864a4daff3ec39ad8fc50c => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:58.842015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c64266-9881-4ff5-9076-8a6fb2c509ef None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:58.842474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c64266-9881-4ff5-9076-8a6fb2c509ef None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:58.842582 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c64266-9881-4ff5-9076-8a6fb2c509ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:58.854233 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:05:58.859904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-78c64266-9881-4ff5-9076-8a6fb2c509ef None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:05:58.861166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-78c64266-9881-4ff5-9076-8a6fb2c509ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:58.937327 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1245/2478] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:05:58.948124 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ca4f3-d8b6-4622-a46a-a0e1a3432a9b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:58.949764 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-a54ca4f3-d8b6-4622-a46a-a0e1a3432a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:59.016911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ca4f3-d8b6-4622-a46a-a0e1a3432a9b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:59.020394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6eacf-dfe6-4a2c-bcd9-f09d0adb9642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:59.021194 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6eacf-dfe6-4a2c-bcd9-f09d0adb9642 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:59.021341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6eacf-dfe6-4a2c-bcd9-f09d0adb9642 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:59.021613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6eacf-dfe6-4a2c-bcd9-f09d0adb9642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:59.031294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6eacf-dfe6-4a2c-bcd9-f09d0adb9642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:59.032734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6eacf-dfe6-4a2c-bcd9-f09d0adb9642 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:59.043758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1234/2479] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:05:59.489099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c64266-9881-4ff5-9076-8a6fb2c509ef None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:59.489099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-78c64266-9881-4ff5-9076-8a6fb2c509ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:05:59.497296 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c64266-9881-4ff5-9076-8a6fb2c509ef None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:59.501921 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:59.502890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:59.503176 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:59.503528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1 admin admin] PATH_INFO: `/v3/projects/5051f58d35794665832a52c28afeeac0` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:59.504774 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5051f58d35794665832a52c28afeeac0)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:59.506876 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:05:59.635221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5051f58d35794665832a52c28afeeac0', 'request_id': 'req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:59.641795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5051f58d35794665832a52c28afeeac0', 'request_id': 'req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:59.719546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5051f58d35794665832a52c28afeeac0', 'request_id': 'req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:59.731225 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1 admin admin] The token cache is being invalidate because project 5051f58d35794665832a52c28afeeac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:05:59.731509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:59.732146 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:05:59.733691 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1246/2480] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:05:59 2022] DELETE /identity/v3/projects/5051f58d35794665832a52c28afeeac0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:05:59.737626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6eacf-dfe6-4a2c-bcd9-f09d0adb9642 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:05:59.747905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6eacf-dfe6-4a2c-bcd9-f09d0adb9642 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:05:59.804972 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3617d-f5a9-48cc-9a34-2e1ba2f26651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:05:59.805864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3617d-f5a9-48cc-9a34-2e1ba2f26651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:05:59.806396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3617d-f5a9-48cc-9a34-2e1ba2f26651 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:05:59.806669 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3617d-f5a9-48cc-9a34-2e1ba2f26651 admin admin] PATH_INFO: `/v3/users/38724b75470f4e47bc597abda3615fbe` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:05:59.807850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3617d-f5a9-48cc-9a34-2e1ba2f26651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38724b75470f4e47bc597abda3615fbe)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:05:59.809953 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3617d-f5a9-48cc-9a34-2e1ba2f26651 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:00.020322 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-94f3617d-f5a9-48cc-9a34-2e1ba2f26651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38724b75470f4e47bc597abda3615fbe'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:00.033652 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-94f3617d-f5a9-48cc-9a34-2e1ba2f26651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38724b75470f4e47bc597abda3615fbe'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:00.120595 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-94f3617d-f5a9-48cc-9a34-2e1ba2f26651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38724b75470f4e47bc597abda3615fbe'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:00.121422 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-94f3617d-f5a9-48cc-9a34-2e1ba2f26651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38724b75470f4e47bc597abda3615fbe'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:00.124428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:00.130461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-94f3617d-f5a9-48cc-9a34-2e1ba2f26651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38724b75470f4e47bc597abda3615fbe'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:00.138130 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1235/2481] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:05:59 2022] DELETE /identity/v3/users/38724b75470f4e47bc597abda3615fbe => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:00.151812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:00.153922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:00.229599 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b12be-349e-4f7e-96dd-0a804b6f11d1 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:00.281879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:00.287035 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc6651-42d7-47df-ba83-79cb77bede81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:00.287672 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc6651-42d7-47df-ba83-79cb77bede81 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:00.287951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc6651-42d7-47df-ba83-79cb77bede81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:00.288221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc6651-42d7-47df-ba83-79cb77bede81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:00.290074 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-28cc6651-42d7-47df-ba83-79cb77bede81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:00.385668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc6651-42d7-47df-ba83-79cb77bede81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:00.387255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc6651-42d7-47df-ba83-79cb77bede81 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:00.400413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1247/2482] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:00.685056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3617d-f5a9-48cc-9a34-2e1ba2f26651 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:00.686826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-94f3617d-f5a9-48cc-9a34-2e1ba2f26651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:00.763969 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3617d-f5a9-48cc-9a34-2e1ba2f26651 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:00.769447 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf78a0-3b72-470a-9e15-aa2c05d6f27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:00.770338 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf78a0-3b72-470a-9e15-aa2c05d6f27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:00.770624 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf78a0-3b72-470a-9e15-aa2c05d6f27c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:00.770922 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf78a0-3b72-470a-9e15-aa2c05d6f27c admin admin] PATH_INFO: `/v3/projects/f5b99998492c4eaab8b70d71a7df4983` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:00.772102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf78a0-3b72-470a-9e15-aa2c05d6f27c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b99998492c4eaab8b70d71a7df4983)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:00.774101 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf78a0-3b72-470a-9e15-aa2c05d6f27c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:00.933759 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5adf78a0-3b72-470a-9e15-aa2c05d6f27c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b99998492c4eaab8b70d71a7df4983', 'request_id': 'req-5adf78a0-3b72-470a-9e15-aa2c05d6f27c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:01.023461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5adf78a0-3b72-470a-9e15-aa2c05d6f27c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b99998492c4eaab8b70d71a7df4983', 'request_id': 'req-5adf78a0-3b72-470a-9e15-aa2c05d6f27c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:01.030734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5adf78a0-3b72-470a-9e15-aa2c05d6f27c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b99998492c4eaab8b70d71a7df4983', 'request_id': 'req-5adf78a0-3b72-470a-9e15-aa2c05d6f27c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:01.042071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5adf78a0-3b72-470a-9e15-aa2c05d6f27c admin admin] The token cache is being invalidate because project f5b99998492c4eaab8b70d71a7df4983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:06:01.042358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5adf78a0-3b72-470a-9e15-aa2c05d6f27c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:01.042985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-5adf78a0-3b72-470a-9e15-aa2c05d6f27c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:01.044514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1236/2483] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:06:00 2022] DELETE /identity/v3/projects/f5b99998492c4eaab8b70d71a7df4983 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:01.049396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e949b-769a-4990-99db-2a7724cd42f7 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:01.049684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e949b-769a-4990-99db-2a7724cd42f7 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:01.049959 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e949b-769a-4990-99db-2a7724cd42f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:01.068257 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-e71e949b-769a-4990-99db-2a7724cd42f7 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:01.069493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e71e949b-769a-4990-99db-2a7724cd42f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:01.128698 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1248/2484] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:01.136570 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62648ec-e2da-4d65-80b3-251b600c8cd5 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:01.136906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62648ec-e2da-4d65-80b3-251b600c8cd5 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:01.137185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62648ec-e2da-4d65-80b3-251b600c8cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:01.156505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-d62648ec-e2da-4d65-80b3-251b600c8cd5 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:01.157737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-d62648ec-e2da-4d65-80b3-251b600c8cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:01.166482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1237/2485] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:01.170702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e949b-769a-4990-99db-2a7724cd42f7 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:01.181933 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e949b-769a-4990-99db-2a7724cd42f7 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:01.186566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed12f9-a6ff-4121-b427-2fdd23e42138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:01.187214 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed12f9-a6ff-4121-b427-2fdd23e42138 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:01.187592 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed12f9-a6ff-4121-b427-2fdd23e42138 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:01.187902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed12f9-a6ff-4121-b427-2fdd23e42138 admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:01.188769 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed12f9-a6ff-4121-b427-2fdd23e42138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:06:01.189082 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed12f9-a6ff-4121-b427-2fdd23e42138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:01.190663 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed12f9-a6ff-4121-b427-2fdd23e42138 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:01.202422 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1249/2486] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:06:01.212092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62648ec-e2da-4d65-80b3-251b600c8cd5 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:01.221341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62648ec-e2da-4d65-80b3-251b600c8cd5 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:01.225980 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8d705-7e49-42ca-bda1-9ae5efd4cb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:01.226618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d705-7e49-42ca-bda1-9ae5efd4cb39 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:01.226896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d705-7e49-42ca-bda1-9ae5efd4cb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:01.227764 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d705-7e49-42ca-bda1-9ae5efd4cb39 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:01.228463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8d705-7e49-42ca-bda1-9ae5efd4cb39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:01.230383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8d705-7e49-42ca-bda1-9ae5efd4cb39 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:01.326975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1238/2487] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:06:01 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:01.331140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed12f9-a6ff-4121-b427-2fdd23e42138 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:01.341908 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed12f9-a6ff-4121-b427-2fdd23e42138 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:01.401621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9555bd2-75a3-4527-b651-159b57d6c56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:01.404965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9555bd2-75a3-4527-b651-159b57d6c56c admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:01.404965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9555bd2-75a3-4527-b651-159b57d6c56c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:01.404965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9555bd2-75a3-4527-b651-159b57d6c56c admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:01.404965 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9555bd2-75a3-4527-b651-159b57d6c56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:01.405523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9555bd2-75a3-4527-b651-159b57d6c56c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:01.500372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1250/2488] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:06:01 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:01.504174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8d705-7e49-42ca-bda1-9ae5efd4cb39 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:01.516523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8d705-7e49-42ca-bda1-9ae5efd4cb39 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:01.521434 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731b26c-eb0c-4b99-a7b1-ef559daa1a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:01.522102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b26c-eb0c-4b99-a7b1-ef559daa1a4d admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:01.522381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b26c-eb0c-4b99-a7b1-ef559daa1a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:01.522713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b26c-eb0c-4b99-a7b1-ef559daa1a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:01.523616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731b26c-eb0c-4b99-a7b1-ef559daa1a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:01.531028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731b26c-eb0c-4b99-a7b1-ef559daa1a4d admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:01.537529 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1239/2489] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:06:01.541396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9555bd2-75a3-4527-b651-159b57d6c56c admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:01.550837 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:01.555961 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9555bd2-75a3-4527-b651-159b57d6c56c admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:01.561070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca2d04-19ba-4fc8-85d7-32284cc0c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:01.561742 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca2d04-19ba-4fc8-85d7-32284cc0c572 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:01.562070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca2d04-19ba-4fc8-85d7-32284cc0c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:01.562346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca2d04-19ba-4fc8-85d7-32284cc0c572 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:01.563473 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca2d04-19ba-4fc8-85d7-32284cc0c572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:01.565039 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca2d04-19ba-4fc8-85d7-32284cc0c572 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:01.579678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1251/2490] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:06:01.583245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731b26c-eb0c-4b99-a7b1-ef559daa1a4d admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:01.596331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731b26c-eb0c-4b99-a7b1-ef559daa1a4d admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:01.604133 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fbc15-b6d7-496e-9361-c6f1924e92de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:01.604541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fbc15-b6d7-496e-9361-c6f1924e92de admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:01.604867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fbc15-b6d7-496e-9361-c6f1924e92de admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:01.608623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fbc15-b6d7-496e-9361-c6f1924e92de admin admin] PATH_INFO: `/v3/projects/23c46d4892834c6fae28ad1311f4718b/users/222c568d1b284c5ba0f6bd2292d848fe/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:01.628866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fbc15-b6d7-496e-9361-c6f1924e92de admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c46d4892834c6fae28ad1311f4718b, user_id=222c568d1b284c5ba0f6bd2292d848fe, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:01.632209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fbc15-b6d7-496e-9361-c6f1924e92de admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:01.762522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1240/2491] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:01 2022] PUT /identity/v3/projects/23c46d4892834c6fae28ad1311f4718b/users/222c568d1b284c5ba0f6bd2292d848fe/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:06:01.765837 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03325e-c10b-49cb-975e-4149ba6577bb None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:01.766424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03325e-c10b-49cb-975e-4149ba6577bb None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:01.766911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03325e-c10b-49cb-975e-4149ba6577bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:01.810704 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-5f03325e-c10b-49cb-975e-4149ba6577bb None None] MFA Rules not processed for user `222c568d1b284c5ba0f6bd2292d848fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:01.812424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-5f03325e-c10b-49cb-975e-4149ba6577bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:01.908084 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1252/2492] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:01.912278 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fbc15-b6d7-496e-9361-c6f1924e92de admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:01.943616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:02.004769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fbc15-b6d7-496e-9361-c6f1924e92de admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:02.011892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583c7a7-888a-4ca8-9b18-6a7ed31f509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:02.012674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583c7a7-888a-4ca8-9b18-6a7ed31f509a admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:02.013051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583c7a7-888a-4ca8-9b18-6a7ed31f509a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:02.013419 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583c7a7-888a-4ca8-9b18-6a7ed31f509a admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:02.014267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583c7a7-888a-4ca8-9b18-6a7ed31f509a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:02.016475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583c7a7-888a-4ca8-9b18-6a7ed31f509a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:02.112748 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1241/2493] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:06:01 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:02.117178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03325e-c10b-49cb-975e-4149ba6577bb None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:02.132840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03325e-c10b-49cb-975e-4149ba6577bb None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:02.195537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342049e-5cee-4e3c-8dc6-fdda0c4cf981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:02.196431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342049e-5cee-4e3c-8dc6-fdda0c4cf981 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:02.196555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342049e-5cee-4e3c-8dc6-fdda0c4cf981 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:02.196820 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342049e-5cee-4e3c-8dc6-fdda0c4cf981 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:02.197528 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342049e-5cee-4e3c-8dc6-fdda0c4cf981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:02.199483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342049e-5cee-4e3c-8dc6-fdda0c4cf981 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:02.277648 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1253/2494] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:06:02 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:02.281511 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583c7a7-888a-4ca8-9b18-6a7ed31f509a admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:02.292787 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583c7a7-888a-4ca8-9b18-6a7ed31f509a admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:02.297604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6f92d-9973-4725-ad12-5cbbfe88d3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:02.298268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6f92d-9973-4725-ad12-5cbbfe88d3aa admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:02.298672 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6f92d-9973-4725-ad12-5cbbfe88d3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:02.299042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6f92d-9973-4725-ad12-5cbbfe88d3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:02.299786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6f92d-9973-4725-ad12-5cbbfe88d3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:02.301709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6f92d-9973-4725-ad12-5cbbfe88d3aa admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:02.315417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1242/2495] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:02.320283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342049e-5cee-4e3c-8dc6-fdda0c4cf981 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:02.332135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342049e-5cee-4e3c-8dc6-fdda0c4cf981 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:02.339759 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921520ef-cea6-4af2-9e6e-da338ca5f37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:02.341792 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921520ef-cea6-4af2-9e6e-da338ca5f37b admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:02.342104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921520ef-cea6-4af2-9e6e-da338ca5f37b admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:02.342457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921520ef-cea6-4af2-9e6e-da338ca5f37b admin admin] PATH_INFO: `/v3/projects/86eab0dde6f74cada4b882f60a3b42a1/users/e49d85364a934b37ab0eb5773819aa2a/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:02.363884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921520ef-cea6-4af2-9e6e-da338ca5f37b admin admin] RBAC: Authorizing `identity:create_grant(project_id=86eab0dde6f74cada4b882f60a3b42a1, user_id=e49d85364a934b37ab0eb5773819aa2a, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:02.367031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921520ef-cea6-4af2-9e6e-da338ca5f37b admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:02.475614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1254/2496] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:02 2022] PUT /identity/v3/projects/86eab0dde6f74cada4b882f60a3b42a1/users/e49d85364a934b37ab0eb5773819aa2a/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:02.481229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6f92d-9973-4725-ad12-5cbbfe88d3aa admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:02.491889 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6f92d-9973-4725-ad12-5cbbfe88d3aa admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:02.554389 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2899149-9670-476a-8a7e-652cfd537556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:02.555127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2899149-9670-476a-8a7e-652cfd537556 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:02.555548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2899149-9670-476a-8a7e-652cfd537556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:02.556303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2899149-9670-476a-8a7e-652cfd537556 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:02.557089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2899149-9670-476a-8a7e-652cfd537556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:02.558876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2899149-9670-476a-8a7e-652cfd537556 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:02.569482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1243/2497] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:02.573843 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921520ef-cea6-4af2-9e6e-da338ca5f37b admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:02.584273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921520ef-cea6-4af2-9e6e-da338ca5f37b admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:02.590209 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61d119-f5a0-427f-aa0f-f86b7ce5265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:02.591096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61d119-f5a0-427f-aa0f-f86b7ce5265c admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:02.591396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61d119-f5a0-427f-aa0f-f86b7ce5265c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:02.591665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61d119-f5a0-427f-aa0f-f86b7ce5265c admin admin] PATH_INFO: `/v3/projects/86eab0dde6f74cada4b882f60a3b42a1/users/e49d85364a934b37ab0eb5773819aa2a/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:02.593692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61d119-f5a0-427f-aa0f-f86b7ce5265c admin admin] RBAC: Authorizing `identity:create_grant(project_id=86eab0dde6f74cada4b882f60a3b42a1, user_id=e49d85364a934b37ab0eb5773819aa2a, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:02.596426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61d119-f5a0-427f-aa0f-f86b7ce5265c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:02.608075 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1255/2498] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:02 2022] PUT /identity/v3/projects/86eab0dde6f74cada4b882f60a3b42a1/users/e49d85364a934b37ab0eb5773819aa2a/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:02.622148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b0a9e-77ad-46f4-879f-92447f296528 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:02.622148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b0a9e-77ad-46f4-879f-92447f296528 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:02.622148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b0a9e-77ad-46f4-879f-92447f296528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:02.645115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-343b0a9e-77ad-46f4-879f-92447f296528 None None] MFA Rules not processed for user `e49d85364a934b37ab0eb5773819aa2a`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:02.646323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-343b0a9e-77ad-46f4-879f-92447f296528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:02.715728 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1244/2499] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:02.728005 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61d119-f5a0-427f-aa0f-f86b7ce5265c admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:02.730143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-cf61d119-f5a0-427f-aa0f-f86b7ce5265c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:02.777342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:02.797896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61d119-f5a0-427f-aa0f-f86b7ce5265c admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:02.803495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26f7f7-1476-4548-8205-3206f503a222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:02.804152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26f7f7-1476-4548-8205-3206f503a222 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:02.804434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26f7f7-1476-4548-8205-3206f503a222 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:02.804741 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26f7f7-1476-4548-8205-3206f503a222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:02.816189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26f7f7-1476-4548-8205-3206f503a222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:02.817834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26f7f7-1476-4548-8205-3206f503a222 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:02.832230 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1256/2500] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:02.914642 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b0a9e-77ad-46f4-879f-92447f296528 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:02.930590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:02.987057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b0a9e-77ad-46f4-879f-92447f296528 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:03.003165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e417d17-97f4-40fd-850d-2350ee53af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:03.003165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e417d17-97f4-40fd-850d-2350ee53af70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:03.003165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e417d17-97f4-40fd-850d-2350ee53af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:03.003165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e417d17-97f4-40fd-850d-2350ee53af70 admin admin] PATH_INFO: `/v3/users/222c568d1b284c5ba0f6bd2292d848fe` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:03.003566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e417d17-97f4-40fd-850d-2350ee53af70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=222c568d1b284c5ba0f6bd2292d848fe)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:03.003566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e417d17-97f4-40fd-850d-2350ee53af70 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:03.195960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6e417d17-97f4-40fd-850d-2350ee53af70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222c568d1b284c5ba0f6bd2292d848fe'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:03.218832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6e417d17-97f4-40fd-850d-2350ee53af70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222c568d1b284c5ba0f6bd2292d848fe'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:03.275717 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6e417d17-97f4-40fd-850d-2350ee53af70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222c568d1b284c5ba0f6bd2292d848fe'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:03.276358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6e417d17-97f4-40fd-850d-2350ee53af70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222c568d1b284c5ba0f6bd2292d848fe'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:03.288130 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6e417d17-97f4-40fd-850d-2350ee53af70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222c568d1b284c5ba0f6bd2292d848fe'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:03.302006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1245/2501] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:06:02 2022] DELETE /identity/v3/users/222c568d1b284c5ba0f6bd2292d848fe => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:03.307245 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64655ea-dce6-4e7c-9102-86a5be98821e None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:03.308696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64655ea-dce6-4e7c-9102-86a5be98821e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:03.308986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64655ea-dce6-4e7c-9102-86a5be98821e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:03.343878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-e64655ea-dce6-4e7c-9102-86a5be98821e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:03.345152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e64655ea-dce6-4e7c-9102-86a5be98821e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:03.435955 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1257/2502] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:03.446038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e417d17-97f4-40fd-850d-2350ee53af70 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:03.447693 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6e417d17-97f4-40fd-850d-2350ee53af70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:03.511355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e417d17-97f4-40fd-850d-2350ee53af70 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:03.514938 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f7fec-eceb-47f8-a500-b79a89229c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:03.515590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f7fec-eceb-47f8-a500-b79a89229c7e service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:03.515873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f7fec-eceb-47f8-a500-b79a89229c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:03.516151 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f7fec-eceb-47f8-a500-b79a89229c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:03.531974 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f7fec-eceb-47f8-a500-b79a89229c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:03.533443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f7fec-eceb-47f8-a500-b79a89229c7e service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:03.543412 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1246/2503] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:04.021567 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64655ea-dce6-4e7c-9102-86a5be98821e None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:04.024783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e64655ea-dce6-4e7c-9102-86a5be98821e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:04.049521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64655ea-dce6-4e7c-9102-86a5be98821e None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:04.057981 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79066833-74b3-438e-b4ab-0217beebb2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:04.059475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79066833-74b3-438e-b4ab-0217beebb2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:04.059910 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79066833-74b3-438e-b4ab-0217beebb2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:04.060423 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79066833-74b3-438e-b4ab-0217beebb2b3 admin admin] PATH_INFO: `/v3/projects/23c46d4892834c6fae28ad1311f4718b` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:04.062658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79066833-74b3-438e-b4ab-0217beebb2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c46d4892834c6fae28ad1311f4718b)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:04.066205 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79066833-74b3-438e-b4ab-0217beebb2b3 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:04.182837 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-79066833-74b3-438e-b4ab-0217beebb2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c46d4892834c6fae28ad1311f4718b', 'request_id': 'req-79066833-74b3-438e-b4ab-0217beebb2b3'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:04.190673 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-79066833-74b3-438e-b4ab-0217beebb2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c46d4892834c6fae28ad1311f4718b', 'request_id': 'req-79066833-74b3-438e-b4ab-0217beebb2b3'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:04.279890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-79066833-74b3-438e-b4ab-0217beebb2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c46d4892834c6fae28ad1311f4718b', 'request_id': 'req-79066833-74b3-438e-b4ab-0217beebb2b3'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:04.292023 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-79066833-74b3-438e-b4ab-0217beebb2b3 admin admin] The token cache is being invalidate because project 23c46d4892834c6fae28ad1311f4718b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:06:04.292412 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-79066833-74b3-438e-b4ab-0217beebb2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:04.293154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-79066833-74b3-438e-b4ab-0217beebb2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:04.294978 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1258/2504] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:06:04 2022] DELETE /identity/v3/projects/23c46d4892834c6fae28ad1311f4718b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:04.298897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f7fec-eceb-47f8-a500-b79a89229c7e service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:04.309816 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f7fec-eceb-47f8-a500-b79a89229c7e service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:04.344779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:04.374516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143438b-d950-413e-9033-e151f2e6c73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:04.375438 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143438b-d950-413e-9033-e151f2e6c73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:04.375718 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143438b-d950-413e-9033-e151f2e6c73b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:04.375989 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143438b-d950-413e-9033-e151f2e6c73b admin admin] PATH_INFO: `/v3/users/e49d85364a934b37ab0eb5773819aa2a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:04.377425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143438b-d950-413e-9033-e151f2e6c73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49d85364a934b37ab0eb5773819aa2a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:04.379762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143438b-d950-413e-9033-e151f2e6c73b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:04.611735 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4143438b-d950-413e-9033-e151f2e6c73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49d85364a934b37ab0eb5773819aa2a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:04.625243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4143438b-d950-413e-9033-e151f2e6c73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49d85364a934b37ab0eb5773819aa2a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:04.720449 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4143438b-d950-413e-9033-e151f2e6c73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49d85364a934b37ab0eb5773819aa2a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:04.721108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4143438b-d950-413e-9033-e151f2e6c73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49d85364a934b37ab0eb5773819aa2a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:04.729754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4143438b-d950-413e-9033-e151f2e6c73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49d85364a934b37ab0eb5773819aa2a'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:04.736547 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1247/2505] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:06:04 2022] DELETE /identity/v3/users/e49d85364a934b37ab0eb5773819aa2a => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:05.905207 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79066833-74b3-438e-b4ab-0217beebb2b3 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:05.906667 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-79066833-74b3-438e-b4ab-0217beebb2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:05.919875 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79066833-74b3-438e-b4ab-0217beebb2b3 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:05.994636 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb3c07-dfac-4053-bfa2-a94eed7853a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:05.995507 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb3c07-dfac-4053-bfa2-a94eed7853a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:05.995851 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb3c07-dfac-4053-bfa2-a94eed7853a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:05.996128 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb3c07-dfac-4053-bfa2-a94eed7853a8 admin admin] PATH_INFO: `/v3/projects/86eab0dde6f74cada4b882f60a3b42a1` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:05.997367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb3c07-dfac-4053-bfa2-a94eed7853a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86eab0dde6f74cada4b882f60a3b42a1)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:05.999315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb3c07-dfac-4053-bfa2-a94eed7853a8 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:06.002030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:06.105628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c1eb3c07-dfac-4053-bfa2-a94eed7853a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86eab0dde6f74cada4b882f60a3b42a1', 'request_id': 'req-c1eb3c07-dfac-4053-bfa2-a94eed7853a8'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:06.112508 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c1eb3c07-dfac-4053-bfa2-a94eed7853a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86eab0dde6f74cada4b882f60a3b42a1', 'request_id': 'req-c1eb3c07-dfac-4053-bfa2-a94eed7853a8'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:06.195159 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c1eb3c07-dfac-4053-bfa2-a94eed7853a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86eab0dde6f74cada4b882f60a3b42a1', 'request_id': 'req-c1eb3c07-dfac-4053-bfa2-a94eed7853a8'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:06.210764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c1eb3c07-dfac-4053-bfa2-a94eed7853a8 admin admin] The token cache is being invalidate because project 86eab0dde6f74cada4b882f60a3b42a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:06:06.211076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c1eb3c07-dfac-4053-bfa2-a94eed7853a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:06.212576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c1eb3c07-dfac-4053-bfa2-a94eed7853a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:06.214178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1259/2506] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:06:05 2022] DELETE /identity/v3/projects/86eab0dde6f74cada4b882f60a3b42a1 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:06.219366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbca077-46b6-4da8-9972-17f0f92a1303 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:06.219835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbca077-46b6-4da8-9972-17f0f92a1303 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:06.220120 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbca077-46b6-4da8-9972-17f0f92a1303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:06.238646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-5fbca077-46b6-4da8-9972-17f0f92a1303 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:06.239919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-5fbca077-46b6-4da8-9972-17f0f92a1303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:06.299512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1248/2507] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:06.309653 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826083f-a9c2-45b1-ab5a-56fa165bb204 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:06.310021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826083f-a9c2-45b1-ab5a-56fa165bb204 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:06.310376 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826083f-a9c2-45b1-ab5a-56fa165bb204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:06.330742 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1826083f-a9c2-45b1-ab5a-56fa165bb204 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:06.332084 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1826083f-a9c2-45b1-ab5a-56fa165bb204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:06.340502 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1260/2508] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:06.344845 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbca077-46b6-4da8-9972-17f0f92a1303 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:06.354476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbca077-46b6-4da8-9972-17f0f92a1303 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:06.359046 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de61665-6204-475c-898a-ddb508518310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:06.359694 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61665-6204-475c-898a-ddb508518310 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:06.359978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61665-6204-475c-898a-ddb508518310 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:06.360254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61665-6204-475c-898a-ddb508518310 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:06.361013 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de61665-6204-475c-898a-ddb508518310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:06:06.361323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de61665-6204-475c-898a-ddb508518310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:06.362900 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de61665-6204-475c-898a-ddb508518310 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:06.375218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1249/2509] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:06:06.384460 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826083f-a9c2-45b1-ab5a-56fa165bb204 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:06.394282 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826083f-a9c2-45b1-ab5a-56fa165bb204 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:06.400294 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea93eb0-7daa-4640-9443-48ff880ba4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:06.401296 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea93eb0-7daa-4640-9443-48ff880ba4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:06.401553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea93eb0-7daa-4640-9443-48ff880ba4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:06.401987 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea93eb0-7daa-4640-9443-48ff880ba4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:06.402719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea93eb0-7daa-4640-9443-48ff880ba4b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:06.405521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea93eb0-7daa-4640-9443-48ff880ba4b9 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:06.521621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1261/2510] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:06:06 2022] POST /identity/v3/projects => generated 393 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:06.521991 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de61665-6204-475c-898a-ddb508518310 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:06.536631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de61665-6204-475c-898a-ddb508518310 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:06.603432 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:06.623346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23242e1d-ea97-4af8-a445-b9d9c67f0f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:06.628391 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23242e1d-ea97-4af8-a445-b9d9c67f0f81 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:06.628391 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23242e1d-ea97-4af8-a445-b9d9c67f0f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:06.628391 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23242e1d-ea97-4af8-a445-b9d9c67f0f81 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:06.628391 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23242e1d-ea97-4af8-a445-b9d9c67f0f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:06.628391 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23242e1d-ea97-4af8-a445-b9d9c67f0f81 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:06.724054 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1250/2511] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:06:06 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:06.725615 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea93eb0-7daa-4640-9443-48ff880ba4b9 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:06.737787 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea93eb0-7daa-4640-9443-48ff880ba4b9 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:06.744172 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ad5a2-98bf-40b5-98f2-e73626b5c3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:06.744903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ad5a2-98bf-40b5-98f2-e73626b5c3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:06.745192 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ad5a2-98bf-40b5-98f2-e73626b5c3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:06.745458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ad5a2-98bf-40b5-98f2-e73626b5c3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:06.746208 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ad5a2-98bf-40b5-98f2-e73626b5c3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:06.748490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ad5a2-98bf-40b5-98f2-e73626b5c3d5 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:06.762059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1262/2512] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:06.766367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23242e1d-ea97-4af8-a445-b9d9c67f0f81 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:06.777339 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23242e1d-ea97-4af8-a445-b9d9c67f0f81 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:06.783251 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de8fd3-5e32-4518-8e44-a5a3bb12cefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:06.783931 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de8fd3-5e32-4518-8e44-a5a3bb12cefc admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:06.784212 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de8fd3-5e32-4518-8e44-a5a3bb12cefc admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:06.784488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de8fd3-5e32-4518-8e44-a5a3bb12cefc admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:06.785326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de8fd3-5e32-4518-8e44-a5a3bb12cefc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:06.786918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de8fd3-5e32-4518-8e44-a5a3bb12cefc admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:06.803001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1251/2513] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:06.804214 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ad5a2-98bf-40b5-98f2-e73626b5c3d5 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:06.815501 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ad5a2-98bf-40b5-98f2-e73626b5c3d5 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:06.821582 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e30fde-a272-47e2-8ad2-4252b0100b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:06.822662 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e30fde-a272-47e2-8ad2-4252b0100b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:06.822946 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e30fde-a272-47e2-8ad2-4252b0100b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:06.823221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e30fde-a272-47e2-8ad2-4252b0100b59 admin admin] PATH_INFO: `/v3/projects/8c5e690975224d22b2c76c1a0e0a97ff/users/2e3d07e5e531464cabffe243123b4870/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:06.838315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e30fde-a272-47e2-8ad2-4252b0100b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5e690975224d22b2c76c1a0e0a97ff, user_id=2e3d07e5e531464cabffe243123b4870, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:06.840983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e30fde-a272-47e2-8ad2-4252b0100b59 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:06.943818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1263/2514] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:06 2022] PUT /identity/v3/projects/8c5e690975224d22b2c76c1a0e0a97ff/users/2e3d07e5e531464cabffe243123b4870/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:06.958914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386a741-954e-4d82-a5a8-e2e0708b07c5 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:06.959211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386a741-954e-4d82-a5a8-e2e0708b07c5 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:06.959492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386a741-954e-4d82-a5a8-e2e0708b07c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:06.989618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-d386a741-954e-4d82-a5a8-e2e0708b07c5 None None] MFA Rules not processed for user `2e3d07e5e531464cabffe243123b4870`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:06.994487 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-d386a741-954e-4d82-a5a8-e2e0708b07c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:07.071046 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1252/2515] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:07.076671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e30fde-a272-47e2-8ad2-4252b0100b59 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:07.145553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e30fde-a272-47e2-8ad2-4252b0100b59 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:07.151024 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fc5f2-0a10-4f66-b7d7-e7d7c68e575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:07.151692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fc5f2-0a10-4f66-b7d7-e7d7c68e575b admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:07.151987 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fc5f2-0a10-4f66-b7d7-e7d7c68e575b admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:07.152264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fc5f2-0a10-4f66-b7d7-e7d7c68e575b admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:07.153018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fc5f2-0a10-4f66-b7d7-e7d7c68e575b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:07.155103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fc5f2-0a10-4f66-b7d7-e7d7c68e575b admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:07.263870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1264/2516] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:06:07 2022] POST /identity/v3/projects => generated 391 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:07.265157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386a741-954e-4d82-a5a8-e2e0708b07c5 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:07.276954 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386a741-954e-4d82-a5a8-e2e0708b07c5 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:07.338936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74078149-670b-40b2-a3e8-d862260cee63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:07.339609 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74078149-670b-40b2-a3e8-d862260cee63 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:07.339887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74078149-670b-40b2-a3e8-d862260cee63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:07.340157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74078149-670b-40b2-a3e8-d862260cee63 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:07.340926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74078149-670b-40b2-a3e8-d862260cee63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:07.342914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74078149-670b-40b2-a3e8-d862260cee63 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:07.463783 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1253/2517] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:06:07 2022] POST /identity/v3/users => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:07.468070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fc5f2-0a10-4f66-b7d7-e7d7c68e575b admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:07.478332 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fc5f2-0a10-4f66-b7d7-e7d7c68e575b admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:07.482854 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257979f4-661b-4009-a060-d3a2d70a7710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:07.483500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257979f4-661b-4009-a060-d3a2d70a7710 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:07.483779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257979f4-661b-4009-a060-d3a2d70a7710 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:07.484048 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257979f4-661b-4009-a060-d3a2d70a7710 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:07.484962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257979f4-661b-4009-a060-d3a2d70a7710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:07.486506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257979f4-661b-4009-a060-d3a2d70a7710 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:07.497761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1265/2518] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:07.502995 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74078149-670b-40b2-a3e8-d862260cee63 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:07.513771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74078149-670b-40b2-a3e8-d862260cee63 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:07.518416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea40860-320c-4a62-8768-5f22e7ee77ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:07.519287 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea40860-320c-4a62-8768-5f22e7ee77ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:07.522997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea40860-320c-4a62-8768-5f22e7ee77ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:07.522997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea40860-320c-4a62-8768-5f22e7ee77ff admin admin] PATH_INFO: `/v3/projects/b40d756df6e840848f35981d8e2571ad/users/d1c1b125e42b405da2b412c0f768820e/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:07.537897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea40860-320c-4a62-8768-5f22e7ee77ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40d756df6e840848f35981d8e2571ad, user_id=d1c1b125e42b405da2b412c0f768820e, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:07.540504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea40860-320c-4a62-8768-5f22e7ee77ff admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:07.623332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1254/2519] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:07 2022] PUT /identity/v3/projects/b40d756df6e840848f35981d8e2571ad/users/d1c1b125e42b405da2b412c0f768820e/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:07.627353 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257979f4-661b-4009-a060-d3a2d70a7710 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:07.632707 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:07.638732 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257979f4-661b-4009-a060-d3a2d70a7710 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:07.696477 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cf32b-d1f7-4b2b-9562-d693b79180d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:07.697190 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cf32b-d1f7-4b2b-9562-d693b79180d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:07.697474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cf32b-d1f7-4b2b-9562-d693b79180d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:07.697754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cf32b-d1f7-4b2b-9562-d693b79180d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:07.698489 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cf32b-d1f7-4b2b-9562-d693b79180d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:07.700092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cf32b-d1f7-4b2b-9562-d693b79180d7 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:07.713826 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1266/2520] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:07.715153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea40860-320c-4a62-8768-5f22e7ee77ff admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:07.725846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea40860-320c-4a62-8768-5f22e7ee77ff admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:07.730530 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d0038-661f-41f7-a1d8-fb8d5c49dd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:07.731492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d0038-661f-41f7-a1d8-fb8d5c49dd15 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:07.731834 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d0038-661f-41f7-a1d8-fb8d5c49dd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:07.732169 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d0038-661f-41f7-a1d8-fb8d5c49dd15 admin admin] PATH_INFO: `/v3/projects/b40d756df6e840848f35981d8e2571ad/users/d1c1b125e42b405da2b412c0f768820e/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:07.734210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d0038-661f-41f7-a1d8-fb8d5c49dd15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40d756df6e840848f35981d8e2571ad, user_id=d1c1b125e42b405da2b412c0f768820e, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:07.741121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d0038-661f-41f7-a1d8-fb8d5c49dd15 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:07.748307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1255/2521] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:07 2022] PUT /identity/v3/projects/b40d756df6e840848f35981d8e2571ad/users/d1c1b125e42b405da2b412c0f768820e/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:07.759341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae38c-6c9e-44c8-9834-0f41867352f2 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:07.759934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae38c-6c9e-44c8-9834-0f41867352f2 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:07.760323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae38c-6c9e-44c8-9834-0f41867352f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:07.787485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-b65ae38c-6c9e-44c8-9834-0f41867352f2 None None] MFA Rules not processed for user `d1c1b125e42b405da2b412c0f768820e`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:07.789698 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b65ae38c-6c9e-44c8-9834-0f41867352f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:07.857398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1267/2522] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:07.872381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d0038-661f-41f7-a1d8-fb8d5c49dd15 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:07.874162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-185d0038-661f-41f7-a1d8-fb8d5c49dd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:07.879355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:07.933933 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d0038-661f-41f7-a1d8-fb8d5c49dd15 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:07.937545 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cd149-8163-4afa-b7a9-df4c1eb0c629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:07.938205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cd149-8163-4afa-b7a9-df4c1eb0c629 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:07.938481 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cd149-8163-4afa-b7a9-df4c1eb0c629 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:07.938752 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cd149-8163-4afa-b7a9-df4c1eb0c629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:07.948553 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cd149-8163-4afa-b7a9-df4c1eb0c629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:07.950015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cd149-8163-4afa-b7a9-df4c1eb0c629 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:07.959940 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1256/2523] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:08.005886 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ae38c-6c9e-44c8-9834-0f41867352f2 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:08.007271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b65ae38c-6c9e-44c8-9834-0f41867352f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:08.019775 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ae38c-6c9e-44c8-9834-0f41867352f2 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:08.023610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94320f8b-7c6e-4b13-9440-9f529e2c4e75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:08.024581 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94320f8b-7c6e-4b13-9440-9f529e2c4e75 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:08.024902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94320f8b-7c6e-4b13-9440-9f529e2c4e75 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:08.025188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94320f8b-7c6e-4b13-9440-9f529e2c4e75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:08.083573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94320f8b-7c6e-4b13-9440-9f529e2c4e75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:08.085068 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94320f8b-7c6e-4b13-9440-9f529e2c4e75 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:08.095252 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1268/2524] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:13.345167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efa036-0a43-45b2-837a-ac2fe432a4f5 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:13.345636 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efa036-0a43-45b2-837a-ac2fe432a4f5 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:13.348257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efa036-0a43-45b2-837a-ac2fe432a4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:13.363491 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-53efa036-0a43-45b2-837a-ac2fe432a4f5 None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:13.364726 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-53efa036-0a43-45b2-837a-ac2fe432a4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:13.420041 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1257/2525] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Jun 27 15:06:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:13.542248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94320f8b-7c6e-4b13-9440-9f529e2c4e75 service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:13.543751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-94320f8b-7c6e-4b13-9440-9f529e2c4e75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:13.571445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:13.616901 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94320f8b-7c6e-4b13-9440-9f529e2c4e75 service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:13.623618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956b6d8-caf7-49a0-b788-f437ed2f969c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:13.624271 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956b6d8-caf7-49a0-b788-f437ed2f969c service swift] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:13.624557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956b6d8-caf7-49a0-b788-f437ed2f969c service swift] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:13.624870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956b6d8-caf7-49a0-b788-f437ed2f969c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:13.633404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956b6d8-caf7-49a0-b788-f437ed2f969c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:13.637497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956b6d8-caf7-49a0-b788-f437ed2f969c service swift] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:13.644009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1269/2526] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 15:06:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:06:13.736241 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efa036-0a43-45b2-837a-ac2fe432a4f5 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:13.817279 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efa036-0a43-45b2-837a-ac2fe432a4f5 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:13.823061 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592d90a-7478-4817-856b-7f5eec3690bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:13.823936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592d90a-7478-4817-856b-7f5eec3690bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:13.824213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592d90a-7478-4817-856b-7f5eec3690bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:13.824484 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592d90a-7478-4817-856b-7f5eec3690bf admin admin] PATH_INFO: `/v3/users/2e3d07e5e531464cabffe243123b4870` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:13.825892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592d90a-7478-4817-856b-7f5eec3690bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e3d07e5e531464cabffe243123b4870)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:13.827810 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592d90a-7478-4817-856b-7f5eec3690bf admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:14.035034 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1592d90a-7478-4817-856b-7f5eec3690bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e3d07e5e531464cabffe243123b4870'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:14.039822 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:14.050087 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1592d90a-7478-4817-856b-7f5eec3690bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e3d07e5e531464cabffe243123b4870'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:14.126110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1592d90a-7478-4817-856b-7f5eec3690bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e3d07e5e531464cabffe243123b4870'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:14.127066 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1592d90a-7478-4817-856b-7f5eec3690bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e3d07e5e531464cabffe243123b4870'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:14.142834 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-1592d90a-7478-4817-856b-7f5eec3690bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e3d07e5e531464cabffe243123b4870'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:14.153754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1258/2527] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:06:13 2022] DELETE /identity/v3/users/2e3d07e5e531464cabffe243123b4870 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:14.155624 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fb045-e36b-4b70-99b6-4ff6d2d69afa None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:14.156117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fb045-e36b-4b70-99b6-4ff6d2d69afa None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:14.156394 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fb045-e36b-4b70-99b6-4ff6d2d69afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:14.188804 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-2f7fb045-e36b-4b70-99b6-4ff6d2d69afa None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:14.190025 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2f7fb045-e36b-4b70-99b6-4ff6d2d69afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:14.267549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1270/2528] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:06:14.274143 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592d90a-7478-4817-856b-7f5eec3690bf admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:14.276296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-1592d90a-7478-4817-856b-7f5eec3690bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:14.344853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592d90a-7478-4817-856b-7f5eec3690bf admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:14.348965 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a502f4-4f5f-4a92-8c67-420237a9da62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:14.350280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a502f4-4f5f-4a92-8c67-420237a9da62 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:14.350555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a502f4-4f5f-4a92-8c67-420237a9da62 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:14.350885 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a502f4-4f5f-4a92-8c67-420237a9da62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:14.361452 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a502f4-4f5f-4a92-8c67-420237a9da62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:14.363305 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a502f4-4f5f-4a92-8c67-420237a9da62 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:14.376356 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1259/2529] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:14.888679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fb045-e36b-4b70-99b6-4ff6d2d69afa None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:14.890250 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2f7fb045-e36b-4b70-99b6-4ff6d2d69afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:14.903243 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fb045-e36b-4b70-99b6-4ff6d2d69afa None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:14.908344 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4fee4-2723-42e7-8e85-f658670f6798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:14.909381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4fee4-2723-42e7-8e85-f658670f6798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:14.909865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4fee4-2723-42e7-8e85-f658670f6798 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:14.910237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4fee4-2723-42e7-8e85-f658670f6798 admin admin] PATH_INFO: `/v3/projects/8c5e690975224d22b2c76c1a0e0a97ff` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:14.912209 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4fee4-2723-42e7-8e85-f658670f6798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c5e690975224d22b2c76c1a0e0a97ff)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:14.914506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4fee4-2723-42e7-8e85-f658670f6798 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:15.030312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d8f4fee4-2723-42e7-8e85-f658670f6798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c5e690975224d22b2c76c1a0e0a97ff', 'request_id': 'req-d8f4fee4-2723-42e7-8e85-f658670f6798'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:15.038270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d8f4fee4-2723-42e7-8e85-f658670f6798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c5e690975224d22b2c76c1a0e0a97ff', 'request_id': 'req-d8f4fee4-2723-42e7-8e85-f658670f6798'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:15.107470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d8f4fee4-2723-42e7-8e85-f658670f6798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c5e690975224d22b2c76c1a0e0a97ff', 'request_id': 'req-d8f4fee4-2723-42e7-8e85-f658670f6798'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:15.124366 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d8f4fee4-2723-42e7-8e85-f658670f6798 admin admin] The token cache is being invalidate because project 8c5e690975224d22b2c76c1a0e0a97ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:06:15.130749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d8f4fee4-2723-42e7-8e85-f658670f6798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:15.130749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d8f4fee4-2723-42e7-8e85-f658670f6798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:15.130749 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1271/2530] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:06:14 2022] DELETE /identity/v3/projects/8c5e690975224d22b2c76c1a0e0a97ff => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:15.133221 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a502f4-4f5f-4a92-8c67-420237a9da62 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:15.144446 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a502f4-4f5f-4a92-8c67-420237a9da62 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:15.226840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413630c9-8ab8-4af1-858a-286c3eac176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:15.228405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413630c9-8ab8-4af1-858a-286c3eac176f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:15.228838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413630c9-8ab8-4af1-858a-286c3eac176f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:15.229413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413630c9-8ab8-4af1-858a-286c3eac176f admin admin] PATH_INFO: `/v3/users/d1c1b125e42b405da2b412c0f768820e` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:15.230943 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413630c9-8ab8-4af1-858a-286c3eac176f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c1b125e42b405da2b412c0f768820e)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:15.232984 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413630c9-8ab8-4af1-858a-286c3eac176f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:15.412096 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-413630c9-8ab8-4af1-858a-286c3eac176f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c1b125e42b405da2b412c0f768820e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:15.427472 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-413630c9-8ab8-4af1-858a-286c3eac176f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c1b125e42b405da2b412c0f768820e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:15.502872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-413630c9-8ab8-4af1-858a-286c3eac176f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c1b125e42b405da2b412c0f768820e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:15.503847 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-413630c9-8ab8-4af1-858a-286c3eac176f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c1b125e42b405da2b412c0f768820e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:15.506427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:15.516190 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-413630c9-8ab8-4af1-858a-286c3eac176f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c1b125e42b405da2b412c0f768820e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:15.527645 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1260/2531] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:06:15 2022] DELETE /identity/v3/users/d1c1b125e42b405da2b412c0f768820e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:16.020460 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4fee4-2723-42e7-8e85-f658670f6798 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:16.022058 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d8f4fee4-2723-42e7-8e85-f658670f6798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:16.049056 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4fee4-2723-42e7-8e85-f658670f6798 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:16.139153 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:16.172171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a225e69-ba95-4097-809d-0b0114ab137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:16.173080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a225e69-ba95-4097-809d-0b0114ab137c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:16.173428 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a225e69-ba95-4097-809d-0b0114ab137c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:16.173796 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a225e69-ba95-4097-809d-0b0114ab137c admin admin] PATH_INFO: `/v3/projects/b40d756df6e840848f35981d8e2571ad` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:16.175076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a225e69-ba95-4097-809d-0b0114ab137c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40d756df6e840848f35981d8e2571ad)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:16.177121 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a225e69-ba95-4097-809d-0b0114ab137c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:16.296197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a225e69-ba95-4097-809d-0b0114ab137c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40d756df6e840848f35981d8e2571ad', 'request_id': 'req-4a225e69-ba95-4097-809d-0b0114ab137c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:16.303696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a225e69-ba95-4097-809d-0b0114ab137c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40d756df6e840848f35981d8e2571ad', 'request_id': 'req-4a225e69-ba95-4097-809d-0b0114ab137c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:16.360485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a225e69-ba95-4097-809d-0b0114ab137c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40d756df6e840848f35981d8e2571ad', 'request_id': 'req-4a225e69-ba95-4097-809d-0b0114ab137c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:16.375778 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a225e69-ba95-4097-809d-0b0114ab137c admin admin] The token cache is being invalidate because project b40d756df6e840848f35981d8e2571ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:06:16.376403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a225e69-ba95-4097-809d-0b0114ab137c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:16.377304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a225e69-ba95-4097-809d-0b0114ab137c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:16.382470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1272/2532] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:06:16 2022] DELETE /identity/v3/projects/b40d756df6e840848f35981d8e2571ad => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:16.384678 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb268adb-cadb-4ff0-b2a7-bc9fe00b3b88 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:16.385095 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb268adb-cadb-4ff0-b2a7-bc9fe00b3b88 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:16.385507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb268adb-cadb-4ff0-b2a7-bc9fe00b3b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:16.442442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-bb268adb-cadb-4ff0-b2a7-bc9fe00b3b88 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:16.443786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-bb268adb-cadb-4ff0-b2a7-bc9fe00b3b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:16.540737 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1261/2533] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:06:16.549295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13001cf2-4b18-4558-918c-e608a2dd91f2 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:16.549682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13001cf2-4b18-4558-918c-e608a2dd91f2 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:16.550028 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13001cf2-4b18-4558-918c-e608a2dd91f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:16.572768 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-13001cf2-4b18-4558-918c-e608a2dd91f2 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:16.574151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-13001cf2-4b18-4558-918c-e608a2dd91f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:16.750017 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1273/2534] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:16.753332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb268adb-cadb-4ff0-b2a7-bc9fe00b3b88 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:16.763591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb268adb-cadb-4ff0-b2a7-bc9fe00b3b88 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:16.768536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29807e3-36fb-435b-a318-df313e4f1b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:16.769276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29807e3-36fb-435b-a318-df313e4f1b0c admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:16.769611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29807e3-36fb-435b-a318-df313e4f1b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:16.769918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29807e3-36fb-435b-a318-df313e4f1b0c admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:16.770746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29807e3-36fb-435b-a318-df313e4f1b0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:06:16.771107 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29807e3-36fb-435b-a318-df313e4f1b0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:16.772715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29807e3-36fb-435b-a318-df313e4f1b0c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:16.785692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1262/2535] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:06:16.798253 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13001cf2-4b18-4558-918c-e608a2dd91f2 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:16.808211 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13001cf2-4b18-4558-918c-e608a2dd91f2 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:16.812957 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b26a0-b506-4edd-aed1-6d9efb503b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:16.813599 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b26a0-b506-4edd-aed1-6d9efb503b06 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:16.813884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b26a0-b506-4edd-aed1-6d9efb503b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:16.814160 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b26a0-b506-4edd-aed1-6d9efb503b06 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:16.814861 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b26a0-b506-4edd-aed1-6d9efb503b06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:16.816763 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b26a0-b506-4edd-aed1-6d9efb503b06 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:17.008348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1274/2536] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:06:16 2022] POST /identity/v3/projects => generated 409 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:17.013157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29807e3-36fb-435b-a318-df313e4f1b0c admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:17.023171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29807e3-36fb-435b-a318-df313e4f1b0c admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:17.082839 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49cb95-a4e1-426c-a5a5-be61090f0e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:17.083798 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49cb95-a4e1-426c-a5a5-be61090f0e1f admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:17.084161 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49cb95-a4e1-426c-a5a5-be61090f0e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:17.084410 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49cb95-a4e1-426c-a5a5-be61090f0e1f admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:17.085138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49cb95-a4e1-426c-a5a5-be61090f0e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:17.087815 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49cb95-a4e1-426c-a5a5-be61090f0e1f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:17.162138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1263/2537] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:06:17 2022] POST /identity/v3/users => generated 305 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:17.166157 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b26a0-b506-4edd-aed1-6d9efb503b06 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:17.187569 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b26a0-b506-4edd-aed1-6d9efb503b06 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:17.193299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6776a7-ec6d-4b2f-9e3e-2db09df011c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:17.194260 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6776a7-ec6d-4b2f-9e3e-2db09df011c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:17.194581 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6776a7-ec6d-4b2f-9e3e-2db09df011c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:17.194867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6776a7-ec6d-4b2f-9e3e-2db09df011c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:17.195692 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6776a7-ec6d-4b2f-9e3e-2db09df011c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:17.198691 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6776a7-ec6d-4b2f-9e3e-2db09df011c0 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:17.213801 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1275/2538] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:06:17.217826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49cb95-a4e1-426c-a5a5-be61090f0e1f admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:17.233872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49cb95-a4e1-426c-a5a5-be61090f0e1f admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:17.242524 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d754f5f-612c-49b8-9419-42298cede3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:17.243555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d754f5f-612c-49b8-9419-42298cede3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:17.244117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d754f5f-612c-49b8-9419-42298cede3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:17.244871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d754f5f-612c-49b8-9419-42298cede3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:17.245731 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d754f5f-612c-49b8-9419-42298cede3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:17.247604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d754f5f-612c-49b8-9419-42298cede3f2 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:17.263952 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1264/2539] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:06:17.268487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6776a7-ec6d-4b2f-9e3e-2db09df011c0 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:17.279285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6776a7-ec6d-4b2f-9e3e-2db09df011c0 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:17.286934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96eb48-5ee0-4116-92aa-ea5dbe979ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:17.287870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96eb48-5ee0-4116-92aa-ea5dbe979ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:17.288167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96eb48-5ee0-4116-92aa-ea5dbe979ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:17.295754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96eb48-5ee0-4116-92aa-ea5dbe979ca7 admin admin] PATH_INFO: `/v3/projects/17383fa4f35941aca611ef11e360b1c2/users/56f9dd76dfb946eb87e58563e82196f2/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:17.315417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96eb48-5ee0-4116-92aa-ea5dbe979ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17383fa4f35941aca611ef11e360b1c2, user_id=56f9dd76dfb946eb87e58563e82196f2, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:17.318350 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96eb48-5ee0-4116-92aa-ea5dbe979ca7 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:17.390962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1276/2540] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:17 2022] PUT /identity/v3/projects/17383fa4f35941aca611ef11e360b1c2/users/56f9dd76dfb946eb87e58563e82196f2/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:17.402412 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182d467-87eb-4525-9b02-56ec70961c8b None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:17.403659 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182d467-87eb-4525-9b02-56ec70961c8b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:17.403659 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182d467-87eb-4525-9b02-56ec70961c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:17.435206 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f182d467-87eb-4525-9b02-56ec70961c8b None None] MFA Rules not processed for user `56f9dd76dfb946eb87e58563e82196f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:17.438049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f182d467-87eb-4525-9b02-56ec70961c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:17.492706 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:17.521418 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1265/2541] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:17 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:17.529033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96eb48-5ee0-4116-92aa-ea5dbe979ca7 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:17.604274 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96eb48-5ee0-4116-92aa-ea5dbe979ca7 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:17.609802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde81a0-ee39-4b6a-b042-b197867489c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:17.610713 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde81a0-ee39-4b6a-b042-b197867489c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:17.610996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde81a0-ee39-4b6a-b042-b197867489c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:17.611272 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde81a0-ee39-4b6a-b042-b197867489c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:17.611983 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde81a0-ee39-4b6a-b042-b197867489c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:17.613937 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde81a0-ee39-4b6a-b042-b197867489c7 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:17.620236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:17.715475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1277/2542] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:06:17 2022] POST /identity/v3/projects => generated 409 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:06:17.716863 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182d467-87eb-4525-9b02-56ec70961c8b None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:17.733843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182d467-87eb-4525-9b02-56ec70961c8b None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:17.875213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743b7bf-f37f-4135-8be7-1eed5c2e1f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:17.876324 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743b7bf-f37f-4135-8be7-1eed5c2e1f8f admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:17.879316 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743b7bf-f37f-4135-8be7-1eed5c2e1f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:17.888048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743b7bf-f37f-4135-8be7-1eed5c2e1f8f admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:17.888048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743b7bf-f37f-4135-8be7-1eed5c2e1f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:17.888048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743b7bf-f37f-4135-8be7-1eed5c2e1f8f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:18.037699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1266/2543] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:06:17 2022] POST /identity/v3/users => generated 311 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:18.042264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde81a0-ee39-4b6a-b042-b197867489c7 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:18.053696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde81a0-ee39-4b6a-b042-b197867489c7 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:18.059613 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef2012-0a8b-426f-aaad-8ec5d9c08873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:18.060631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef2012-0a8b-426f-aaad-8ec5d9c08873 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:18.061170 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef2012-0a8b-426f-aaad-8ec5d9c08873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:18.061454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef2012-0a8b-426f-aaad-8ec5d9c08873 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:18.062247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef2012-0a8b-426f-aaad-8ec5d9c08873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:18.063908 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef2012-0a8b-426f-aaad-8ec5d9c08873 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:18.079926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1278/2544] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:18.083804 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743b7bf-f37f-4135-8be7-1eed5c2e1f8f admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:18.096986 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743b7bf-f37f-4135-8be7-1eed5c2e1f8f admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:18.104334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65741a6-c9b6-4c9f-9028-76227edf7bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:18.105261 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65741a6-c9b6-4c9f-9028-76227edf7bba admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:18.105541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65741a6-c9b6-4c9f-9028-76227edf7bba admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:18.105983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65741a6-c9b6-4c9f-9028-76227edf7bba admin admin] PATH_INFO: `/v3/projects/f0523db3db384d27bf14118ca2d3ae86/users/99e2bbe09abc4cbfac7d059efc5847fa/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:18.123327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65741a6-c9b6-4c9f-9028-76227edf7bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0523db3db384d27bf14118ca2d3ae86, user_id=99e2bbe09abc4cbfac7d059efc5847fa, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:18.126003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65741a6-c9b6-4c9f-9028-76227edf7bba admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:18.188156 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1267/2545] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:18 2022] PUT /identity/v3/projects/f0523db3db384d27bf14118ca2d3ae86/users/99e2bbe09abc4cbfac7d059efc5847fa/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:18.189513 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef2012-0a8b-426f-aaad-8ec5d9c08873 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:18.201601 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef2012-0a8b-426f-aaad-8ec5d9c08873 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:18.270800 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21254b67-2ca9-497a-afa0-319aef57c266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:18.271677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21254b67-2ca9-497a-afa0-319aef57c266 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:18.271804 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21254b67-2ca9-497a-afa0-319aef57c266 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:18.272069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21254b67-2ca9-497a-afa0-319aef57c266 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:18.276925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21254b67-2ca9-497a-afa0-319aef57c266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:18.276925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21254b67-2ca9-497a-afa0-319aef57c266 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:18.297666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1279/2546] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:18.298858 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65741a6-c9b6-4c9f-9028-76227edf7bba admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:18.327415 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65741a6-c9b6-4c9f-9028-76227edf7bba admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:18.344763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279d1ab-3f32-4c86-b6c6-634ea805fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:18.344763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279d1ab-3f32-4c86-b6c6-634ea805fa73 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:18.344763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279d1ab-3f32-4c86-b6c6-634ea805fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:18.344763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279d1ab-3f32-4c86-b6c6-634ea805fa73 admin admin] PATH_INFO: `/v3/projects/f0523db3db384d27bf14118ca2d3ae86/users/99e2bbe09abc4cbfac7d059efc5847fa/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:18.345793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279d1ab-3f32-4c86-b6c6-634ea805fa73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0523db3db384d27bf14118ca2d3ae86, user_id=99e2bbe09abc4cbfac7d059efc5847fa, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:18.348410 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279d1ab-3f32-4c86-b6c6-634ea805fa73 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:18.372442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1268/2547] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:18 2022] PUT /identity/v3/projects/f0523db3db384d27bf14118ca2d3ae86/users/99e2bbe09abc4cbfac7d059efc5847fa/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:18.390130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80924362-2856-4917-93c7-ab73fae7bf3b None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:18.400998 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80924362-2856-4917-93c7-ab73fae7bf3b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:18.401467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80924362-2856-4917-93c7-ab73fae7bf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:18.444773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-80924362-2856-4917-93c7-ab73fae7bf3b None None] MFA Rules not processed for user `99e2bbe09abc4cbfac7d059efc5847fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:18.446137 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-80924362-2856-4917-93c7-ab73fae7bf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:18.558879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1280/2548] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:18 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:18.569070 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279d1ab-3f32-4c86-b6c6-634ea805fa73 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:18.571987 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-3279d1ab-3f32-4c86-b6c6-634ea805fa73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:18.658692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279d1ab-3f32-4c86-b6c6-634ea805fa73 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:18.667615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1b3fd-986e-4716-a4f8-d86e61ebab4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:18.668370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1b3fd-986e-4716-a4f8-d86e61ebab4e service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:18.668758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1b3fd-986e-4716-a4f8-d86e61ebab4e service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:18.669110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1b3fd-986e-4716-a4f8-d86e61ebab4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:18.680671 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1b3fd-986e-4716-a4f8-d86e61ebab4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:18.683032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1b3fd-986e-4716-a4f8-d86e61ebab4e service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:18.693534 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1269/2549] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:18 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:19.020358 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80924362-2856-4917-93c7-ab73fae7bf3b None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:19.032374 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80924362-2856-4917-93c7-ab73fae7bf3b None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:19.036723 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af70b0-c894-419a-aeff-0831c88970af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:19.037384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af70b0-c894-419a-aeff-0831c88970af service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:19.037666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af70b0-c894-419a-aeff-0831c88970af service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:19.037964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af70b0-c894-419a-aeff-0831c88970af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:19.117600 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:19.121764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af70b0-c894-419a-aeff-0831c88970af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:19.123226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af70b0-c894-419a-aeff-0831c88970af service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:19.143595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1281/2550] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:19 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:21.775975 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1b3fd-986e-4716-a4f8-d86e61ebab4e service cinder] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:21.777499 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8bc1b3fd-986e-4716-a4f8-d86e61ebab4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:21.834572 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:21.848405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1b3fd-986e-4716-a4f8-d86e61ebab4e service cinder] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:21.853383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7856fe6-0570-4fd2-86e7-0ea8bd052b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:21.854288 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7856fe6-0570-4fd2-86e7-0ea8bd052b33 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:21.854647 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7856fe6-0570-4fd2-86e7-0ea8bd052b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:21.854940 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7856fe6-0570-4fd2-86e7-0ea8bd052b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:21.857195 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-a7856fe6-0570-4fd2-86e7-0ea8bd052b33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:21.929394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7856fe6-0570-4fd2-86e7-0ea8bd052b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:21.931304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7856fe6-0570-4fd2-86e7-0ea8bd052b33 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:21.942181 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1270/2551] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:26.638887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af70b0-c894-419a-aeff-0831c88970af service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:26.645509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-38af70b0-c894-419a-aeff-0831c88970af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:26.653801 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af70b0-c894-419a-aeff-0831c88970af service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:26.658010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758bdcd-49c2-4a11-91df-5e3cfa6149a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:26.658648 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758bdcd-49c2-4a11-91df-5e3cfa6149a4 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:26.658928 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758bdcd-49c2-4a11-91df-5e3cfa6149a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:26.659205 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758bdcd-49c2-4a11-91df-5e3cfa6149a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:26.661002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f758bdcd-49c2-4a11-91df-5e3cfa6149a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:26.671928 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758bdcd-49c2-4a11-91df-5e3cfa6149a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:26.673440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758bdcd-49c2-4a11-91df-5e3cfa6149a4 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:26.682721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1282/2552] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:31.270974 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7856fe6-0570-4fd2-86e7-0ea8bd052b33 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:31.332777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7856fe6-0570-4fd2-86e7-0ea8bd052b33 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:31.337399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f67cb6-c3ed-4de0-8b1f-1f57b5930cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:31.338272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f67cb6-c3ed-4de0-8b1f-1f57b5930cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:31.339117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f67cb6-c3ed-4de0-8b1f-1f57b5930cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:31.339397 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f67cb6-c3ed-4de0-8b1f-1f57b5930cc3 admin admin] PATH_INFO: `/v3/users/56f9dd76dfb946eb87e58563e82196f2` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:31.341309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f67cb6-c3ed-4de0-8b1f-1f57b5930cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f9dd76dfb946eb87e58563e82196f2)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:31.343375 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f67cb6-c3ed-4de0-8b1f-1f57b5930cc3 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:31.585928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-09f67cb6-c3ed-4de0-8b1f-1f57b5930cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f9dd76dfb946eb87e58563e82196f2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:31.597677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-09f67cb6-c3ed-4de0-8b1f-1f57b5930cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f9dd76dfb946eb87e58563e82196f2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:31.681360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-09f67cb6-c3ed-4de0-8b1f-1f57b5930cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f9dd76dfb946eb87e58563e82196f2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:31.682036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-09f67cb6-c3ed-4de0-8b1f-1f57b5930cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f9dd76dfb946eb87e58563e82196f2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:31.690618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-09f67cb6-c3ed-4de0-8b1f-1f57b5930cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f9dd76dfb946eb87e58563e82196f2'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:31.698112 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1271/2553] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:06:31 2022] DELETE /identity/v3/users/56f9dd76dfb946eb87e58563e82196f2 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:31.703523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b10cb-ca0c-4d72-a36b-e030f79ea025 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:31.704063 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b10cb-ca0c-4d72-a36b-e030f79ea025 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:31.704157 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b10cb-ca0c-4d72-a36b-e030f79ea025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:31.721898 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-f75b10cb-ca0c-4d72-a36b-e030f79ea025 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:31.723097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f75b10cb-ca0c-4d72-a36b-e030f79ea025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:31.784044 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1283/2554] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:31.795232 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f67cb6-c3ed-4de0-8b1f-1f57b5930cc3 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:31.796662 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-09f67cb6-c3ed-4de0-8b1f-1f57b5930cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:31.810897 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:31.857959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f67cb6-c3ed-4de0-8b1f-1f57b5930cc3 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:31.861611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170adb37-bbdc-4818-b546-e547efb1f792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:31.862260 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170adb37-bbdc-4818-b546-e547efb1f792 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:31.862551 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170adb37-bbdc-4818-b546-e547efb1f792 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:31.863335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170adb37-bbdc-4818-b546-e547efb1f792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:31.874945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170adb37-bbdc-4818-b546-e547efb1f792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:31.882376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170adb37-bbdc-4818-b546-e547efb1f792 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:31.886165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1272/2555] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:32.328553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b10cb-ca0c-4d72-a36b-e030f79ea025 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:32.328803 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f75b10cb-ca0c-4d72-a36b-e030f79ea025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:32.341098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b10cb-ca0c-4d72-a36b-e030f79ea025 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:32.345682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a8d93-1157-4b16-9af5-3b4a5f843c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:32.346547 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a8d93-1157-4b16-9af5-3b4a5f843c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:32.346823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a8d93-1157-4b16-9af5-3b4a5f843c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:32.347095 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a8d93-1157-4b16-9af5-3b4a5f843c50 admin admin] PATH_INFO: `/v3/projects/17383fa4f35941aca611ef11e360b1c2` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:32.348281 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a8d93-1157-4b16-9af5-3b4a5f843c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17383fa4f35941aca611ef11e360b1c2)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:32.350286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a8d93-1157-4b16-9af5-3b4a5f843c50 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:32.453256 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-360a8d93-1157-4b16-9af5-3b4a5f843c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17383fa4f35941aca611ef11e360b1c2', 'request_id': 'req-360a8d93-1157-4b16-9af5-3b4a5f843c50'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:32.459996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-360a8d93-1157-4b16-9af5-3b4a5f843c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17383fa4f35941aca611ef11e360b1c2', 'request_id': 'req-360a8d93-1157-4b16-9af5-3b4a5f843c50'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:32.525545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-360a8d93-1157-4b16-9af5-3b4a5f843c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17383fa4f35941aca611ef11e360b1c2', 'request_id': 'req-360a8d93-1157-4b16-9af5-3b4a5f843c50'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:32.537122 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-360a8d93-1157-4b16-9af5-3b4a5f843c50 admin admin] The token cache is being invalidate because project 17383fa4f35941aca611ef11e360b1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:06:32.537402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-360a8d93-1157-4b16-9af5-3b4a5f843c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:32.538025 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-360a8d93-1157-4b16-9af5-3b4a5f843c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:32.539563 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1284/2556] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:06:32 2022] DELETE /identity/v3/projects/17383fa4f35941aca611ef11e360b1c2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:06:32.544216 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170adb37-bbdc-4818-b546-e547efb1f792 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:32.553955 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170adb37-bbdc-4818-b546-e547efb1f792 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:32.610631 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49021e14-b8d6-46e6-be0c-103e75f887d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:32.611420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49021e14-b8d6-46e6-be0c-103e75f887d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:32.611698 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49021e14-b8d6-46e6-be0c-103e75f887d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:32.611971 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49021e14-b8d6-46e6-be0c-103e75f887d6 admin admin] PATH_INFO: `/v3/users/99e2bbe09abc4cbfac7d059efc5847fa` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:32.613233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49021e14-b8d6-46e6-be0c-103e75f887d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99e2bbe09abc4cbfac7d059efc5847fa)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:32.615138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49021e14-b8d6-46e6-be0c-103e75f887d6 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:32.849209 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-49021e14-b8d6-46e6-be0c-103e75f887d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99e2bbe09abc4cbfac7d059efc5847fa'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:32.861575 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-49021e14-b8d6-46e6-be0c-103e75f887d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99e2bbe09abc4cbfac7d059efc5847fa'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:32.936905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-49021e14-b8d6-46e6-be0c-103e75f887d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99e2bbe09abc4cbfac7d059efc5847fa'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:32.937558 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-49021e14-b8d6-46e6-be0c-103e75f887d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99e2bbe09abc4cbfac7d059efc5847fa'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:32.945207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-49021e14-b8d6-46e6-be0c-103e75f887d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99e2bbe09abc4cbfac7d059efc5847fa'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:32.951713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1273/2557] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:06:32 2022] DELETE /identity/v3/users/99e2bbe09abc4cbfac7d059efc5847fa => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:33.390261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a8d93-1157-4b16-9af5-3b4a5f843c50 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:33.391841 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-360a8d93-1157-4b16-9af5-3b4a5f843c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:33.407962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a8d93-1157-4b16-9af5-3b4a5f843c50 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:33.477283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead8e24-7c14-49c9-b5ac-1b030b36d07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:33.478151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead8e24-7c14-49c9-b5ac-1b030b36d07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:33.478438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead8e24-7c14-49c9-b5ac-1b030b36d07e admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:33.478714 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead8e24-7c14-49c9-b5ac-1b030b36d07e admin admin] PATH_INFO: `/v3/projects/f0523db3db384d27bf14118ca2d3ae86` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:33.479903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead8e24-7c14-49c9-b5ac-1b030b36d07e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0523db3db384d27bf14118ca2d3ae86)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:33.481876 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead8e24-7c14-49c9-b5ac-1b030b36d07e admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:33.490888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:33.630536 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-aead8e24-7c14-49c9-b5ac-1b030b36d07e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0523db3db384d27bf14118ca2d3ae86', 'request_id': 'req-aead8e24-7c14-49c9-b5ac-1b030b36d07e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:33.637143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-aead8e24-7c14-49c9-b5ac-1b030b36d07e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0523db3db384d27bf14118ca2d3ae86', 'request_id': 'req-aead8e24-7c14-49c9-b5ac-1b030b36d07e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:33.726048 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-aead8e24-7c14-49c9-b5ac-1b030b36d07e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0523db3db384d27bf14118ca2d3ae86', 'request_id': 'req-aead8e24-7c14-49c9-b5ac-1b030b36d07e'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:33.739514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-aead8e24-7c14-49c9-b5ac-1b030b36d07e admin admin] The token cache is being invalidate because project f0523db3db384d27bf14118ca2d3ae86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:06:33.739872 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-aead8e24-7c14-49c9-b5ac-1b030b36d07e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:33.740450 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-aead8e24-7c14-49c9-b5ac-1b030b36d07e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:33.742497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1285/2558] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:06:33 2022] DELETE /identity/v3/projects/f0523db3db384d27bf14118ca2d3ae86 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:33.748386 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30873eda-c29e-4cc3-853e-081dd199925b None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:33.749830 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30873eda-c29e-4cc3-853e-081dd199925b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:33.750293 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30873eda-c29e-4cc3-853e-081dd199925b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:33.770225 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-30873eda-c29e-4cc3-853e-081dd199925b None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:33.771429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-30873eda-c29e-4cc3-853e-081dd199925b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:33.811875 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:33.844532 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1274/2559] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:06:33.852527 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d5733-b704-4ba9-b873-5edff2f23f36 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:33.852851 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d5733-b704-4ba9-b873-5edff2f23f36 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:33.853156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d5733-b704-4ba9-b873-5edff2f23f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:33.872874 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1e7d5733-b704-4ba9-b873-5edff2f23f36 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:33.874190 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1e7d5733-b704-4ba9-b873-5edff2f23f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:33.882352 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1286/2560] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:06:33.886691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30873eda-c29e-4cc3-853e-081dd199925b None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:33.898815 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30873eda-c29e-4cc3-853e-081dd199925b None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:33.904258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81df9e-a2d7-4e5e-aa0e-d21446bd1237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:33.905764 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81df9e-a2d7-4e5e-aa0e-d21446bd1237 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:33.906101 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81df9e-a2d7-4e5e-aa0e-d21446bd1237 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:33.915346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81df9e-a2d7-4e5e-aa0e-d21446bd1237 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:33.915346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81df9e-a2d7-4e5e-aa0e-d21446bd1237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:06:33.915346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81df9e-a2d7-4e5e-aa0e-d21446bd1237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:33.915346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81df9e-a2d7-4e5e-aa0e-d21446bd1237 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:33.923246 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1275/2561] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:06:33.927375 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d5733-b704-4ba9-b873-5edff2f23f36 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:33.937648 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d5733-b704-4ba9-b873-5edff2f23f36 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:33.944942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa5955-564a-410d-b7eb-a7313a47d55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:33.945650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa5955-564a-410d-b7eb-a7313a47d55e admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:33.945964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa5955-564a-410d-b7eb-a7313a47d55e admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:33.946248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa5955-564a-410d-b7eb-a7313a47d55e admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:33.946963 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa5955-564a-410d-b7eb-a7313a47d55e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:33.948943 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa5955-564a-410d-b7eb-a7313a47d55e admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:34.012840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1287/2562] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:06:33 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:06:34.017045 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81df9e-a2d7-4e5e-aa0e-d21446bd1237 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:34.027354 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81df9e-a2d7-4e5e-aa0e-d21446bd1237 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:34.095582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758fdcd-fafc-4b70-a6a5-c882f6eaa185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:34.096253 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758fdcd-fafc-4b70-a6a5-c882f6eaa185 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:34.096534 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758fdcd-fafc-4b70-a6a5-c882f6eaa185 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:34.096852 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758fdcd-fafc-4b70-a6a5-c882f6eaa185 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:34.097592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758fdcd-fafc-4b70-a6a5-c882f6eaa185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:34.099561 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758fdcd-fafc-4b70-a6a5-c882f6eaa185 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:34.161160 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1276/2563] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:06:34 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:06:34.165033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa5955-564a-410d-b7eb-a7313a47d55e admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:34.175856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa5955-564a-410d-b7eb-a7313a47d55e admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:34.180836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859af32-9967-4455-825f-c359d1f0c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:34.181510 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859af32-9967-4455-825f-c359d1f0c8ce admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:34.181789 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859af32-9967-4455-825f-c359d1f0c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:34.182061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859af32-9967-4455-825f-c359d1f0c8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:34.182817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859af32-9967-4455-825f-c359d1f0c8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:34.184385 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859af32-9967-4455-825f-c359d1f0c8ce admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:34.195036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1288/2564] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:06:34.199167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758fdcd-fafc-4b70-a6a5-c882f6eaa185 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:34.209859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758fdcd-fafc-4b70-a6a5-c882f6eaa185 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:34.214396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af36c1e-f4ab-459c-a949-5e1dc3f402da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:34.215041 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af36c1e-f4ab-459c-a949-5e1dc3f402da admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:34.215394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af36c1e-f4ab-459c-a949-5e1dc3f402da admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:34.215779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af36c1e-f4ab-459c-a949-5e1dc3f402da admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:34.216506 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af36c1e-f4ab-459c-a949-5e1dc3f402da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:34.218735 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af36c1e-f4ab-459c-a949-5e1dc3f402da admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:34.229497 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1277/2565] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:34.233802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859af32-9967-4455-825f-c359d1f0c8ce admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:34.244040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859af32-9967-4455-825f-c359d1f0c8ce admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:34.249288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c707-7779-4b9a-b78a-f72f498a377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:34.250181 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c707-7779-4b9a-b78a-f72f498a377c admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:34.250481 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c707-7779-4b9a-b78a-f72f498a377c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:34.250761 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c707-7779-4b9a-b78a-f72f498a377c admin admin] PATH_INFO: `/v3/projects/e35d4087035c4ffe8af022e1f1a70bae/users/4a67b4e10de549f388b1d30a8802c687/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:34.267195 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64c707-7779-4b9a-b78a-f72f498a377c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35d4087035c4ffe8af022e1f1a70bae, user_id=4a67b4e10de549f388b1d30a8802c687, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:34.270752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64c707-7779-4b9a-b78a-f72f498a377c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:34.344533 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1289/2566] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:34 2022] PUT /identity/v3/projects/e35d4087035c4ffe8af022e1f1a70bae/users/4a67b4e10de549f388b1d30a8802c687/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:34.354999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2bd07-4562-4292-8713-561318419da6 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:34.356387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2bd07-4562-4292-8713-561318419da6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:34.356387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2bd07-4562-4292-8713-561318419da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:34.386250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-4cc2bd07-4562-4292-8713-561318419da6 None None] MFA Rules not processed for user `4a67b4e10de549f388b1d30a8802c687`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:34.388168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-4cc2bd07-4562-4292-8713-561318419da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:34.457527 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1278/2567] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:34.461957 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c707-7779-4b9a-b78a-f72f498a377c admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:34.524953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c707-7779-4b9a-b78a-f72f498a377c admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:34.529727 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1475833-b01e-4a7a-86ac-a2d4d341d76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:34.530607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1475833-b01e-4a7a-86ac-a2d4d341d76f admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:34.530897 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1475833-b01e-4a7a-86ac-a2d4d341d76f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:34.531180 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1475833-b01e-4a7a-86ac-a2d4d341d76f admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:34.531873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1475833-b01e-4a7a-86ac-a2d4d341d76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:34.533801 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1475833-b01e-4a7a-86ac-a2d4d341d76f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:34.647821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1290/2568] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:06:34 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:34.651827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2bd07-4562-4292-8713-561318419da6 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:34.663128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2bd07-4562-4292-8713-561318419da6 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:34.689833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:34.720669 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4200936-0aa9-4d21-95fb-90680136515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:34.721371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4200936-0aa9-4d21-95fb-90680136515c admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:34.721657 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4200936-0aa9-4d21-95fb-90680136515c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:34.721977 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4200936-0aa9-4d21-95fb-90680136515c admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:34.722625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4200936-0aa9-4d21-95fb-90680136515c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:34.724531 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4200936-0aa9-4d21-95fb-90680136515c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:34.797346 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1279/2569] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:06:34 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:34.798695 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1475833-b01e-4a7a-86ac-a2d4d341d76f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:34.809288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1475833-b01e-4a7a-86ac-a2d4d341d76f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:34.814502 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a8ebf-10b0-4b33-a5f5-8999158bc7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:34.815185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a8ebf-10b0-4b33-a5f5-8999158bc7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:34.815424 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a8ebf-10b0-4b33-a5f5-8999158bc7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:34.815699 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a8ebf-10b0-4b33-a5f5-8999158bc7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:34.816451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a8ebf-10b0-4b33-a5f5-8999158bc7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:34.818093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a8ebf-10b0-4b33-a5f5-8999158bc7a5 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:34.830569 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1291/2570] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:34.834691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4200936-0aa9-4d21-95fb-90680136515c admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:34.845630 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4200936-0aa9-4d21-95fb-90680136515c admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:34.850671 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704266c1-dcd9-456f-87d2-156e24c72f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:34.851332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704266c1-dcd9-456f-87d2-156e24c72f2a admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:34.851619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704266c1-dcd9-456f-87d2-156e24c72f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:34.851891 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704266c1-dcd9-456f-87d2-156e24c72f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:34.852620 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704266c1-dcd9-456f-87d2-156e24c72f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:34.854280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704266c1-dcd9-456f-87d2-156e24c72f2a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:34.865340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1280/2571] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:34.869476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a8ebf-10b0-4b33-a5f5-8999158bc7a5 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:34.880668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a8ebf-10b0-4b33-a5f5-8999158bc7a5 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:34.885390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cb247-cdb4-4ae0-b828-5449de81bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:34.886272 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cb247-cdb4-4ae0-b828-5449de81bae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:34.886563 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cb247-cdb4-4ae0-b828-5449de81bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:34.886844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cb247-cdb4-4ae0-b828-5449de81bae2 admin admin] PATH_INFO: `/v3/projects/dbc05e01160048c3a21ce336a1240175/users/e58c10761fd74889b508ea9a9e0b8dc1/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:34.889206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:34.902651 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cb247-cdb4-4ae0-b828-5449de81bae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc05e01160048c3a21ce336a1240175, user_id=e58c10761fd74889b508ea9a9e0b8dc1, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:34.905426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cb247-cdb4-4ae0-b828-5449de81bae2 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:34.972097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1292/2572] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:34 2022] PUT /identity/v3/projects/dbc05e01160048c3a21ce336a1240175/users/e58c10761fd74889b508ea9a9e0b8dc1/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:35.039990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d4623-cc25-4983-b868-f752c90ed0bb None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:35.040369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d4623-cc25-4983-b868-f752c90ed0bb None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:35.040820 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d4623-cc25-4983-b868-f752c90ed0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:35.069559 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b44d4623-cc25-4983-b868-f752c90ed0bb None None] MFA Rules not processed for user `e58c10761fd74889b508ea9a9e0b8dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:35.070781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b44d4623-cc25-4983-b868-f752c90ed0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:35.138044 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1281/2573] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:35.142978 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cb247-cdb4-4ae0-b828-5449de81bae2 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:35.205778 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cb247-cdb4-4ae0-b828-5449de81bae2 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:35.210593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab113016-ed24-4dfd-883c-ca8a969b3d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:35.211248 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab113016-ed24-4dfd-883c-ca8a969b3d2c admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:35.211527 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab113016-ed24-4dfd-883c-ca8a969b3d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:35.211802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab113016-ed24-4dfd-883c-ca8a969b3d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:35.212495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab113016-ed24-4dfd-883c-ca8a969b3d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:35.214462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab113016-ed24-4dfd-883c-ca8a969b3d2c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:35.330874 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1293/2574] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:06:35 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:35.332938 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d4623-cc25-4983-b868-f752c90ed0bb None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:35.343591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d4623-cc25-4983-b868-f752c90ed0bb None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:35.399116 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206936b-be6e-4e17-ad72-0f54e5db3734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:35.399770 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206936b-be6e-4e17-ad72-0f54e5db3734 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:35.400055 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206936b-be6e-4e17-ad72-0f54e5db3734 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:35.400325 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206936b-be6e-4e17-ad72-0f54e5db3734 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:35.401636 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206936b-be6e-4e17-ad72-0f54e5db3734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:35.403760 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206936b-be6e-4e17-ad72-0f54e5db3734 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:35.480767 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1282/2575] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:06:35 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:35.485077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab113016-ed24-4dfd-883c-ca8a969b3d2c admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:35.495457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab113016-ed24-4dfd-883c-ca8a969b3d2c admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:35.501296 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383e4d2-779c-44a9-b315-46dbcb463f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:35.501975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383e4d2-779c-44a9-b315-46dbcb463f40 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:35.502263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383e4d2-779c-44a9-b315-46dbcb463f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:35.502542 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383e4d2-779c-44a9-b315-46dbcb463f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:35.503273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383e4d2-779c-44a9-b315-46dbcb463f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:35.504938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383e4d2-779c-44a9-b315-46dbcb463f40 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:35.518277 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1294/2576] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:35.521442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206936b-be6e-4e17-ad72-0f54e5db3734 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:35.532378 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206936b-be6e-4e17-ad72-0f54e5db3734 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:35.537655 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3229a2f-6fa4-4ec3-a2a5-1c9b1713551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:35.538546 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3229a2f-6fa4-4ec3-a2a5-1c9b1713551a admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:35.538840 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3229a2f-6fa4-4ec3-a2a5-1c9b1713551a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:35.539121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3229a2f-6fa4-4ec3-a2a5-1c9b1713551a admin admin] PATH_INFO: `/v3/projects/a1eb33d0a4fd4c229c2d2bac3bb3783f/users/4b0aa6737edb4b3eb7708b5bbc4e71eb/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:35.557882 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3229a2f-6fa4-4ec3-a2a5-1c9b1713551a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1eb33d0a4fd4c229c2d2bac3bb3783f, user_id=4b0aa6737edb4b3eb7708b5bbc4e71eb, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:35.561670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3229a2f-6fa4-4ec3-a2a5-1c9b1713551a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:35.630733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd9461-d9fe-48c2-bf8f-d720ddee5898 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:35.631027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd9461-d9fe-48c2-bf8f-d720ddee5898 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:35.631311 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd9461-d9fe-48c2-bf8f-d720ddee5898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:35.645909 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1283/2577] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:35 2022] PUT /identity/v3/projects/a1eb33d0a4fd4c229c2d2bac3bb3783f/users/4b0aa6737edb4b3eb7708b5bbc4e71eb/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:06:35.649813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3229a2f-6fa4-4ec3-a2a5-1c9b1713551a admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:35.652889 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-24cd9461-d9fe-48c2-bf8f-d720ddee5898 None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:35.654015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:35.654178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-24cd9461-d9fe-48c2-bf8f-d720ddee5898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:35.710196 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1295/2578] 10.222.0.44 () {58 vars in 1009 bytes} [Mon Jun 27 15:06:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:06:35.713228 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3229a2f-6fa4-4ec3-a2a5-1c9b1713551a admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:35.727591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c5b60-5b46-498e-b515-3a70afb110fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:35.727591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c5b60-5b46-498e-b515-3a70afb110fb admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:35.727591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c5b60-5b46-498e-b515-3a70afb110fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:35.727591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c5b60-5b46-498e-b515-3a70afb110fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:35.728253 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c5b60-5b46-498e-b515-3a70afb110fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:35.728348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd9461-d9fe-48c2-bf8f-d720ddee5898 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:35.728451 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c5b60-5b46-498e-b515-3a70afb110fb admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:35.728550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-24cd9461-d9fe-48c2-bf8f-d720ddee5898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:35.732850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1284/2579] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:06:35.737559 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c5b60-5b46-498e-b515-3a70afb110fb admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:35.747723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c5b60-5b46-498e-b515-3a70afb110fb admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:35.753147 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c812b9-d7ab-413e-847d-0bc414e92a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:35.754011 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c812b9-d7ab-413e-847d-0bc414e92a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:35.754323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c812b9-d7ab-413e-847d-0bc414e92a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:35.754594 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c812b9-d7ab-413e-847d-0bc414e92a2c admin admin] PATH_INFO: `/v3/projects/a1eb33d0a4fd4c229c2d2bac3bb3783f/users/4b0aa6737edb4b3eb7708b5bbc4e71eb/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:35.756568 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c812b9-d7ab-413e-847d-0bc414e92a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1eb33d0a4fd4c229c2d2bac3bb3783f, user_id=4b0aa6737edb4b3eb7708b5bbc4e71eb, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:35.759229 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c812b9-d7ab-413e-847d-0bc414e92a2c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:35.769729 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1285/2580] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:35 2022] PUT /identity/v3/projects/a1eb33d0a4fd4c229c2d2bac3bb3783f/users/4b0aa6737edb4b3eb7708b5bbc4e71eb/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:06:35.779485 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf01e0a-5381-49bd-bc1d-f7a475988caa None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:35.779772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf01e0a-5381-49bd-bc1d-f7a475988caa None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:35.780062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf01e0a-5381-49bd-bc1d-f7a475988caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:35.790135 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:35.794561 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd9461-d9fe-48c2-bf8f-d720ddee5898 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:35.807060 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-baf01e0a-5381-49bd-bc1d-f7a475988caa None None] MFA Rules not processed for user `4b0aa6737edb4b3eb7708b5bbc4e71eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:35.808275 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-baf01e0a-5381-49bd-bc1d-f7a475988caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:35.854864 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3319ac-d684-408e-bbaf-74eb82f8dddd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:35.855677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3319ac-d684-408e-bbaf-74eb82f8dddd service swift] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:35.856021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3319ac-d684-408e-bbaf-74eb82f8dddd service swift] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:35.856304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3319ac-d684-408e-bbaf-74eb82f8dddd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:35.879089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1286/2581] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:06:35.890667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf01e0a-5381-49bd-bc1d-f7a475988caa None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:35.892094 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-baf01e0a-5381-49bd-bc1d-f7a475988caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:35.914631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3319ac-d684-408e-bbaf-74eb82f8dddd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:35.916306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3319ac-d684-408e-bbaf-74eb82f8dddd service swift] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:35.924568 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1296/2582] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 15:06:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 15:06:35.951193 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf01e0a-5381-49bd-bc1d-f7a475988caa None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:35.955668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a89410-032a-4a3a-aa11-f69bf2a7e29d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:35.956357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a89410-032a-4a3a-aa11-f69bf2a7e29d service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:35.956636 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a89410-032a-4a3a-aa11-f69bf2a7e29d service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:35.956935 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a89410-032a-4a3a-aa11-f69bf2a7e29d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:35.982110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:36.015379 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a89410-032a-4a3a-aa11-f69bf2a7e29d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:36.016776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a89410-032a-4a3a-aa11-f69bf2a7e29d service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:36.026317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1287/2583] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:06:38.984219 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3319ac-d684-408e-bbaf-74eb82f8dddd service swift] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:38.993872 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3319ac-d684-408e-bbaf-74eb82f8dddd service swift] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:38.997603 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e45b5-251a-4be1-96ad-7bc57a2b029a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:39.000711 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e45b5-251a-4be1-96ad-7bc57a2b029a service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:39.001052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e45b5-251a-4be1-96ad-7bc57a2b029a service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:39.001487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e45b5-251a-4be1-96ad-7bc57a2b029a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:39.076281 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e45b5-251a-4be1-96ad-7bc57a2b029a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:39.078545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e45b5-251a-4be1-96ad-7bc57a2b029a service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:39.090417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1297/2584] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:40.496389 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a89410-032a-4a3a-aa11-f69bf2a7e29d service cinder] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:40.506450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a89410-032a-4a3a-aa11-f69bf2a7e29d service cinder] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:40.511654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b7e7e-e2ac-48db-80b5-01b38eb1ea0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:40.511654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b7e7e-e2ac-48db-80b5-01b38eb1ea0f service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:40.511654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b7e7e-e2ac-48db-80b5-01b38eb1ea0f service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:40.511654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b7e7e-e2ac-48db-80b5-01b38eb1ea0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:40.521873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b7e7e-e2ac-48db-80b5-01b38eb1ea0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:40.523298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b7e7e-e2ac-48db-80b5-01b38eb1ea0f service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:40.539008 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1288/2585] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:46.198642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e45b5-251a-4be1-96ad-7bc57a2b029a service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:46.245515 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=100 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:46.262924 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e45b5-251a-4be1-96ad-7bc57a2b029a service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:46.267771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0dc39-8f96-421a-82f1-55cfca727961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:46.268652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0dc39-8f96-421a-82f1-55cfca727961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:46.268952 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0dc39-8f96-421a-82f1-55cfca727961 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:46.269233 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0dc39-8f96-421a-82f1-55cfca727961 admin admin] PATH_INFO: `/v3/users/4a67b4e10de549f388b1d30a8802c687` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:46.270433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0dc39-8f96-421a-82f1-55cfca727961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a67b4e10de549f388b1d30a8802c687)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:46.272347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0dc39-8f96-421a-82f1-55cfca727961 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:46.448703 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-44a0dc39-8f96-421a-82f1-55cfca727961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a67b4e10de549f388b1d30a8802c687'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:46.460751 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-44a0dc39-8f96-421a-82f1-55cfca727961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a67b4e10de549f388b1d30a8802c687'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:46.513695 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-44a0dc39-8f96-421a-82f1-55cfca727961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a67b4e10de549f388b1d30a8802c687'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:46.514337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-44a0dc39-8f96-421a-82f1-55cfca727961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a67b4e10de549f388b1d30a8802c687'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:46.521700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-44a0dc39-8f96-421a-82f1-55cfca727961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a67b4e10de549f388b1d30a8802c687'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:46.527815 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1298/2586] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:06:46 2022] DELETE /identity/v3/users/4a67b4e10de549f388b1d30a8802c687 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:46.533087 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e95a5-f35a-49fd-8b3b-0fc26510880d None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:46.533611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e95a5-f35a-49fd-8b3b-0fc26510880d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:46.533725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e95a5-f35a-49fd-8b3b-0fc26510880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:46.551582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-ba2e95a5-f35a-49fd-8b3b-0fc26510880d None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:46.554311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ba2e95a5-f35a-49fd-8b3b-0fc26510880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:46.612116 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1289/2587] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:46.621706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0dc39-8f96-421a-82f1-55cfca727961 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:46.623083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-44a0dc39-8f96-421a-82f1-55cfca727961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:46.679508 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0dc39-8f96-421a-82f1-55cfca727961 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:46.683437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179df5cb-cd26-4c70-a15a-575195df79c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:46.684076 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179df5cb-cd26-4c70-a15a-575195df79c4 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:46.684357 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179df5cb-cd26-4c70-a15a-575195df79c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:46.684632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179df5cb-cd26-4c70-a15a-575195df79c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:46.693691 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179df5cb-cd26-4c70-a15a-575195df79c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:46.695105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179df5cb-cd26-4c70-a15a-575195df79c4 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:46.704489 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1299/2588] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:47.040779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e95a5-f35a-49fd-8b3b-0fc26510880d None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:47.042207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ba2e95a5-f35a-49fd-8b3b-0fc26510880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:47.054720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e95a5-f35a-49fd-8b3b-0fc26510880d None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:47.059697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:47.060549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:47.060983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:47.061297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e admin admin] PATH_INFO: `/v3/projects/e35d4087035c4ffe8af022e1f1a70bae` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:47.062615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e35d4087035c4ffe8af022e1f1a70bae)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:47.064501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:47.154182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e35d4087035c4ffe8af022e1f1a70bae', 'request_id': 'req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:47.204851 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e35d4087035c4ffe8af022e1f1a70bae', 'request_id': 'req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:47.211204 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e35d4087035c4ffe8af022e1f1a70bae', 'request_id': 'req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:47.221814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e admin admin] The token cache is being invalidate because project e35d4087035c4ffe8af022e1f1a70bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:06:47.223445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:47.223445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:47.224215 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1290/2589] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:06:47 2022] DELETE /identity/v3/projects/e35d4087035c4ffe8af022e1f1a70bae => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:47.228187 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179df5cb-cd26-4c70-a15a-575195df79c4 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:47.237750 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179df5cb-cd26-4c70-a15a-575195df79c4 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:47.293002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fcace-1cb9-4521-bb46-a2dcd7561fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:47.293791 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fcace-1cb9-4521-bb46-a2dcd7561fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:47.294077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fcace-1cb9-4521-bb46-a2dcd7561fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:47.294358 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fcace-1cb9-4521-bb46-a2dcd7561fcc admin admin] PATH_INFO: `/v3/users/e58c10761fd74889b508ea9a9e0b8dc1` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:47.295547 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fcace-1cb9-4521-bb46-a2dcd7561fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e58c10761fd74889b508ea9a9e0b8dc1)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:47.297496 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fcace-1cb9-4521-bb46-a2dcd7561fcc admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:47.302655 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:47.465492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-7f4fcace-1cb9-4521-bb46-a2dcd7561fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e58c10761fd74889b508ea9a9e0b8dc1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:47.478536 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-7f4fcace-1cb9-4521-bb46-a2dcd7561fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e58c10761fd74889b508ea9a9e0b8dc1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:47.548178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-7f4fcace-1cb9-4521-bb46-a2dcd7561fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e58c10761fd74889b508ea9a9e0b8dc1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:47.548793 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-7f4fcace-1cb9-4521-bb46-a2dcd7561fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e58c10761fd74889b508ea9a9e0b8dc1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:47.556595 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-7f4fcace-1cb9-4521-bb46-a2dcd7561fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e58c10761fd74889b508ea9a9e0b8dc1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:47.562510 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1300/2590] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:06:47 2022] DELETE /identity/v3/users/e58c10761fd74889b508ea9a9e0b8dc1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:47.972977 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:47.974553 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:47.988144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cda12-cf37-4008-bbd3-7ea49b77a20e admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:48.027692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:48.050957 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d35517-bb62-448e-a189-2e5f2ba30dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:48.051828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d35517-bb62-448e-a189-2e5f2ba30dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:48.052097 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d35517-bb62-448e-a189-2e5f2ba30dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:48.052376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d35517-bb62-448e-a189-2e5f2ba30dcb admin admin] PATH_INFO: `/v3/projects/dbc05e01160048c3a21ce336a1240175` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:48.053589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d35517-bb62-448e-a189-2e5f2ba30dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc05e01160048c3a21ce336a1240175)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:48.055728 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d35517-bb62-448e-a189-2e5f2ba30dcb admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:48.195410 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-73d35517-bb62-448e-a189-2e5f2ba30dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc05e01160048c3a21ce336a1240175', 'request_id': 'req-73d35517-bb62-448e-a189-2e5f2ba30dcb'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:48.250542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-73d35517-bb62-448e-a189-2e5f2ba30dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc05e01160048c3a21ce336a1240175', 'request_id': 'req-73d35517-bb62-448e-a189-2e5f2ba30dcb'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:48.257076 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-73d35517-bb62-448e-a189-2e5f2ba30dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc05e01160048c3a21ce336a1240175', 'request_id': 'req-73d35517-bb62-448e-a189-2e5f2ba30dcb'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:48.268128 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-73d35517-bb62-448e-a189-2e5f2ba30dcb admin admin] The token cache is being invalidate because project dbc05e01160048c3a21ce336a1240175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:06:48.268409 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-73d35517-bb62-448e-a189-2e5f2ba30dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:48.269061 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-73d35517-bb62-448e-a189-2e5f2ba30dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:48.270586 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1291/2591] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:06:47 2022] DELETE /identity/v3/projects/dbc05e01160048c3a21ce336a1240175 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:48.274435 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fcace-1cb9-4521-bb46-a2dcd7561fcc admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:48.275822 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-7f4fcace-1cb9-4521-bb46-a2dcd7561fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:48.288356 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fcace-1cb9-4521-bb46-a2dcd7561fcc admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:48.345019 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2be84-aaf6-47ee-abbb-25f58a22a083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:48.345881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2be84-aaf6-47ee-abbb-25f58a22a083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:48.346164 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2be84-aaf6-47ee-abbb-25f58a22a083 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:48.346434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2be84-aaf6-47ee-abbb-25f58a22a083 admin admin] PATH_INFO: `/v3/users/4b0aa6737edb4b3eb7708b5bbc4e71eb` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:48.347610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2be84-aaf6-47ee-abbb-25f58a22a083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0aa6737edb4b3eb7708b5bbc4e71eb)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:48.349570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2be84-aaf6-47ee-abbb-25f58a22a083 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:48.533566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-99d2be84-aaf6-47ee-abbb-25f58a22a083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0aa6737edb4b3eb7708b5bbc4e71eb'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:48.546661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-99d2be84-aaf6-47ee-abbb-25f58a22a083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0aa6737edb4b3eb7708b5bbc4e71eb'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:48.691619 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-99d2be84-aaf6-47ee-abbb-25f58a22a083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0aa6737edb4b3eb7708b5bbc4e71eb'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:48.692260 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-99d2be84-aaf6-47ee-abbb-25f58a22a083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0aa6737edb4b3eb7708b5bbc4e71eb'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:48.700421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-99d2be84-aaf6-47ee-abbb-25f58a22a083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0aa6737edb4b3eb7708b5bbc4e71eb'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:48.707719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1301/2592] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:06:48 2022] DELETE /identity/v3/users/4b0aa6737edb4b3eb7708b5bbc4e71eb => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:49.086469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d35517-bb62-448e-a189-2e5f2ba30dcb admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:49.087980 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-73d35517-bb62-448e-a189-2e5f2ba30dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:49.101066 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d35517-bb62-448e-a189-2e5f2ba30dcb admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:49.162931 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996945f-2fb8-4618-915b-bc09fc9106a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:49.163808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996945f-2fb8-4618-915b-bc09fc9106a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:49.164928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996945f-2fb8-4618-915b-bc09fc9106a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:49.165217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996945f-2fb8-4618-915b-bc09fc9106a4 admin admin] PATH_INFO: `/v3/projects/a1eb33d0a4fd4c229c2d2bac3bb3783f` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:49.166514 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996945f-2fb8-4618-915b-bc09fc9106a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1eb33d0a4fd4c229c2d2bac3bb3783f)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:49.168460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996945f-2fb8-4618-915b-bc09fc9106a4 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:49.275929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3996945f-2fb8-4618-915b-bc09fc9106a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1eb33d0a4fd4c229c2d2bac3bb3783f', 'request_id': 'req-3996945f-2fb8-4618-915b-bc09fc9106a4'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:49.347978 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3996945f-2fb8-4618-915b-bc09fc9106a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1eb33d0a4fd4c229c2d2bac3bb3783f', 'request_id': 'req-3996945f-2fb8-4618-915b-bc09fc9106a4'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:49.354749 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3996945f-2fb8-4618-915b-bc09fc9106a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1eb33d0a4fd4c229c2d2bac3bb3783f', 'request_id': 'req-3996945f-2fb8-4618-915b-bc09fc9106a4'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:49.360018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:49.365767 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3996945f-2fb8-4618-915b-bc09fc9106a4 admin admin] The token cache is being invalidate because project a1eb33d0a4fd4c229c2d2bac3bb3783f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:06:49.366063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3996945f-2fb8-4618-915b-bc09fc9106a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:49.366763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3996945f-2fb8-4618-915b-bc09fc9106a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:06:49.368404 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1292/2593] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:06:49 2022] DELETE /identity/v3/projects/a1eb33d0a4fd4c229c2d2bac3bb3783f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:49.374194 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942c121-ea2d-4783-bfe3-c0bd0669f2b3 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:49.374713 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942c121-ea2d-4783-bfe3-c0bd0669f2b3 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:49.374975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942c121-ea2d-4783-bfe3-c0bd0669f2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:49.382334 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:49.393290 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-8942c121-ea2d-4783-bfe3-c0bd0669f2b3 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:49.394495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-8942c121-ea2d-4783-bfe3-c0bd0669f2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:49.457768 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1302/2594] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:49.465734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db08a8-3528-4367-9a2b-9cb72494bcb7 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:49.466060 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db08a8-3528-4367-9a2b-9cb72494bcb7 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:49.466338 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db08a8-3528-4367-9a2b-9cb72494bcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:49.485317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-60db08a8-3528-4367-9a2b-9cb72494bcb7 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:49.486505 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-60db08a8-3528-4367-9a2b-9cb72494bcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:49.494336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1293/2595] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:49.498814 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942c121-ea2d-4783-bfe3-c0bd0669f2b3 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:49.508582 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942c121-ea2d-4783-bfe3-c0bd0669f2b3 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:49.513175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af2b1a-e5cd-4673-8ade-f7b2248d3caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:49.513827 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af2b1a-e5cd-4673-8ade-f7b2248d3caa admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:49.516001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af2b1a-e5cd-4673-8ade-f7b2248d3caa admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:49.516001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af2b1a-e5cd-4673-8ade-f7b2248d3caa admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:49.516001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af2b1a-e5cd-4673-8ade-f7b2248d3caa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:06:49.516001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af2b1a-e5cd-4673-8ade-f7b2248d3caa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:49.517540 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af2b1a-e5cd-4673-8ade-f7b2248d3caa admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:49.530572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1303/2596] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:06:49.535145 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db08a8-3528-4367-9a2b-9cb72494bcb7 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:49.544856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db08a8-3528-4367-9a2b-9cb72494bcb7 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:49.550157 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac592e9-08f4-4fbc-9046-6ca94fc00d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:49.550867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac592e9-08f4-4fbc-9046-6ca94fc00d99 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:49.551147 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac592e9-08f4-4fbc-9046-6ca94fc00d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:49.551421 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac592e9-08f4-4fbc-9046-6ca94fc00d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:49.552124 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac592e9-08f4-4fbc-9046-6ca94fc00d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:49.554039 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac592e9-08f4-4fbc-9046-6ca94fc00d99 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:49.678319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1294/2597] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:06:49 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:49.683565 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af2b1a-e5cd-4673-8ade-f7b2248d3caa admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:49.694632 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af2b1a-e5cd-4673-8ade-f7b2248d3caa admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:49.758283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bb64f-55bd-420f-908c-a27f6be86d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:49.758956 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bb64f-55bd-420f-908c-a27f6be86d45 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:49.759243 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bb64f-55bd-420f-908c-a27f6be86d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:49.759521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bb64f-55bd-420f-908c-a27f6be86d45 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:49.760265 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7bb64f-55bd-420f-908c-a27f6be86d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:49.762226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7bb64f-55bd-420f-908c-a27f6be86d45 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:49.871610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1304/2598] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:06:49 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:49.873000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac592e9-08f4-4fbc-9046-6ca94fc00d99 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:49.884699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac592e9-08f4-4fbc-9046-6ca94fc00d99 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:49.890994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e7711-0f45-4965-9df5-6ece565c0fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:49.891661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e7711-0f45-4965-9df5-6ece565c0fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:49.891939 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e7711-0f45-4965-9df5-6ece565c0fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:49.892211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e7711-0f45-4965-9df5-6ece565c0fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:49.892979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e7711-0f45-4965-9df5-6ece565c0fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:49.894565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e7711-0f45-4965-9df5-6ece565c0fb3 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:49.916151 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1295/2599] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:06:49.917326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bb64f-55bd-420f-908c-a27f6be86d45 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:49.927283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bb64f-55bd-420f-908c-a27f6be86d45 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:49.933263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61ad70-e0c8-42da-a934-fabc2e14b782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:49.933856 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61ad70-e0c8-42da-a934-fabc2e14b782 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:49.934193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61ad70-e0c8-42da-a934-fabc2e14b782 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:49.934472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61ad70-e0c8-42da-a934-fabc2e14b782 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:49.935191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61ad70-e0c8-42da-a934-fabc2e14b782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:49.937009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61ad70-e0c8-42da-a934-fabc2e14b782 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:49.947150 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1305/2600] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:49.953296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e7711-0f45-4965-9df5-6ece565c0fb3 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:49.964870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e7711-0f45-4965-9df5-6ece565c0fb3 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:49.970682 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8e341-d13b-41b7-ba79-2495f25da466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:49.971555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8e341-d13b-41b7-ba79-2495f25da466 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:49.971838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8e341-d13b-41b7-ba79-2495f25da466 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:49.972110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8e341-d13b-41b7-ba79-2495f25da466 admin admin] PATH_INFO: `/v3/projects/1f0930afdc584d559e0f132e0f1ee215/users/ec662ce3a9a14645b7ac69eb0639d08b/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:49.990812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8e341-d13b-41b7-ba79-2495f25da466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0930afdc584d559e0f132e0f1ee215, user_id=ec662ce3a9a14645b7ac69eb0639d08b, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:49.993584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8e341-d13b-41b7-ba79-2495f25da466 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:50.046166 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1296/2601] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:49 2022] PUT /identity/v3/projects/1f0930afdc584d559e0f132e0f1ee215/users/ec662ce3a9a14645b7ac69eb0639d08b/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:06:50.063032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ca3b-222e-46ad-85ed-2407f879238c None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:50.063324 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ca3b-222e-46ad-85ed-2407f879238c None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:50.063606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ca3b-222e-46ad-85ed-2407f879238c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:50.095927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-5cf6ca3b-222e-46ad-85ed-2407f879238c None None] MFA Rules not processed for user `ec662ce3a9a14645b7ac69eb0639d08b`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:50.097194 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-5cf6ca3b-222e-46ad-85ed-2407f879238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:50.166897 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:50.171693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1306/2602] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:50.182590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8e341-d13b-41b7-ba79-2495f25da466 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:50.250079 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8e341-d13b-41b7-ba79-2495f25da466 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:50.257275 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65f233-43fc-4cdd-ab41-59665c419c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:50.257931 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65f233-43fc-4cdd-ab41-59665c419c6c admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:50.258215 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65f233-43fc-4cdd-ab41-59665c419c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:50.258491 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65f233-43fc-4cdd-ab41-59665c419c6c admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:50.259183 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65f233-43fc-4cdd-ab41-59665c419c6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:50.261152 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65f233-43fc-4cdd-ab41-59665c419c6c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:50.371607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1297/2603] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:06:50 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:50.376453 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6ca3b-222e-46ad-85ed-2407f879238c None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:50.387101 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6ca3b-222e-46ad-85ed-2407f879238c None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:50.442963 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b004c-4185-49a8-b95a-724efb9f24ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:50.443628 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b004c-4185-49a8-b95a-724efb9f24ca admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:50.443911 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b004c-4185-49a8-b95a-724efb9f24ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:50.444194 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b004c-4185-49a8-b95a-724efb9f24ca admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:50.444909 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b004c-4185-49a8-b95a-724efb9f24ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:50.446844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b004c-4185-49a8-b95a-724efb9f24ca admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:50.520812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1307/2604] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:06:50 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:06:50.524939 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65f233-43fc-4cdd-ab41-59665c419c6c admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:50.535410 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65f233-43fc-4cdd-ab41-59665c419c6c admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:50.540097 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8a892-b673-42e3-95ad-d4a8afda336a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:50.540790 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8a892-b673-42e3-95ad-d4a8afda336a admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:50.541078 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8a892-b673-42e3-95ad-d4a8afda336a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:50.541355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8a892-b673-42e3-95ad-d4a8afda336a admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:50.542117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8a892-b673-42e3-95ad-d4a8afda336a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:50.543700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8a892-b673-42e3-95ad-d4a8afda336a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:50.554280 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1298/2605] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:50.558391 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b004c-4185-49a8-b95a-724efb9f24ca admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:50.569041 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b004c-4185-49a8-b95a-724efb9f24ca admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:50.573642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff3e1f-0ef1-413c-a4de-ab83f8005fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:50.574292 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff3e1f-0ef1-413c-a4de-ab83f8005fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:50.574577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff3e1f-0ef1-413c-a4de-ab83f8005fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:50.574851 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff3e1f-0ef1-413c-a4de-ab83f8005fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:50.575573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff3e1f-0ef1-413c-a4de-ab83f8005fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:50.577836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff3e1f-0ef1-413c-a4de-ab83f8005fc9 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:50.587629 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1308/2606] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:50.591785 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8a892-b673-42e3-95ad-d4a8afda336a admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:50.602004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8a892-b673-42e3-95ad-d4a8afda336a admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:50.606661 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417751ad-3974-4b9e-bebd-2fe75a8a531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:50.607527 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417751ad-3974-4b9e-bebd-2fe75a8a531a admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:50.608370 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417751ad-3974-4b9e-bebd-2fe75a8a531a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:50.608668 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417751ad-3974-4b9e-bebd-2fe75a8a531a admin admin] PATH_INFO: `/v3/projects/f1852fc4316148faaaf239f45b9d6ff1/users/9085d748586b45a3a5b91f452a83ca9d/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:50.623027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417751ad-3974-4b9e-bebd-2fe75a8a531a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1852fc4316148faaaf239f45b9d6ff1, user_id=9085d748586b45a3a5b91f452a83ca9d, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:50.626338 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417751ad-3974-4b9e-bebd-2fe75a8a531a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:50.724543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1299/2607] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:50 2022] PUT /identity/v3/projects/f1852fc4316148faaaf239f45b9d6ff1/users/9085d748586b45a3a5b91f452a83ca9d/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:50.735429 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e8168-0671-4780-bf0d-4d5e025f2536 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:50.735715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e8168-0671-4780-bf0d-4d5e025f2536 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:50.735994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e8168-0671-4780-bf0d-4d5e025f2536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:50.762121 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d07e8168-0671-4780-bf0d-4d5e025f2536 None None] MFA Rules not processed for user `9085d748586b45a3a5b91f452a83ca9d`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:50.763321 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d07e8168-0671-4780-bf0d-4d5e025f2536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:50.826042 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1309/2608] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:50.830542 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417751ad-3974-4b9e-bebd-2fe75a8a531a admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:50.874733 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:50.890678 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417751ad-3974-4b9e-bebd-2fe75a8a531a admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:50.895289 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2c7cb-d13c-431c-88c4-70b6f765e75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:50.895928 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2c7cb-d13c-431c-88c4-70b6f765e75f admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:50.896208 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2c7cb-d13c-431c-88c4-70b6f765e75f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:50.896476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2c7cb-d13c-431c-88c4-70b6f765e75f admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:50.897196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2c7cb-d13c-431c-88c4-70b6f765e75f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:50.899055 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2c7cb-d13c-431c-88c4-70b6f765e75f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:51.847544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1300/2609] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:06:50 2022] POST /identity/v3/projects => generated 385 bytes in 1017 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:51.851335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e8168-0671-4780-bf0d-4d5e025f2536 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:51.864354 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e8168-0671-4780-bf0d-4d5e025f2536 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:51.925255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1a4c8-9311-4c81-a15e-6470a7a32d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:51.927836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1a4c8-9311-4c81-a15e-6470a7a32d24 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:51.927836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1a4c8-9311-4c81-a15e-6470a7a32d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:51.927836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1a4c8-9311-4c81-a15e-6470a7a32d24 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:51.927836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1a4c8-9311-4c81-a15e-6470a7a32d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:51.929126 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1a4c8-9311-4c81-a15e-6470a7a32d24 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:52.005205 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:52.011184 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1310/2610] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:06:51 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:06:52.015149 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2c7cb-d13c-431c-88c4-70b6f765e75f admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:52.025695 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2c7cb-d13c-431c-88c4-70b6f765e75f admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:52.031094 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df45743-7713-4b02-bdbb-bcaca91fd696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:52.031742 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df45743-7713-4b02-bdbb-bcaca91fd696 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:52.032041 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df45743-7713-4b02-bdbb-bcaca91fd696 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:52.032335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df45743-7713-4b02-bdbb-bcaca91fd696 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:52.033101 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df45743-7713-4b02-bdbb-bcaca91fd696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:52.034672 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df45743-7713-4b02-bdbb-bcaca91fd696 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:52.045933 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1301/2611] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:52.050073 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1a4c8-9311-4c81-a15e-6470a7a32d24 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:52.060368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1a4c8-9311-4c81-a15e-6470a7a32d24 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:52.065678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7c2f4-59ec-48a9-a8f8-d255e7a5fb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:52.066838 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7c2f4-59ec-48a9-a8f8-d255e7a5fb75 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:52.066984 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7c2f4-59ec-48a9-a8f8-d255e7a5fb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:52.067180 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7c2f4-59ec-48a9-a8f8-d255e7a5fb75 admin admin] PATH_INFO: `/v3/projects/64ec826b6e554c34a441dc4abfc20f5d/users/81ff49643211441da75e023132d13f09/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:52.082408 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7c2f4-59ec-48a9-a8f8-d255e7a5fb75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ec826b6e554c34a441dc4abfc20f5d, user_id=81ff49643211441da75e023132d13f09, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:52.086258 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7c2f4-59ec-48a9-a8f8-d255e7a5fb75 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:52.166232 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1311/2612] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:52 2022] PUT /identity/v3/projects/64ec826b6e554c34a441dc4abfc20f5d/users/81ff49643211441da75e023132d13f09/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:52.170328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df45743-7713-4b02-bdbb-bcaca91fd696 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:52.181502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df45743-7713-4b02-bdbb-bcaca91fd696 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:52.240134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07363df3-c333-4600-8306-3fad4aa5cd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:52.240827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07363df3-c333-4600-8306-3fad4aa5cd49 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:52.241113 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07363df3-c333-4600-8306-3fad4aa5cd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:52.241396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07363df3-c333-4600-8306-3fad4aa5cd49 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:52.242127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07363df3-c333-4600-8306-3fad4aa5cd49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:52.243698 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07363df3-c333-4600-8306-3fad4aa5cd49 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:52.254607 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1302/2613] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:06:52.258667 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7c2f4-59ec-48a9-a8f8-d255e7a5fb75 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:52.269821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7c2f4-59ec-48a9-a8f8-d255e7a5fb75 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:52.274625 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507983f-9b6f-4a3b-8352-8f35234c4748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:52.277947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507983f-9b6f-4a3b-8352-8f35234c4748 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:52.277947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507983f-9b6f-4a3b-8352-8f35234c4748 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:52.277947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507983f-9b6f-4a3b-8352-8f35234c4748 admin admin] PATH_INFO: `/v3/projects/64ec826b6e554c34a441dc4abfc20f5d/users/81ff49643211441da75e023132d13f09/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:52.278261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507983f-9b6f-4a3b-8352-8f35234c4748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ec826b6e554c34a441dc4abfc20f5d, user_id=81ff49643211441da75e023132d13f09, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:52.281308 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507983f-9b6f-4a3b-8352-8f35234c4748 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:52.291723 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1312/2614] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:06:52 2022] PUT /identity/v3/projects/64ec826b6e554c34a441dc4abfc20f5d/users/81ff49643211441da75e023132d13f09/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:06:52.303217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa213d32-c92a-4cad-8ffa-61e93cbef8c6 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:52.303510 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa213d32-c92a-4cad-8ffa-61e93cbef8c6 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:52.303842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa213d32-c92a-4cad-8ffa-61e93cbef8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:52.330739 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-aa213d32-c92a-4cad-8ffa-61e93cbef8c6 None None] MFA Rules not processed for user `81ff49643211441da75e023132d13f09`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:52.331953 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-aa213d32-c92a-4cad-8ffa-61e93cbef8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:52.402703 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1303/2615] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:06:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:52.414910 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507983f-9b6f-4a3b-8352-8f35234c4748 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:52.416698 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-8507983f-9b6f-4a3b-8352-8f35234c4748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:52.475945 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507983f-9b6f-4a3b-8352-8f35234c4748 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:52.479606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1517b-312d-4b76-9f5c-5ea571402121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:52.480244 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1517b-312d-4b76-9f5c-5ea571402121 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:52.480526 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1517b-312d-4b76-9f5c-5ea571402121 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:52.480832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1517b-312d-4b76-9f5c-5ea571402121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:52.537362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1517b-312d-4b76-9f5c-5ea571402121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:52.538792 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1517b-312d-4b76-9f5c-5ea571402121 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:52.548006 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1313/2616] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:55.540792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa213d32-c92a-4cad-8ffa-61e93cbef8c6 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:55.550423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa213d32-c92a-4cad-8ffa-61e93cbef8c6 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:55.553945 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25563dd2-a3bb-491d-a7eb-9def3c25f6c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:55.554571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25563dd2-a3bb-491d-a7eb-9def3c25f6c0 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:55.554850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25563dd2-a3bb-491d-a7eb-9def3c25f6c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:55.555374 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25563dd2-a3bb-491d-a7eb-9def3c25f6c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:55.590493 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:06:55.612544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25563dd2-a3bb-491d-a7eb-9def3c25f6c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:55.614012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25563dd2-a3bb-491d-a7eb-9def3c25f6c0 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:55.623239 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1304/2617] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:06:56.190362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6405ee9-98ea-4622-8ac8-7957224e526f None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:56.190826 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6405ee9-98ea-4622-8ac8-7957224e526f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:56.190923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6405ee9-98ea-4622-8ac8-7957224e526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:56.208455 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-f6405ee9-98ea-4622-8ac8-7957224e526f None None] MFA Rules not processed for user `d87edb187b2f4d6194cb7c94a3d690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:06:56.209788 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f6405ee9-98ea-4622-8ac8-7957224e526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:56.267427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1314/2618] 10.222.0.44 () {58 vars in 967 bytes} [Mon Jun 27 15:06:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:06:56.279382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25563dd2-a3bb-491d-a7eb-9def3c25f6c0 service cinder] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:56.280830 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-25563dd2-a3bb-491d-a7eb-9def3c25f6c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:06:56.353589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25563dd2-a3bb-491d-a7eb-9def3c25f6c0 service cinder] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:56.358963 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed9c72-9a50-4488-b763-9cd9fe41ea6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482c11dafd8541e28d50705f7651fd15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:56.359606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed9c72-9a50-4488-b763-9cd9fe41ea6e service swift] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:56.359893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed9c72-9a50-4488-b763-9cd9fe41ea6e service swift] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:56.360999 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed9c72-9a50-4488-b763-9cd9fe41ea6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:56.369374 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed9c72-9a50-4488-b763-9cd9fe41ea6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:56.371050 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed9c72-9a50-4488-b763-9cd9fe41ea6e service swift] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:56.379701 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1305/2619] 10.222.0.44 () {60 vars in 1384 bytes} [Mon Jun 27 15:06:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 15:06:57.028811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6405ee9-98ea-4622-8ac8-7957224e526f None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:06:57.038346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6405ee9-98ea-4622-8ac8-7957224e526f None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:06:57.048478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58366f1d-7f71-4f72-8393-0ef68df36375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:06:57.048478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58366f1d-7f71-4f72-8393-0ef68df36375 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:06:57.048478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58366f1d-7f71-4f72-8393-0ef68df36375 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:06:57.048478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58366f1d-7f71-4f72-8393-0ef68df36375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:06:57.051955 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58366f1d-7f71-4f72-8393-0ef68df36375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:06:57.053395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58366f1d-7f71-4f72-8393-0ef68df36375 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:06:57.063533 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1315/2620] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:06:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:07:01.502034 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed9c72-9a50-4488-b763-9cd9fe41ea6e service swift] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:07:01.563552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed9c72-9a50-4488-b763-9cd9fe41ea6e service swift] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:07:01.568067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd24471-97f6-4aa4-b191-b6eabc62ccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:07:01.568954 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd24471-97f6-4aa4-b191-b6eabc62ccf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:07:01.569236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd24471-97f6-4aa4-b191-b6eabc62ccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:07:01.569513 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd24471-97f6-4aa4-b191-b6eabc62ccf7 admin admin] PATH_INFO: `/v3/users/ec662ce3a9a14645b7ac69eb0639d08b` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:07:01.570686 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd24471-97f6-4aa4-b191-b6eabc62ccf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec662ce3a9a14645b7ac69eb0639d08b)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:07:01.572611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd24471-97f6-4aa4-b191-b6eabc62ccf7 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:07:01.715685 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ddd24471-97f6-4aa4-b191-b6eabc62ccf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec662ce3a9a14645b7ac69eb0639d08b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:01.727902 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ddd24471-97f6-4aa4-b191-b6eabc62ccf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec662ce3a9a14645b7ac69eb0639d08b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:01.730445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:07:01.805307 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ddd24471-97f6-4aa4-b191-b6eabc62ccf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec662ce3a9a14645b7ac69eb0639d08b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:01.805929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ddd24471-97f6-4aa4-b191-b6eabc62ccf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec662ce3a9a14645b7ac69eb0639d08b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:01.813175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ddd24471-97f6-4aa4-b191-b6eabc62ccf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec662ce3a9a14645b7ac69eb0639d08b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:01.819739 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1306/2621] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:07:01 2022] DELETE /identity/v3/users/ec662ce3a9a14645b7ac69eb0639d08b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:07:01.824169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7711f8a-808e-436d-b088-5d4cabbc4f7f None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:07:01.824703 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7711f8a-808e-436d-b088-5d4cabbc4f7f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:07:01.824860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7711f8a-808e-436d-b088-5d4cabbc4f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:07:01.837197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:07:01.843074 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-c7711f8a-808e-436d-b088-5d4cabbc4f7f None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:07:01.844954 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-c7711f8a-808e-436d-b088-5d4cabbc4f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:07:01.902925 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1316/2622] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:07:01.913202 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd24471-97f6-4aa4-b191-b6eabc62ccf7 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:07:01.914626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ddd24471-97f6-4aa4-b191-b6eabc62ccf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:07:01.971470 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd24471-97f6-4aa4-b191-b6eabc62ccf7 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:07:01.975014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf2686-ee9c-44de-bd5b-79f8a06fac8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:07:01.975667 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf2686-ee9c-44de-bd5b-79f8a06fac8d service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:07:01.975932 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf2686-ee9c-44de-bd5b-79f8a06fac8d service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:07:01.976205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf2686-ee9c-44de-bd5b-79f8a06fac8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:07:01.985203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf2686-ee9c-44de-bd5b-79f8a06fac8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:07:01.986614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf2686-ee9c-44de-bd5b-79f8a06fac8d service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:07:01.995987 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1307/2623] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:07:02.400593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7711f8a-808e-436d-b088-5d4cabbc4f7f None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:07:02.402394 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-c7711f8a-808e-436d-b088-5d4cabbc4f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:07:02.414938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7711f8a-808e-436d-b088-5d4cabbc4f7f None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:07:02.419398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1203c9d-2a33-4b59-836c-041eef12e400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:07:02.420256 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1203c9d-2a33-4b59-836c-041eef12e400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:07:02.420564 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1203c9d-2a33-4b59-836c-041eef12e400 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:07:02.420913 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1203c9d-2a33-4b59-836c-041eef12e400 admin admin] PATH_INFO: `/v3/projects/1f0930afdc584d559e0f132e0f1ee215` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:07:02.422218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1203c9d-2a33-4b59-836c-041eef12e400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0930afdc584d559e0f132e0f1ee215)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:07:02.424259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1203c9d-2a33-4b59-836c-041eef12e400 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:07:02.513614 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d1203c9d-2a33-4b59-836c-041eef12e400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0930afdc584d559e0f132e0f1ee215', 'request_id': 'req-d1203c9d-2a33-4b59-836c-041eef12e400'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:02.520523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d1203c9d-2a33-4b59-836c-041eef12e400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0930afdc584d559e0f132e0f1ee215', 'request_id': 'req-d1203c9d-2a33-4b59-836c-041eef12e400'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:02.604612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d1203c9d-2a33-4b59-836c-041eef12e400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0930afdc584d559e0f132e0f1ee215', 'request_id': 'req-d1203c9d-2a33-4b59-836c-041eef12e400'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:02.615907 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d1203c9d-2a33-4b59-836c-041eef12e400 admin admin] The token cache is being invalidate because project 1f0930afdc584d559e0f132e0f1ee215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:07:02.616193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d1203c9d-2a33-4b59-836c-041eef12e400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:02.616840 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d1203c9d-2a33-4b59-836c-041eef12e400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:02.618365 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1317/2624] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:07:02 2022] DELETE /identity/v3/projects/1f0930afdc584d559e0f132e0f1ee215 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:07:02.622250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf2686-ee9c-44de-bd5b-79f8a06fac8d service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:07:02.632401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf2686-ee9c-44de-bd5b-79f8a06fac8d service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:07:02.686844 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff862e3-f58a-4ff6-aec6-5c5999a84ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:07:02.688817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff862e3-f58a-4ff6-aec6-5c5999a84ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:07:02.688817 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff862e3-f58a-4ff6-aec6-5c5999a84ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:07:02.689176 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff862e3-f58a-4ff6-aec6-5c5999a84ce5 admin admin] PATH_INFO: `/v3/users/9085d748586b45a3a5b91f452a83ca9d` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:07:02.690086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff862e3-f58a-4ff6-aec6-5c5999a84ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9085d748586b45a3a5b91f452a83ca9d)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:07:02.692087 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff862e3-f58a-4ff6-aec6-5c5999a84ce5 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:07:02.841947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-bff862e3-f58a-4ff6-aec6-5c5999a84ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9085d748586b45a3a5b91f452a83ca9d'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:02.854412 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-bff862e3-f58a-4ff6-aec6-5c5999a84ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9085d748586b45a3a5b91f452a83ca9d'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:02.918771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-bff862e3-f58a-4ff6-aec6-5c5999a84ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9085d748586b45a3a5b91f452a83ca9d'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:02.919384 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-bff862e3-f58a-4ff6-aec6-5c5999a84ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9085d748586b45a3a5b91f452a83ca9d'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:02.927528 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-bff862e3-f58a-4ff6-aec6-5c5999a84ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9085d748586b45a3a5b91f452a83ca9d'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:02.933885 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1308/2625] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:07:02 2022] DELETE /identity/v3/users/9085d748586b45a3a5b91f452a83ca9d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:07:03.326577 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1203c9d-2a33-4b59-836c-041eef12e400 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:07:03.328065 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d1203c9d-2a33-4b59-836c-041eef12e400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:07:03.341492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1203c9d-2a33-4b59-836c-041eef12e400 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:07:03.399431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a65c4-44f5-48e9-aeaa-892c5b2d9231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:07:03.400290 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a65c4-44f5-48e9-aeaa-892c5b2d9231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:07:03.400571 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a65c4-44f5-48e9-aeaa-892c5b2d9231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:07:03.400886 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a65c4-44f5-48e9-aeaa-892c5b2d9231 admin admin] PATH_INFO: `/v3/projects/f1852fc4316148faaaf239f45b9d6ff1` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:07:03.402062 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a65c4-44f5-48e9-aeaa-892c5b2d9231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1852fc4316148faaaf239f45b9d6ff1)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:07:03.404072 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a65c4-44f5-48e9-aeaa-892c5b2d9231 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:07:03.485099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:07:03.496527 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-810a65c4-44f5-48e9-aeaa-892c5b2d9231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1852fc4316148faaaf239f45b9d6ff1', 'request_id': 'req-810a65c4-44f5-48e9-aeaa-892c5b2d9231'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:03.502662 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-810a65c4-44f5-48e9-aeaa-892c5b2d9231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1852fc4316148faaaf239f45b9d6ff1', 'request_id': 'req-810a65c4-44f5-48e9-aeaa-892c5b2d9231'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:03.559172 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-810a65c4-44f5-48e9-aeaa-892c5b2d9231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1852fc4316148faaaf239f45b9d6ff1', 'request_id': 'req-810a65c4-44f5-48e9-aeaa-892c5b2d9231'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:03.570168 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-810a65c4-44f5-48e9-aeaa-892c5b2d9231 admin admin] The token cache is being invalidate because project f1852fc4316148faaaf239f45b9d6ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:07:03.570631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-810a65c4-44f5-48e9-aeaa-892c5b2d9231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:03.571695 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-810a65c4-44f5-48e9-aeaa-892c5b2d9231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:03.573334 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1318/2626] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:07:03 2022] DELETE /identity/v3/projects/f1852fc4316148faaaf239f45b9d6ff1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:07:03.577400 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff862e3-f58a-4ff6-aec6-5c5999a84ce5 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:07:03.579453 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-bff862e3-f58a-4ff6-aec6-5c5999a84ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:07:03.592214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff862e3-f58a-4ff6-aec6-5c5999a84ce5 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:07:03.596244 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:07:03.648887 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e3bc9-f013-4866-9999-8de209552e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:07:03.649774 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3bc9-f013-4866-9999-8de209552e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:07:03.650056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3bc9-f013-4866-9999-8de209552e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:07:03.650326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3bc9-f013-4866-9999-8de209552e9e admin admin] PATH_INFO: `/v3/users/81ff49643211441da75e023132d13f09` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:07:03.651501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e3bc9-f013-4866-9999-8de209552e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ff49643211441da75e023132d13f09)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:07:03.653415 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e3bc9-f013-4866-9999-8de209552e9e admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:07:03.818080 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-835e3bc9-f013-4866-9999-8de209552e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ff49643211441da75e023132d13f09'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:03.830937 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-835e3bc9-f013-4866-9999-8de209552e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ff49643211441da75e023132d13f09'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:03.895703 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-835e3bc9-f013-4866-9999-8de209552e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ff49643211441da75e023132d13f09'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:03.896349 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-835e3bc9-f013-4866-9999-8de209552e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ff49643211441da75e023132d13f09'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:03.903371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-835e3bc9-f013-4866-9999-8de209552e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ff49643211441da75e023132d13f09'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:03.909696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1309/2627] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:07:03 2022] DELETE /identity/v3/users/81ff49643211441da75e023132d13f09 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:07:04.343404 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a65c4-44f5-48e9-aeaa-892c5b2d9231 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:07:04.344954 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-810a65c4-44f5-48e9-aeaa-892c5b2d9231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:07:04.357663 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a65c4-44f5-48e9-aeaa-892c5b2d9231 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:07:04.419270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:07:04.420127 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:07:04.420413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:07:04.420811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f admin admin] PATH_INFO: `/v3/projects/64ec826b6e554c34a441dc4abfc20f5d` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:07:04.422009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ec826b6e554c34a441dc4abfc20f5d)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:07:04.425152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:07:04.519450 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ec826b6e554c34a441dc4abfc20f5d', 'request_id': 'req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:04.525825 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ec826b6e554c34a441dc4abfc20f5d', 'request_id': 'req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:04.586877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ec826b6e554c34a441dc4abfc20f5d', 'request_id': 'req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:04.597922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f admin admin] The token cache is being invalidate because project 64ec826b6e554c34a441dc4abfc20f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:07:04.598212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:04.600260 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:07:04.600514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1319/2628] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:07:04 2022] DELETE /identity/v3/projects/64ec826b6e554c34a441dc4abfc20f5d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:07:13.906042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=50,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:07:14.594368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=63,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:07:49.930778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e3bc9-f013-4866-9999-8de209552e9e admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:07:49.932400 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-835e3bc9-f013-4866-9999-8de209552e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:07:50.016067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e3bc9-f013-4866-9999-8de209552e9e admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:07:50.086114 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecab3dd-b9de-45c8-8762-c98c769e49bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:07:50.087070 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecab3dd-b9de-45c8-8762-c98c769e49bf service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:07:50.087358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecab3dd-b9de-45c8-8762-c98c769e49bf service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:07:50.087636 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecab3dd-b9de-45c8-8762-c98c769e49bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:07:50.089530 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-aecab3dd-b9de-45c8-8762-c98c769e49bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:07:50.106770 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecab3dd-b9de-45c8-8762-c98c769e49bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:07:50.109773 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecab3dd-b9de-45c8-8762-c98c769e49bf service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:07:50.123460 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1310/2629] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:07:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:07:56.254053 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:07:56.259053 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:07:56.313550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761ddbe-b34a-4a7e-88b6-d0d32a92e26f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:07:56.318389 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbdf51-b558-44d4-b7b2-cc4b48b83371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:07:56.319038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbdf51-b558-44d4-b7b2-cc4b48b83371 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:07:56.319326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbdf51-b558-44d4-b7b2-cc4b48b83371 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:07:56.319608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbdf51-b558-44d4-b7b2-cc4b48b83371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:07:56.321454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-5bcbdf51-b558-44d4-b7b2-cc4b48b83371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:07:56.397120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbdf51-b558-44d4-b7b2-cc4b48b83371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:07:56.398575 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbdf51-b558-44d4-b7b2-cc4b48b83371 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:07:56.409927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1320/2630] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:08:00.118620 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=62 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:00.168163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecab3dd-b9de-45c8-8762-c98c769e49bf service nova] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:00.170722 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-aecab3dd-b9de-45c8-8762-c98c769e49bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:00.243182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecab3dd-b9de-45c8-8762-c98c769e49bf service nova] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:00.248123 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2214b-8ce0-4276-865a-e6a13903e19f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:00.249015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2214b-8ce0-4276-865a-e6a13903e19f service placement] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:00.249582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2214b-8ce0-4276-865a-e6a13903e19f service placement] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:00.250036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2214b-8ce0-4276-865a-e6a13903e19f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:00.253032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-cbb2214b-8ce0-4276-865a-e6a13903e19f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:00.265173 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2214b-8ce0-4276-865a-e6a13903e19f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:00.266763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2214b-8ce0-4276-865a-e6a13903e19f service placement] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:00.277197 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1311/2631] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:00.291505 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbdf51-b558-44d4-b7b2-cc4b48b83371 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:00.293107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-5bcbdf51-b558-44d4-b7b2-cc4b48b83371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:00.307098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbdf51-b558-44d4-b7b2-cc4b48b83371 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:00.312175 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5703a39-4d28-4151-ab0c-ba285fbc9ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:00.313153 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5703a39-4d28-4151-ab0c-ba285fbc9ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:00.313435 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5703a39-4d28-4151-ab0c-ba285fbc9ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:00.313709 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5703a39-4d28-4151-ab0c-ba285fbc9ff0 admin admin] PATH_INFO: `/v3/users/d93abd4361d240919ec85cf4b92347fb` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:00.315472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5703a39-4d28-4151-ab0c-ba285fbc9ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d93abd4361d240919ec85cf4b92347fb)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:00.317452 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5703a39-4d28-4151-ab0c-ba285fbc9ff0 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:00.531776 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f5703a39-4d28-4151-ab0c-ba285fbc9ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd93abd4361d240919ec85cf4b92347fb'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:00.543550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f5703a39-4d28-4151-ab0c-ba285fbc9ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd93abd4361d240919ec85cf4b92347fb'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:00.632148 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f5703a39-4d28-4151-ab0c-ba285fbc9ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd93abd4361d240919ec85cf4b92347fb'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:00.632795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f5703a39-4d28-4151-ab0c-ba285fbc9ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd93abd4361d240919ec85cf4b92347fb'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:00.640254 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f5703a39-4d28-4151-ab0c-ba285fbc9ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd93abd4361d240919ec85cf4b92347fb'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:00.646267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1321/2632] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:08:00 2022] DELETE /identity/v3/users/d93abd4361d240919ec85cf4b92347fb => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:00.907921 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2214b-8ce0-4276-865a-e6a13903e19f service placement] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:00.919258 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2214b-8ce0-4276-865a-e6a13903e19f service placement] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:00.991632 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d79ad3-9587-4624-becc-fe9415f53e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:00.992545 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d79ad3-9587-4624-becc-fe9415f53e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:00.992909 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d79ad3-9587-4624-becc-fe9415f53e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:00.993184 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d79ad3-9587-4624-becc-fe9415f53e9f admin admin] PATH_INFO: `/v3/projects/3d96ee908883411d9838f850ee7dd66b` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:00.994479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d79ad3-9587-4624-becc-fe9415f53e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d96ee908883411d9838f850ee7dd66b)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:00.996405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d79ad3-9587-4624-becc-fe9415f53e9f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:01.108245 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d7d79ad3-9587-4624-becc-fe9415f53e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d96ee908883411d9838f850ee7dd66b', 'request_id': 'req-d7d79ad3-9587-4624-becc-fe9415f53e9f'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:01.221014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d7d79ad3-9587-4624-becc-fe9415f53e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d96ee908883411d9838f850ee7dd66b', 'request_id': 'req-d7d79ad3-9587-4624-becc-fe9415f53e9f'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:01.228170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d7d79ad3-9587-4624-becc-fe9415f53e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d96ee908883411d9838f850ee7dd66b', 'request_id': 'req-d7d79ad3-9587-4624-becc-fe9415f53e9f'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:01.238436 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d7d79ad3-9587-4624-becc-fe9415f53e9f admin admin] The token cache is being invalidate because project 3d96ee908883411d9838f850ee7dd66b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:08:01.238765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d7d79ad3-9587-4624-becc-fe9415f53e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:01.239367 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-d7d79ad3-9587-4624-becc-fe9415f53e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:01.240958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1312/2633] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:08:00 2022] DELETE /identity/v3/projects/3d96ee908883411d9838f850ee7dd66b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:01.245889 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fc673-1493-4c2b-bc8d-78a464f31755 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:01.246185 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fc673-1493-4c2b-bc8d-78a464f31755 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:01.246465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fc673-1493-4c2b-bc8d-78a464f31755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:01.265239 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-5a3fc673-1493-4c2b-bc8d-78a464f31755 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:01.266445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-5a3fc673-1493-4c2b-bc8d-78a464f31755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:01.286438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:01.336193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1322/2634] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:08:01.339419 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcd8f6-bfb0-4313-9f21-fa21532406d3 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:01.339419 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcd8f6-bfb0-4313-9f21-fa21532406d3 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:01.339419 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcd8f6-bfb0-4313-9f21-fa21532406d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:01.357618 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-aedcd8f6-bfb0-4313-9f21-fa21532406d3 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:01.358825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-aedcd8f6-bfb0-4313-9f21-fa21532406d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:01.367234 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1313/2635] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:01.371481 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fc673-1493-4c2b-bc8d-78a464f31755 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:01.382180 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fc673-1493-4c2b-bc8d-78a464f31755 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:01.386996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641032d1-d9f9-452f-a05c-d4c80862e53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:01.387648 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641032d1-d9f9-452f-a05c-d4c80862e53f admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:01.387936 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641032d1-d9f9-452f-a05c-d4c80862e53f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:01.388217 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641032d1-d9f9-452f-a05c-d4c80862e53f admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:01.389020 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641032d1-d9f9-452f-a05c-d4c80862e53f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:08:01.389330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641032d1-d9f9-452f-a05c-d4c80862e53f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:01.390980 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641032d1-d9f9-452f-a05c-d4c80862e53f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:01.403818 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1323/2636] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 15:08:01.407886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcd8f6-bfb0-4313-9f21-fa21532406d3 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:01.417426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcd8f6-bfb0-4313-9f21-fa21532406d3 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:01.422108 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f1204-0dde-47c3-912d-d8afe48dcab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:01.422747 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f1204-0dde-47c3-912d-d8afe48dcab8 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:01.423028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f1204-0dde-47c3-912d-d8afe48dcab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:01.423301 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f1204-0dde-47c3-912d-d8afe48dcab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:01.424036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f1204-0dde-47c3-912d-d8afe48dcab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:01.425974 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f1204-0dde-47c3-912d-d8afe48dcab8 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:01.435925 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:01.548110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1314/2637] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:08:01 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:08:01.552181 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641032d1-d9f9-452f-a05c-d4c80862e53f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:01.562311 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641032d1-d9f9-452f-a05c-d4c80862e53f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:01.619969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e0c22-de57-407d-8fc5-581c5906a725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:01.620631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e0c22-de57-407d-8fc5-581c5906a725 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:01.620943 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e0c22-de57-407d-8fc5-581c5906a725 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:01.621222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e0c22-de57-407d-8fc5-581c5906a725 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:01.621922 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e0c22-de57-407d-8fc5-581c5906a725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:01.623819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e0c22-de57-407d-8fc5-581c5906a725 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:01.707646 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1324/2638] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:08:01 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:08:01.711575 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f1204-0dde-47c3-912d-d8afe48dcab8 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:01.722025 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f1204-0dde-47c3-912d-d8afe48dcab8 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:01.727012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e883b-c915-4aeb-877e-ad99238c8e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:01.727675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e883b-c915-4aeb-877e-ad99238c8e4f admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:01.727952 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e883b-c915-4aeb-877e-ad99238c8e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:01.728231 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e883b-c915-4aeb-877e-ad99238c8e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:01.729224 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e883b-c915-4aeb-877e-ad99238c8e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:01.730862 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e883b-c915-4aeb-877e-ad99238c8e4f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:01.742013 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1315/2639] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:08:01.745957 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e0c22-de57-407d-8fc5-581c5906a725 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:01.757170 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e0c22-de57-407d-8fc5-581c5906a725 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:01.761887 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42d03f-e287-48c0-aba5-b84c461b46bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:01.762573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42d03f-e287-48c0-aba5-b84c461b46bd admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:01.762823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42d03f-e287-48c0-aba5-b84c461b46bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:01.763121 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42d03f-e287-48c0-aba5-b84c461b46bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:01.763838 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42d03f-e287-48c0-aba5-b84c461b46bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:01.765439 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42d03f-e287-48c0-aba5-b84c461b46bd admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:01.775436 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1325/2640] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:08:01.779809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e883b-c915-4aeb-877e-ad99238c8e4f admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:01.790482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e883b-c915-4aeb-877e-ad99238c8e4f admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:01.804927 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb2e69-9e1e-4162-ba77-02c41e307fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:01.804927 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb2e69-9e1e-4162-ba77-02c41e307fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:01.804927 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb2e69-9e1e-4162-ba77-02c41e307fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:01.804927 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb2e69-9e1e-4162-ba77-02c41e307fdc admin admin] PATH_INFO: `/v3/projects/6900e202b511498fa4f15f21e589127c/users/115aeebf9834427993165751c9859fe6/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:01.812001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb2e69-9e1e-4162-ba77-02c41e307fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6900e202b511498fa4f15f21e589127c, user_id=115aeebf9834427993165751c9859fe6, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:01.814694 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb2e69-9e1e-4162-ba77-02c41e307fdc admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:01.895504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1316/2641] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:08:01 2022] PUT /identity/v3/projects/6900e202b511498fa4f15f21e589127c/users/115aeebf9834427993165751c9859fe6/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:01.906405 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea2a58-b2ef-47dd-ad62-f80464dbdedf None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:01.906697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea2a58-b2ef-47dd-ad62-f80464dbdedf None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:01.906974 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea2a58-b2ef-47dd-ad62-f80464dbdedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:01.933364 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-3aea2a58-b2ef-47dd-ad62-f80464dbdedf None None] MFA Rules not processed for user `115aeebf9834427993165751c9859fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:01.934593 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-3aea2a58-b2ef-47dd-ad62-f80464dbdedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:02.001288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1326/2642] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:02.012665 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb2e69-9e1e-4162-ba77-02c41e307fdc admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:02.014365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-61cb2e69-9e1e-4162-ba77-02c41e307fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:02.088110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb2e69-9e1e-4162-ba77-02c41e307fdc admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:02.093859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c13441-a0b3-4951-bb4c-de794299fe82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:02.094507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c13441-a0b3-4951-bb4c-de794299fe82 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:02.094786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c13441-a0b3-4951-bb4c-de794299fe82 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:02.095058 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c13441-a0b3-4951-bb4c-de794299fe82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:02.104117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c13441-a0b3-4951-bb4c-de794299fe82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:02.105849 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c13441-a0b3-4951-bb4c-de794299fe82 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:02.115971 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1317/2643] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:02.871654 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea2a58-b2ef-47dd-ad62-f80464dbdedf None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:02.873096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-3aea2a58-b2ef-47dd-ad62-f80464dbdedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:02.893287 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:02.930787 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea2a58-b2ef-47dd-ad62-f80464dbdedf None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:02.934375 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781e541-5878-4e4f-9766-48b207f9f863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:02.935016 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781e541-5878-4e4f-9766-48b207f9f863 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:02.935299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781e541-5878-4e4f-9766-48b207f9f863 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:02.935576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781e541-5878-4e4f-9766-48b207f9f863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:02.937328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d781e541-5878-4e4f-9766-48b207f9f863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:03.000972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781e541-5878-4e4f-9766-48b207f9f863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:03.002400 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781e541-5878-4e4f-9766-48b207f9f863 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:03.012986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1327/2644] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:06.359763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c13441-a0b3-4951-bb4c-de794299fe82 service nova] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:06.361319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f6c13441-a0b3-4951-bb4c-de794299fe82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:06.442119 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c13441-a0b3-4951-bb4c-de794299fe82 service nova] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:06.446934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bd16a-6780-4d16-a3f0-3731143d19ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:06.447793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bd16a-6780-4d16-a3f0-3731143d19ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:06.448071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bd16a-6780-4d16-a3f0-3731143d19ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:06.448342 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bd16a-6780-4d16-a3f0-3731143d19ac admin admin] PATH_INFO: `/v3/users/29e7fc2290a641bcb6f1f96501f98d69` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:06.449544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bd16a-6780-4d16-a3f0-3731143d19ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=29e7fc2290a641bcb6f1f96501f98d69)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:06.451429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bd16a-6780-4d16-a3f0-3731143d19ac admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:06.614308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:06.624099 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6d8bd16a-6780-4d16-a3f0-3731143d19ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29e7fc2290a641bcb6f1f96501f98d69'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:06.635870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6d8bd16a-6780-4d16-a3f0-3731143d19ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29e7fc2290a641bcb6f1f96501f98d69'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:06.701054 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6d8bd16a-6780-4d16-a3f0-3731143d19ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29e7fc2290a641bcb6f1f96501f98d69'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:06.701719 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6d8bd16a-6780-4d16-a3f0-3731143d19ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29e7fc2290a641bcb6f1f96501f98d69'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:06.708873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6d8bd16a-6780-4d16-a3f0-3731143d19ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29e7fc2290a641bcb6f1f96501f98d69'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:06.714818 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1318/2645] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:08:06 2022] DELETE /identity/v3/users/29e7fc2290a641bcb6f1f96501f98d69 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:06.965604 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781e541-5878-4e4f-9766-48b207f9f863 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:07.024432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781e541-5878-4e4f-9766-48b207f9f863 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:07.087346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9db0c8-10d9-4c60-9f3c-e62895a082be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:07.088213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9db0c8-10d9-4c60-9f3c-e62895a082be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:07.088500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9db0c8-10d9-4c60-9f3c-e62895a082be admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:07.088810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9db0c8-10d9-4c60-9f3c-e62895a082be admin admin] PATH_INFO: `/v3/projects/93e1b27eb6724262b7a128c8412642d6` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:07.090026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9db0c8-10d9-4c60-9f3c-e62895a082be admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e1b27eb6724262b7a128c8412642d6)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:07.091932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9db0c8-10d9-4c60-9f3c-e62895a082be admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:07.185952 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:07.198259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-cc9db0c8-10d9-4c60-9f3c-e62895a082be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e1b27eb6724262b7a128c8412642d6', 'request_id': 'req-cc9db0c8-10d9-4c60-9f3c-e62895a082be'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:07.204195 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-cc9db0c8-10d9-4c60-9f3c-e62895a082be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e1b27eb6724262b7a128c8412642d6', 'request_id': 'req-cc9db0c8-10d9-4c60-9f3c-e62895a082be'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:07.266564 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-cc9db0c8-10d9-4c60-9f3c-e62895a082be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e1b27eb6724262b7a128c8412642d6', 'request_id': 'req-cc9db0c8-10d9-4c60-9f3c-e62895a082be'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:07.277624 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-cc9db0c8-10d9-4c60-9f3c-e62895a082be admin admin] The token cache is being invalidate because project 93e1b27eb6724262b7a128c8412642d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:08:07.278234 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-cc9db0c8-10d9-4c60-9f3c-e62895a082be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:07.279240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-cc9db0c8-10d9-4c60-9f3c-e62895a082be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:07.280824 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1328/2646] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:08:06 2022] DELETE /identity/v3/projects/93e1b27eb6724262b7a128c8412642d6 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:07.285758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66648a2b-3f5c-48ba-9cd3-a4869e886b3d None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:07.286045 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66648a2b-3f5c-48ba-9cd3-a4869e886b3d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:07.286319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66648a2b-3f5c-48ba-9cd3-a4869e886b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:07.331556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-66648a2b-3f5c-48ba-9cd3-a4869e886b3d None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:07.332786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-66648a2b-3f5c-48ba-9cd3-a4869e886b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:07.390781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1319/2647] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:07.399289 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b7f19-c092-4779-9d75-a94676f73798 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:07.399581 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b7f19-c092-4779-9d75-a94676f73798 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:07.399864 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b7f19-c092-4779-9d75-a94676f73798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:07.417783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-081b7f19-c092-4779-9d75-a94676f73798 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:07.418989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-081b7f19-c092-4779-9d75-a94676f73798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:07.426848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1329/2648] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:07.431161 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66648a2b-3f5c-48ba-9cd3-a4869e886b3d None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:07.440712 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66648a2b-3f5c-48ba-9cd3-a4869e886b3d None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:07.446018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0f253-2ee4-42f2-add1-152be6562795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:07.446659 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0f253-2ee4-42f2-add1-152be6562795 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:07.446942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0f253-2ee4-42f2-add1-152be6562795 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:07.447218 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0f253-2ee4-42f2-add1-152be6562795 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:07.447943 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0f253-2ee4-42f2-add1-152be6562795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:08:07.448249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0f253-2ee4-42f2-add1-152be6562795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:07.449923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0f253-2ee4-42f2-add1-152be6562795 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:07.462020 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1320/2649] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:08:07.466056 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b7f19-c092-4779-9d75-a94676f73798 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:07.475412 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b7f19-c092-4779-9d75-a94676f73798 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:07.480092 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c0e6d-de3f-4248-9dab-c36292ddfd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:07.480768 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c0e6d-de3f-4248-9dab-c36292ddfd8e admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:07.481054 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c0e6d-de3f-4248-9dab-c36292ddfd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:07.481327 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c0e6d-de3f-4248-9dab-c36292ddfd8e admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:07.482009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c0e6d-de3f-4248-9dab-c36292ddfd8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:07.483910 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c0e6d-de3f-4248-9dab-c36292ddfd8e admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:07.581943 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1330/2650] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:08:07 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:08:07.586786 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0f253-2ee4-42f2-add1-152be6562795 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:07.596859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0f253-2ee4-42f2-add1-152be6562795 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:07.653866 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ad1b6-8663-42d6-beee-c835315774e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:07.656824 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ad1b6-8663-42d6-beee-c835315774e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:07.657057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ad1b6-8663-42d6-beee-c835315774e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:07.657347 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ad1b6-8663-42d6-beee-c835315774e6 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:07.658060 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ad1b6-8663-42d6-beee-c835315774e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:07.660030 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ad1b6-8663-42d6-beee-c835315774e6 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:07.786869 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1321/2651] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:08:07 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:08:07.790931 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c0e6d-de3f-4248-9dab-c36292ddfd8e admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:07.801129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c0e6d-de3f-4248-9dab-c36292ddfd8e admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:07.806447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f23070-6976-4eee-8f7f-1122f45ee439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:07.807094 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f23070-6976-4eee-8f7f-1122f45ee439 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:07.807379 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f23070-6976-4eee-8f7f-1122f45ee439 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:07.807657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f23070-6976-4eee-8f7f-1122f45ee439 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:07.808380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f23070-6976-4eee-8f7f-1122f45ee439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:07.810003 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f23070-6976-4eee-8f7f-1122f45ee439 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:07.820881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1331/2652] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:08:07.824692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ad1b6-8663-42d6-beee-c835315774e6 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:07.834585 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ad1b6-8663-42d6-beee-c835315774e6 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:07.839228 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56640e63-3fbc-4b70-bc65-00535f8277cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:07.839908 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56640e63-3fbc-4b70-bc65-00535f8277cd admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:07.840192 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56640e63-3fbc-4b70-bc65-00535f8277cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:07.840469 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56640e63-3fbc-4b70-bc65-00535f8277cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:07.841248 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56640e63-3fbc-4b70-bc65-00535f8277cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:07.842843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56640e63-3fbc-4b70-bc65-00535f8277cd admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:07.844074 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:07.854912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1322/2653] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:08:07.861753 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f23070-6976-4eee-8f7f-1122f45ee439 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:07.871972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f23070-6976-4eee-8f7f-1122f45ee439 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:07.876496 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe6a19-6b93-4b37-8291-6f8d36895c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:07.877396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe6a19-6b93-4b37-8291-6f8d36895c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:07.877678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe6a19-6b93-4b37-8291-6f8d36895c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:07.877956 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe6a19-6b93-4b37-8291-6f8d36895c24 admin admin] PATH_INFO: `/v3/projects/fa77b298448a40bbb2f12e1b5b9c5967/users/093402db51104953a681418b958b2c38/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:07.892790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe6a19-6b93-4b37-8291-6f8d36895c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa77b298448a40bbb2f12e1b5b9c5967, user_id=093402db51104953a681418b958b2c38, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:07.895411 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe6a19-6b93-4b37-8291-6f8d36895c24 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:07.981107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1332/2654] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:08:07 2022] PUT /identity/v3/projects/fa77b298448a40bbb2f12e1b5b9c5967/users/093402db51104953a681418b958b2c38/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:07.986171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483f8ed-fd76-401d-9fb2-e1032ae132ad None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:07.986691 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483f8ed-fd76-401d-9fb2-e1032ae132ad None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:07.987140 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483f8ed-fd76-401d-9fb2-e1032ae132ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:08.004868 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-7483f8ed-fd76-401d-9fb2-e1032ae132ad None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:08.006086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7483f8ed-fd76-401d-9fb2-e1032ae132ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:08.064980 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1323/2655] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:08:08.074431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe6a19-6b93-4b37-8291-6f8d36895c24 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:08.076115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-53fe6a19-6b93-4b37-8291-6f8d36895c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:08.150226 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe6a19-6b93-4b37-8291-6f8d36895c24 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:08.153883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b11a47-0be8-4ae6-b6cc-3863b3085042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:08.154518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b11a47-0be8-4ae6-b6cc-3863b3085042 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:08.154798 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b11a47-0be8-4ae6-b6cc-3863b3085042 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:08.155070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b11a47-0be8-4ae6-b6cc-3863b3085042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:08.164755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b11a47-0be8-4ae6-b6cc-3863b3085042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:08.167825 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b11a47-0be8-4ae6-b6cc-3863b3085042 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:08.176062 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1333/2656] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:12.480344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483f8ed-fd76-401d-9fb2-e1032ae132ad None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:12.480344 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7483f8ed-fd76-401d-9fb2-e1032ae132ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:12.490653 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483f8ed-fd76-401d-9fb2-e1032ae132ad None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:12.495441 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62cd41-5d2e-4d6a-b6fd-67c4c843c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:12.496308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62cd41-5d2e-4d6a-b6fd-67c4c843c03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:12.496584 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62cd41-5d2e-4d6a-b6fd-67c4c843c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:12.496893 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62cd41-5d2e-4d6a-b6fd-67c4c843c03a admin admin] PATH_INFO: `/v3/users/115aeebf9834427993165751c9859fe6` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:12.498084 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62cd41-5d2e-4d6a-b6fd-67c4c843c03a admin admin] RBAC: Authorizing `identity:delete_user(user_id=115aeebf9834427993165751c9859fe6)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:12.499977 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62cd41-5d2e-4d6a-b6fd-67c4c843c03a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:12.699181 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-7b62cd41-5d2e-4d6a-b6fd-67c4c843c03a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115aeebf9834427993165751c9859fe6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:12.712328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-7b62cd41-5d2e-4d6a-b6fd-67c4c843c03a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115aeebf9834427993165751c9859fe6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:12.798318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-7b62cd41-5d2e-4d6a-b6fd-67c4c843c03a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115aeebf9834427993165751c9859fe6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:12.803174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-7b62cd41-5d2e-4d6a-b6fd-67c4c843c03a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115aeebf9834427993165751c9859fe6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:12.809127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-7b62cd41-5d2e-4d6a-b6fd-67c4c843c03a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115aeebf9834427993165751c9859fe6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:12.818841 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1324/2657] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:08:12 2022] DELETE /identity/v3/users/115aeebf9834427993165751c9859fe6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:12.823938 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae38c9-0300-4011-a41c-b728caa9e597 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:12.827834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae38c9-0300-4011-a41c-b728caa9e597 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:12.827834 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae38c9-0300-4011-a41c-b728caa9e597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:12.848504 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a1ae38c9-0300-4011-a41c-b728caa9e597 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:12.851874 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a1ae38c9-0300-4011-a41c-b728caa9e597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:12.904321 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:12.945325 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1334/2658] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:12.948345 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62cd41-5d2e-4d6a-b6fd-67c4c843c03a admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:12.950063 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7b62cd41-5d2e-4d6a-b6fd-67c4c843c03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:13.054385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62cd41-5d2e-4d6a-b6fd-67c4c843c03a admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:13.059303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3746c94-6173-47c2-8baf-0332ccf9c76b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:13.060041 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3746c94-6173-47c2-8baf-0332ccf9c76b service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:13.060318 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3746c94-6173-47c2-8baf-0332ccf9c76b service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:13.060592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3746c94-6173-47c2-8baf-0332ccf9c76b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:13.071000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3746c94-6173-47c2-8baf-0332ccf9c76b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:13.072518 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3746c94-6173-47c2-8baf-0332ccf9c76b service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:13.087377 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1325/2659] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:13.671842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae38c9-0300-4011-a41c-b728caa9e597 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:13.673954 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a1ae38c9-0300-4011-a41c-b728caa9e597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:13.715284 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae38c9-0300-4011-a41c-b728caa9e597 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:13.724682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149d852-b441-47ee-9b53-3ce0dd78656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:13.730795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149d852-b441-47ee-9b53-3ce0dd78656d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:13.733338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149d852-b441-47ee-9b53-3ce0dd78656d admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:13.733590 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149d852-b441-47ee-9b53-3ce0dd78656d admin admin] PATH_INFO: `/v3/projects/6900e202b511498fa4f15f21e589127c` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:13.737506 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149d852-b441-47ee-9b53-3ce0dd78656d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6900e202b511498fa4f15f21e589127c)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:13.740094 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149d852-b441-47ee-9b53-3ce0dd78656d admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:13.859687 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b500062-5ea5-4afc-8942-7caf9d69faba None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:13.860296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b500062-5ea5-4afc-8942-7caf9d69faba None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:13.860296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b500062-5ea5-4afc-8942-7caf9d69faba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:13.885804 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:13.889653 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3149d852-b441-47ee-9b53-3ce0dd78656d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6900e202b511498fa4f15f21e589127c', 'request_id': 'req-3149d852-b441-47ee-9b53-3ce0dd78656d'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:13.895355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-7b500062-5ea5-4afc-8942-7caf9d69faba None None] MFA Rules not processed for user `093402db51104953a681418b958b2c38`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:13.897491 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3149d852-b441-47ee-9b53-3ce0dd78656d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6900e202b511498fa4f15f21e589127c', 'request_id': 'req-3149d852-b441-47ee-9b53-3ce0dd78656d'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:13.897626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7b500062-5ea5-4afc-8942-7caf9d69faba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:13.966104 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1326/2660] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:08:13.980967 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3149d852-b441-47ee-9b53-3ce0dd78656d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6900e202b511498fa4f15f21e589127c', 'request_id': 'req-3149d852-b441-47ee-9b53-3ce0dd78656d'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:13.984072 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b500062-5ea5-4afc-8942-7caf9d69faba None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:13.985777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7b500062-5ea5-4afc-8942-7caf9d69faba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:13.994531 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3149d852-b441-47ee-9b53-3ce0dd78656d admin admin] The token cache is being invalidate because project 6900e202b511498fa4f15f21e589127c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:08:13.995001 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3149d852-b441-47ee-9b53-3ce0dd78656d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:13.995797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-3149d852-b441-47ee-9b53-3ce0dd78656d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:13.997693 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1335/2661] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:08:13 2022] DELETE /identity/v3/projects/6900e202b511498fa4f15f21e589127c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:14.009643 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6280a-bfbe-4ee7-b003-881aef013dd8 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:14.009918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6280a-bfbe-4ee7-b003-881aef013dd8 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:14.010199 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6280a-bfbe-4ee7-b003-881aef013dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:14.030032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-2ab6280a-bfbe-4ee7-b003-881aef013dd8 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:14.031712 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-2ab6280a-bfbe-4ee7-b003-881aef013dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:14.071462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b500062-5ea5-4afc-8942-7caf9d69faba None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:14.077127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99eab9b-03b5-4ac1-bdaa-c7b29fb8c1c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:14.077784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99eab9b-03b5-4ac1-bdaa-c7b29fb8c1c8 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:14.078065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99eab9b-03b5-4ac1-bdaa-c7b29fb8c1c8 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:14.078334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99eab9b-03b5-4ac1-bdaa-c7b29fb8c1c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:14.080352 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f99eab9b-03b5-4ac1-bdaa-c7b29fb8c1c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:14.092266 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99eab9b-03b5-4ac1-bdaa-c7b29fb8c1c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:14.093946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99eab9b-03b5-4ac1-bdaa-c7b29fb8c1c8 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:14.105856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1327/2662] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:14.112167 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1336/2663] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:08:14.120769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322034f-7491-4082-b234-5e2145442dce None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:14.123232 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322034f-7491-4082-b234-5e2145442dce None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:14.123232 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322034f-7491-4082-b234-5e2145442dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:14.140903 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-6322034f-7491-4082-b234-5e2145442dce None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:14.146759 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6322034f-7491-4082-b234-5e2145442dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:14.151335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1328/2664] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:14.155681 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6280a-bfbe-4ee7-b003-881aef013dd8 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:14.167040 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6280a-bfbe-4ee7-b003-881aef013dd8 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:14.171997 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65250fb-8477-40c0-8bb9-449ed7fd9ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:14.172687 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65250fb-8477-40c0-8bb9-449ed7fd9ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:14.172978 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65250fb-8477-40c0-8bb9-449ed7fd9ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:14.173255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65250fb-8477-40c0-8bb9-449ed7fd9ad7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:14.174132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65250fb-8477-40c0-8bb9-449ed7fd9ad7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:08:14.174442 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65250fb-8477-40c0-8bb9-449ed7fd9ad7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:14.176083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65250fb-8477-40c0-8bb9-449ed7fd9ad7 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:14.198129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1337/2665] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:08:14.198312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322034f-7491-4082-b234-5e2145442dce None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:14.204000 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322034f-7491-4082-b234-5e2145442dce None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:14.209046 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef3b48-30bf-48fd-89b2-4d73e8e9ea54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:14.209862 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef3b48-30bf-48fd-89b2-4d73e8e9ea54 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:14.210210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef3b48-30bf-48fd-89b2-4d73e8e9ea54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:14.210556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef3b48-30bf-48fd-89b2-4d73e8e9ea54 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:14.211319 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef3b48-30bf-48fd-89b2-4d73e8e9ea54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:14.213467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef3b48-30bf-48fd-89b2-4d73e8e9ea54 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:14.323338 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1329/2666] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:08:14 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:08:14.324939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65250fb-8477-40c0-8bb9-449ed7fd9ad7 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:14.338005 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65250fb-8477-40c0-8bb9-449ed7fd9ad7 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:14.396920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:14.406705 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee18f9-1fe2-4e39-9489-ce537af22d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:14.407402 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee18f9-1fe2-4e39-9489-ce537af22d4d admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:14.407695 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee18f9-1fe2-4e39-9489-ce537af22d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:14.407953 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee18f9-1fe2-4e39-9489-ce537af22d4d admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:14.408661 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee18f9-1fe2-4e39-9489-ce537af22d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:14.410607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee18f9-1fe2-4e39-9489-ce537af22d4d admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:14.498472 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1338/2667] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:08:14 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:08:14.499685 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef3b48-30bf-48fd-89b2-4d73e8e9ea54 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:14.510163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef3b48-30bf-48fd-89b2-4d73e8e9ea54 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:14.515076 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04015bbd-b16e-45d5-90ec-6b6b14027a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:14.515769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04015bbd-b16e-45d5-90ec-6b6b14027a0e admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:14.516048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04015bbd-b16e-45d5-90ec-6b6b14027a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:14.516443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04015bbd-b16e-45d5-90ec-6b6b14027a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:14.517262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04015bbd-b16e-45d5-90ec-6b6b14027a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:14.518843 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04015bbd-b16e-45d5-90ec-6b6b14027a0e admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:14.530521 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1330/2668] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:08:14.534865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee18f9-1fe2-4e39-9489-ce537af22d4d admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:14.546085 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee18f9-1fe2-4e39-9489-ce537af22d4d admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:14.550775 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c597f-02f2-4be8-bfab-73275198aeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:14.551483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c597f-02f2-4be8-bfab-73275198aeed admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:14.551748 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c597f-02f2-4be8-bfab-73275198aeed admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:14.552031 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c597f-02f2-4be8-bfab-73275198aeed admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:14.553120 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c597f-02f2-4be8-bfab-73275198aeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:14.554962 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c597f-02f2-4be8-bfab-73275198aeed admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:14.565522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1339/2669] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:08:14.570185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04015bbd-b16e-45d5-90ec-6b6b14027a0e admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:14.580217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04015bbd-b16e-45d5-90ec-6b6b14027a0e admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:14.586089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c692e30-67af-49f8-bd4e-e4432fda7a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:14.587094 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c692e30-67af-49f8-bd4e-e4432fda7a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:14.590266 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c692e30-67af-49f8-bd4e-e4432fda7a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:14.590266 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c692e30-67af-49f8-bd4e-e4432fda7a25 admin admin] PATH_INFO: `/v3/projects/96a480b54ff64ea0a90762bec32c3a0f/users/0213f9d061e44262942b3e9fff7d4fc6/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:14.605091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c692e30-67af-49f8-bd4e-e4432fda7a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a480b54ff64ea0a90762bec32c3a0f, user_id=0213f9d061e44262942b3e9fff7d4fc6, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:14.607770 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c692e30-67af-49f8-bd4e-e4432fda7a25 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:14.707199 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1331/2670] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:08:14 2022] PUT /identity/v3/projects/96a480b54ff64ea0a90762bec32c3a0f/users/0213f9d061e44262942b3e9fff7d4fc6/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:14.718247 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b9b38-e79b-4b92-8af2-2fbbac827f42 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:14.718534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b9b38-e79b-4b92-8af2-2fbbac827f42 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:14.718810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b9b38-e79b-4b92-8af2-2fbbac827f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:14.752544 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-490b9b38-e79b-4b92-8af2-2fbbac827f42 None None] MFA Rules not processed for user `0213f9d061e44262942b3e9fff7d4fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:14.753893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-490b9b38-e79b-4b92-8af2-2fbbac827f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:14.829801 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1340/2671] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:14.844134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c692e30-67af-49f8-bd4e-e4432fda7a25 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:14.846714 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-9c692e30-67af-49f8-bd4e-e4432fda7a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:14.875848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:14.929835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c692e30-67af-49f8-bd4e-e4432fda7a25 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:14.936412 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd6107-e26a-4595-96cb-5fabb31a9ea5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:14.937411 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd6107-e26a-4595-96cb-5fabb31a9ea5 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:14.937777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd6107-e26a-4595-96cb-5fabb31a9ea5 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:14.938155 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd6107-e26a-4595-96cb-5fabb31a9ea5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:14.948579 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd6107-e26a-4595-96cb-5fabb31a9ea5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:14.950204 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd6107-e26a-4595-96cb-5fabb31a9ea5 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:14.960380 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1332/2672] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:16.436073 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62433ec-738d-46c4-b93b-280efcb0e7f9 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:16.436536 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62433ec-738d-46c4-b93b-280efcb0e7f9 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:16.436770 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62433ec-738d-46c4-b93b-280efcb0e7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:16.454680 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-b62433ec-738d-46c4-b93b-280efcb0e7f9 None None] MFA Rules not processed for user `093402db51104953a681418b958b2c38`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:16.455896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b62433ec-738d-46c4-b93b-280efcb0e7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:16.519142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1341/2673] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:16.884509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd6107-e26a-4595-96cb-5fabb31a9ea5 service nova] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:16.885987 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-e4fd6107-e26a-4595-96cb-5fabb31a9ea5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:16.945169 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd6107-e26a-4595-96cb-5fabb31a9ea5 service nova] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:16.949262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759eeb58-e050-436e-a056-d01a22e49f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:16.949917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759eeb58-e050-436e-a056-d01a22e49f72 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:16.950195 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759eeb58-e050-436e-a056-d01a22e49f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:16.950470 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759eeb58-e050-436e-a056-d01a22e49f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:16.952254 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-759eeb58-e050-436e-a056-d01a22e49f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:16.962596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759eeb58-e050-436e-a056-d01a22e49f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:16.964006 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759eeb58-e050-436e-a056-d01a22e49f72 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:16.972924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1333/2674] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:17.418288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62433ec-738d-46c4-b93b-280efcb0e7f9 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:17.418288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-b62433ec-738d-46c4-b93b-280efcb0e7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:17.506048 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62433ec-738d-46c4-b93b-280efcb0e7f9 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:17.511140 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307f24a-c48d-40bc-8ccb-adfd7f404d5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:17.511786 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307f24a-c48d-40bc-8ccb-adfd7f404d5a service placement] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:17.512176 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307f24a-c48d-40bc-8ccb-adfd7f404d5a service placement] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:17.512337 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307f24a-c48d-40bc-8ccb-adfd7f404d5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:17.517776 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a307f24a-c48d-40bc-8ccb-adfd7f404d5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:17.530784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:17.531989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307f24a-c48d-40bc-8ccb-adfd7f404d5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:17.533740 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307f24a-c48d-40bc-8ccb-adfd7f404d5a service placement] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:17.561679 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1342/2675] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:18.892442 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759eeb58-e050-436e-a056-d01a22e49f72 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:18.955335 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759eeb58-e050-436e-a056-d01a22e49f72 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:18.960067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5dfe2-a8ea-420e-b402-9fa80dfd4103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:18.960954 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5dfe2-a8ea-420e-b402-9fa80dfd4103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:18.961233 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5dfe2-a8ea-420e-b402-9fa80dfd4103 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:18.961501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5dfe2-a8ea-420e-b402-9fa80dfd4103 admin admin] PATH_INFO: `/v3/users/0213f9d061e44262942b3e9fff7d4fc6` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:18.962686 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5dfe2-a8ea-420e-b402-9fa80dfd4103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0213f9d061e44262942b3e9fff7d4fc6)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:18.964582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5dfe2-a8ea-420e-b402-9fa80dfd4103 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:19.160549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a0d5dfe2-a8ea-420e-b402-9fa80dfd4103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0213f9d061e44262942b3e9fff7d4fc6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:19.165377 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:19.174592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a0d5dfe2-a8ea-420e-b402-9fa80dfd4103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0213f9d061e44262942b3e9fff7d4fc6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:19.260994 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a0d5dfe2-a8ea-420e-b402-9fa80dfd4103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0213f9d061e44262942b3e9fff7d4fc6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:19.261626 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a0d5dfe2-a8ea-420e-b402-9fa80dfd4103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0213f9d061e44262942b3e9fff7d4fc6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:19.269163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-a0d5dfe2-a8ea-420e-b402-9fa80dfd4103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0213f9d061e44262942b3e9fff7d4fc6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:19.276451 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1334/2676] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:08:18 2022] DELETE /identity/v3/users/0213f9d061e44262942b3e9fff7d4fc6 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:19.281097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656bf96-30ff-4a47-b2df-2bbd24b3dd07 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:19.281605 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656bf96-30ff-4a47-b2df-2bbd24b3dd07 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:19.281731 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656bf96-30ff-4a47-b2df-2bbd24b3dd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:19.299452 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-9656bf96-30ff-4a47-b2df-2bbd24b3dd07 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:19.304604 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9656bf96-30ff-4a47-b2df-2bbd24b3dd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:19.359935 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1343/2677] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:19.370265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5dfe2-a8ea-420e-b402-9fa80dfd4103 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:19.374458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-a0d5dfe2-a8ea-420e-b402-9fa80dfd4103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:19.450860 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5dfe2-a8ea-420e-b402-9fa80dfd4103 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:19.454419 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222e839-37ea-4ddc-a251-2d7b629f9e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:19.455116 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222e839-37ea-4ddc-a251-2d7b629f9e9f service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:19.455396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222e839-37ea-4ddc-a251-2d7b629f9e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:19.455665 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222e839-37ea-4ddc-a251-2d7b629f9e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:19.465282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222e839-37ea-4ddc-a251-2d7b629f9e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:19.466759 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222e839-37ea-4ddc-a251-2d7b629f9e9f service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:19.477972 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1335/2678] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:19.908426 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656bf96-30ff-4a47-b2df-2bbd24b3dd07 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:19.910056 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9656bf96-30ff-4a47-b2df-2bbd24b3dd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:19.926576 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656bf96-30ff-4a47-b2df-2bbd24b3dd07 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:19.932989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeabcf0-4523-4928-b229-f91744fda539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:19.934116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeabcf0-4523-4928-b229-f91744fda539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:19.934280 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeabcf0-4523-4928-b229-f91744fda539 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:19.934559 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeabcf0-4523-4928-b229-f91744fda539 admin admin] PATH_INFO: `/v3/projects/96a480b54ff64ea0a90762bec32c3a0f` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:19.935792 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeabcf0-4523-4928-b229-f91744fda539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a480b54ff64ea0a90762bec32c3a0f)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:19.937750 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeabcf0-4523-4928-b229-f91744fda539 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:20.062309 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-efeabcf0-4523-4928-b229-f91744fda539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a480b54ff64ea0a90762bec32c3a0f', 'request_id': 'req-efeabcf0-4523-4928-b229-f91744fda539'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:20.069152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-efeabcf0-4523-4928-b229-f91744fda539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a480b54ff64ea0a90762bec32c3a0f', 'request_id': 'req-efeabcf0-4523-4928-b229-f91744fda539'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:20.147408 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-efeabcf0-4523-4928-b229-f91744fda539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a480b54ff64ea0a90762bec32c3a0f', 'request_id': 'req-efeabcf0-4523-4928-b229-f91744fda539'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:20.161349 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-efeabcf0-4523-4928-b229-f91744fda539 admin admin] The token cache is being invalidate because project 96a480b54ff64ea0a90762bec32c3a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:08:20.161708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-efeabcf0-4523-4928-b229-f91744fda539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:20.162525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-efeabcf0-4523-4928-b229-f91744fda539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:20.168742 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1344/2679] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:08:19 2022] DELETE /identity/v3/projects/96a480b54ff64ea0a90762bec32c3a0f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:20.170553 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac90a0-6d5e-4971-9850-2589282a3403 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:20.171065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac90a0-6d5e-4971-9850-2589282a3403 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:20.171158 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac90a0-6d5e-4971-9850-2589282a3403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:20.190489 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f9ac90a0-6d5e-4971-9850-2589282a3403 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:20.191725 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f9ac90a0-6d5e-4971-9850-2589282a3403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:20.253471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1336/2680] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:20.263030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80042ff-4328-4981-aaf6-f7da1795feb4 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:20.266395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80042ff-4328-4981-aaf6-f7da1795feb4 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:20.266395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80042ff-4328-4981-aaf6-f7da1795feb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:20.286591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a80042ff-4328-4981-aaf6-f7da1795feb4 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:20.286591 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a80042ff-4328-4981-aaf6-f7da1795feb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:20.293876 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1345/2681] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:20.297854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac90a0-6d5e-4971-9850-2589282a3403 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:20.308502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac90a0-6d5e-4971-9850-2589282a3403 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:20.313361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4294bbe-0fb1-43d4-ae1b-1ccfe2a739fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:20.314012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4294bbe-0fb1-43d4-ae1b-1ccfe2a739fb admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:20.314290 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4294bbe-0fb1-43d4-ae1b-1ccfe2a739fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:20.314561 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4294bbe-0fb1-43d4-ae1b-1ccfe2a739fb admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:20.315286 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4294bbe-0fb1-43d4-ae1b-1ccfe2a739fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:08:20.315613 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4294bbe-0fb1-43d4-ae1b-1ccfe2a739fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:20.317272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4294bbe-0fb1-43d4-ae1b-1ccfe2a739fb admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:20.330440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1337/2682] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:08:20.335299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80042ff-4328-4981-aaf6-f7da1795feb4 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:20.344945 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80042ff-4328-4981-aaf6-f7da1795feb4 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:20.350204 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87429bf9-1eea-434d-a47a-49b121d6d4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:20.350867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87429bf9-1eea-434d-a47a-49b121d6d4fb admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:20.351153 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87429bf9-1eea-434d-a47a-49b121d6d4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:20.351427 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87429bf9-1eea-434d-a47a-49b121d6d4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:20.352129 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87429bf9-1eea-434d-a47a-49b121d6d4fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:20.354070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87429bf9-1eea-434d-a47a-49b121d6d4fb admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:20.443455 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1346/2683] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:08:20 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:08:20.445025 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4294bbe-0fb1-43d4-ae1b-1ccfe2a739fb admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:20.455614 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4294bbe-0fb1-43d4-ae1b-1ccfe2a739fb admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:20.496219 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:20.515728 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f2127-24ad-4414-b211-e872bbb2cc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:20.516418 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f2127-24ad-4414-b211-e872bbb2cc59 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:20.516772 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f2127-24ad-4414-b211-e872bbb2cc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:20.517052 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f2127-24ad-4414-b211-e872bbb2cc59 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:20.517743 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f2127-24ad-4414-b211-e872bbb2cc59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:20.519648 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f2127-24ad-4414-b211-e872bbb2cc59 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:20.621595 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1338/2684] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:08:20 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:08:20.625466 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87429bf9-1eea-434d-a47a-49b121d6d4fb admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:20.636540 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87429bf9-1eea-434d-a47a-49b121d6d4fb admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:20.641126 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de2fc5-d415-43a9-a74d-eb734b9b7d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:20.641836 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de2fc5-d415-43a9-a74d-eb734b9b7d5a admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:20.642115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de2fc5-d415-43a9-a74d-eb734b9b7d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:20.642388 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de2fc5-d415-43a9-a74d-eb734b9b7d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:20.643130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de2fc5-d415-43a9-a74d-eb734b9b7d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:20.644725 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de2fc5-d415-43a9-a74d-eb734b9b7d5a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:20.655042 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1347/2685] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:08:20.658808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f2127-24ad-4414-b211-e872bbb2cc59 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:20.668951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f2127-24ad-4414-b211-e872bbb2cc59 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:20.673600 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74694e0-4b24-487d-9884-a64f88be1006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:20.674250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74694e0-4b24-487d-9884-a64f88be1006 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:20.674538 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74694e0-4b24-487d-9884-a64f88be1006 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:20.674813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74694e0-4b24-487d-9884-a64f88be1006 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:20.675541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74694e0-4b24-487d-9884-a64f88be1006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:20.677665 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74694e0-4b24-487d-9884-a64f88be1006 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:20.690984 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1339/2686] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:08:20.692295 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de2fc5-d415-43a9-a74d-eb734b9b7d5a admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:20.703117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de2fc5-d415-43a9-a74d-eb734b9b7d5a admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:20.707855 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83894b55-dc81-4760-bc25-43de7f2ae931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:20.710315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83894b55-dc81-4760-bc25-43de7f2ae931 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:20.710315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83894b55-dc81-4760-bc25-43de7f2ae931 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:20.710315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83894b55-dc81-4760-bc25-43de7f2ae931 admin admin] PATH_INFO: `/v3/projects/f92dcf68c02f4814a81f9d290edbb69d/users/dd355a6cca204985971e39c4a9bf04f0/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:20.726551 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83894b55-dc81-4760-bc25-43de7f2ae931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92dcf68c02f4814a81f9d290edbb69d, user_id=dd355a6cca204985971e39c4a9bf04f0, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:20.728683 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83894b55-dc81-4760-bc25-43de7f2ae931 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:20.799030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1348/2687] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:08:20 2022] PUT /identity/v3/projects/f92dcf68c02f4814a81f9d290edbb69d/users/dd355a6cca204985971e39c4a9bf04f0/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:08:20.804385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59554b1c-275f-4806-8770-8c905f0386e8 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:20.804701 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59554b1c-275f-4806-8770-8c905f0386e8 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:20.804979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59554b1c-275f-4806-8770-8c905f0386e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:20.827781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-59554b1c-275f-4806-8770-8c905f0386e8 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:20.836093 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-59554b1c-275f-4806-8770-8c905f0386e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:20.916689 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1340/2688] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:20.926323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83894b55-dc81-4760-bc25-43de7f2ae931 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:20.928326 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-83894b55-dc81-4760-bc25-43de7f2ae931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:20.949873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:20.992454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83894b55-dc81-4760-bc25-43de7f2ae931 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:20.996986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284460b-6cf1-41ae-bee5-3636178e9988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:20.997754 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284460b-6cf1-41ae-bee5-3636178e9988 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:20.998096 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284460b-6cf1-41ae-bee5-3636178e9988 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:20.998376 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284460b-6cf1-41ae-bee5-3636178e9988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:21.008583 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284460b-6cf1-41ae-bee5-3636178e9988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:21.010098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284460b-6cf1-41ae-bee5-3636178e9988 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:21.023549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1349/2689] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:22.325097 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995f1ef-28ae-4c7d-a22f-6914e32fbfc4 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:22.325700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995f1ef-28ae-4c7d-a22f-6914e32fbfc4 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:22.325805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995f1ef-28ae-4c7d-a22f-6914e32fbfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:22.361632 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-2995f1ef-28ae-4c7d-a22f-6914e32fbfc4 None None] MFA Rules not processed for user `dd355a6cca204985971e39c4a9bf04f0`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:22.363286 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2995f1ef-28ae-4c7d-a22f-6914e32fbfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:22.446452 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1341/2690] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:22.447409 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284460b-6cf1-41ae-bee5-3636178e9988 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:22.458460 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284460b-6cf1-41ae-bee5-3636178e9988 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:22.463060 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59425bf7-6ff1-40a8-b2b5-275f8492b455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:22.463721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59425bf7-6ff1-40a8-b2b5-275f8492b455 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:22.464004 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59425bf7-6ff1-40a8-b2b5-275f8492b455 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:22.464283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59425bf7-6ff1-40a8-b2b5-275f8492b455 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:22.465020 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59425bf7-6ff1-40a8-b2b5-275f8492b455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:22.466906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59425bf7-6ff1-40a8-b2b5-275f8492b455 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:22.560703 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1350/2691] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:08:22 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:08:22.564281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995f1ef-28ae-4c7d-a22f-6914e32fbfc4 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:22.575237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995f1ef-28ae-4c7d-a22f-6914e32fbfc4 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:22.620438 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:22.632082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4fe4d-7690-44b4-8177-994b8285e641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:22.632789 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4fe4d-7690-44b4-8177-994b8285e641 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:22.633078 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4fe4d-7690-44b4-8177-994b8285e641 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:22.633363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4fe4d-7690-44b4-8177-994b8285e641 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:22.634070 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4fe4d-7690-44b4-8177-994b8285e641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:22.635983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4fe4d-7690-44b4-8177-994b8285e641 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:22.735149 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1342/2692] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:08:22 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:08:22.739846 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59425bf7-6ff1-40a8-b2b5-275f8492b455 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:22.750210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59425bf7-6ff1-40a8-b2b5-275f8492b455 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:22.755609 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54735b-21b9-4447-8c9d-874d44e4259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:22.756368 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54735b-21b9-4447-8c9d-874d44e4259f admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:22.756674 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54735b-21b9-4447-8c9d-874d44e4259f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:22.756971 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54735b-21b9-4447-8c9d-874d44e4259f admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:22.757701 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54735b-21b9-4447-8c9d-874d44e4259f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:22.759296 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54735b-21b9-4447-8c9d-874d44e4259f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:22.773880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1351/2693] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 15:08:22.775010 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4fe4d-7690-44b4-8177-994b8285e641 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:22.785002 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4fe4d-7690-44b4-8177-994b8285e641 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:22.789818 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6c947-2659-4632-9e6d-849da496b270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:22.790727 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6c947-2659-4632-9e6d-849da496b270 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:22.790927 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6c947-2659-4632-9e6d-849da496b270 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:22.791204 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6c947-2659-4632-9e6d-849da496b270 admin admin] PATH_INFO: `/v3/projects/3e7f2c5730dc4fecacb8ef11bc2ffdec/users/3ff4bc97edd047c19b082540361ba5be/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:22.807099 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6c947-2659-4632-9e6d-849da496b270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7f2c5730dc4fecacb8ef11bc2ffdec, user_id=3ff4bc97edd047c19b082540361ba5be, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:22.809779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6c947-2659-4632-9e6d-849da496b270 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:22.918175 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1343/2694] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:08:22 2022] PUT /identity/v3/projects/3e7f2c5730dc4fecacb8ef11bc2ffdec/users/3ff4bc97edd047c19b082540361ba5be/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:08:22.922238 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54735b-21b9-4447-8c9d-874d44e4259f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:22.933168 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54735b-21b9-4447-8c9d-874d44e4259f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:22.993497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d7d5e-f265-4e5b-8fb8-4e32ccccd880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:22.994166 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d7d5e-f265-4e5b-8fb8-4e32ccccd880 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:22.994451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d7d5e-f265-4e5b-8fb8-4e32ccccd880 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:22.994731 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d7d5e-f265-4e5b-8fb8-4e32ccccd880 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:22.995454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d7d5e-f265-4e5b-8fb8-4e32ccccd880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:22.997083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d7d5e-f265-4e5b-8fb8-4e32ccccd880 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:23.006682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1352/2695] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:08:23.010846 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6c947-2659-4632-9e6d-849da496b270 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:23.021202 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6c947-2659-4632-9e6d-849da496b270 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:23.025722 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4daaba-bb89-48a0-a0b4-d1a883c12cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:23.026582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4daaba-bb89-48a0-a0b4-d1a883c12cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:23.026859 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4daaba-bb89-48a0-a0b4-d1a883c12cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:23.027127 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4daaba-bb89-48a0-a0b4-d1a883c12cb0 admin admin] PATH_INFO: `/v3/projects/3e7f2c5730dc4fecacb8ef11bc2ffdec/users/3ff4bc97edd047c19b082540361ba5be/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:23.029091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4daaba-bb89-48a0-a0b4-d1a883c12cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7f2c5730dc4fecacb8ef11bc2ffdec, user_id=3ff4bc97edd047c19b082540361ba5be, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:23.031681 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4daaba-bb89-48a0-a0b4-d1a883c12cb0 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:23.045829 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1344/2696] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:08:23 2022] PUT /identity/v3/projects/3e7f2c5730dc4fecacb8ef11bc2ffdec/users/3ff4bc97edd047c19b082540361ba5be/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:24.215807 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdd05f-a266-4798-a0a1-f054850f429b None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:24.216341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdd05f-a266-4798-a0a1-f054850f429b None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:24.216341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdd05f-a266-4798-a0a1-f054850f429b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:24.243509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1ffdd05f-a266-4798-a0a1-f054850f429b None None] MFA Rules not processed for user `3ff4bc97edd047c19b082540361ba5be`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:24.244784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1ffdd05f-a266-4798-a0a1-f054850f429b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:24.312848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1353/2697] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:24.324027 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4daaba-bb89-48a0-a0b4-d1a883c12cb0 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:24.325750 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ee4daaba-bb89-48a0-a0b4-d1a883c12cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:24.384582 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4daaba-bb89-48a0-a0b4-d1a883c12cb0 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:24.388183 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8906e0-3aca-4193-a790-db1d09f130f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:24.388860 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8906e0-3aca-4193-a790-db1d09f130f2 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:24.389153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8906e0-3aca-4193-a790-db1d09f130f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:24.389434 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8906e0-3aca-4193-a790-db1d09f130f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:24.449759 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8906e0-3aca-4193-a790-db1d09f130f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:24.451296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8906e0-3aca-4193-a790-db1d09f130f2 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:24.461351 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1345/2698] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:08:26.076956 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdd05f-a266-4798-a0a1-f054850f429b None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:26.078160 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1ffdd05f-a266-4798-a0a1-f054850f429b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:26.091000 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdd05f-a266-4798-a0a1-f054850f429b None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:26.094712 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77bb4e-ee3d-475a-8cc6-679aaab71e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:26.095348 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77bb4e-ee3d-475a-8cc6-679aaab71e32 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:26.099778 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77bb4e-ee3d-475a-8cc6-679aaab71e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:26.099778 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77bb4e-ee3d-475a-8cc6-679aaab71e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:26.102202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:26.106592 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77bb4e-ee3d-475a-8cc6-679aaab71e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:26.108007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77bb4e-ee3d-475a-8cc6-679aaab71e32 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:26.118338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1354/2699] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:28.643423 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8906e0-3aca-4193-a790-db1d09f130f2 service cinder] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:28.644930 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-7d8906e0-3aca-4193-a790-db1d09f130f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:28.700937 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:28.720752 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8906e0-3aca-4193-a790-db1d09f130f2 service cinder] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:28.727730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe106ffc-74d1-435d-91a7-ecb09d79db7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:28.728390 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe106ffc-74d1-435d-91a7-ecb09d79db7f service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:28.728692 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe106ffc-74d1-435d-91a7-ecb09d79db7f service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:28.729674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe106ffc-74d1-435d-91a7-ecb09d79db7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:28.730793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-fe106ffc-74d1-435d-91a7-ecb09d79db7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:28.743914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe106ffc-74d1-435d-91a7-ecb09d79db7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:28.745533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe106ffc-74d1-435d-91a7-ecb09d79db7f service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:28.758320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1346/2700] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:32.880514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77bb4e-ee3d-475a-8cc6-679aaab71e32 service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:32.891126 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77bb4e-ee3d-475a-8cc6-679aaab71e32 service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:32.896784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eac6a-d0a9-48ee-aea6-83ecd02a6fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:32.897449 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eac6a-d0a9-48ee-aea6-83ecd02a6fcf service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:32.897733 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eac6a-d0a9-48ee-aea6-83ecd02a6fcf service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:32.898009 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eac6a-d0a9-48ee-aea6-83ecd02a6fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:32.899982 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-651eac6a-d0a9-48ee-aea6-83ecd02a6fcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:32.913097 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651eac6a-d0a9-48ee-aea6-83ecd02a6fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:32.914684 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651eac6a-d0a9-48ee-aea6-83ecd02a6fcf service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:32.927610 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1355/2701] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:38.785883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=9 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:41.239826 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe106ffc-74d1-435d-91a7-ecb09d79db7f service nova] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:41.241429 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-fe106ffc-74d1-435d-91a7-ecb09d79db7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:41.312057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe106ffc-74d1-435d-91a7-ecb09d79db7f service nova] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:41.317071 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cc420-0640-4c62-afbe-965354562f9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:41.317715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cc420-0640-4c62-afbe-965354562f9d service placement] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:41.318040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cc420-0640-4c62-afbe-965354562f9d service placement] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:41.318316 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cc420-0640-4c62-afbe-965354562f9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:41.320072 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-5a6cc420-0640-4c62-afbe-965354562f9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:41.332666 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6cc420-0640-4c62-afbe-965354562f9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:41.334221 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6cc420-0640-4c62-afbe-965354562f9d service placement] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:41.335917 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eac6a-d0a9-48ee-aea6-83ecd02a6fcf service nova] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:41.346420 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1347/2702] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:41.404800 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eac6a-d0a9-48ee-aea6-83ecd02a6fcf service nova] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:41.409244 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f06ca-facd-4c65-a9eb-fabae709e0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:41.410104 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f06ca-facd-4c65-a9eb-fabae709e0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:41.410383 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f06ca-facd-4c65-a9eb-fabae709e0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:41.410656 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f06ca-facd-4c65-a9eb-fabae709e0ef admin admin] PATH_INFO: `/v3/users/dd355a6cca204985971e39c4a9bf04f0` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:41.411816 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f06ca-facd-4c65-a9eb-fabae709e0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd355a6cca204985971e39c4a9bf04f0)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:41.413742 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f06ca-facd-4c65-a9eb-fabae709e0ef admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:41.548672 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a7f06ca-facd-4c65-a9eb-fabae709e0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd355a6cca204985971e39c4a9bf04f0'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:41.560875 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a7f06ca-facd-4c65-a9eb-fabae709e0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd355a6cca204985971e39c4a9bf04f0'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:41.603025 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a7f06ca-facd-4c65-a9eb-fabae709e0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd355a6cca204985971e39c4a9bf04f0'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:41.603634 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a7f06ca-facd-4c65-a9eb-fabae709e0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd355a6cca204985971e39c4a9bf04f0'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:41.610547 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a7f06ca-facd-4c65-a9eb-fabae709e0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd355a6cca204985971e39c4a9bf04f0'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:41.616320 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1356/2703] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:08:41 2022] DELETE /identity/v3/users/dd355a6cca204985971e39c4a9bf04f0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:08:41.845018 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cc420-0640-4c62-afbe-965354562f9d service placement] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:41.856066 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cc420-0640-4c62-afbe-965354562f9d service placement] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:41.913595 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b8c83-0041-4dc2-8b45-04288f46e14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:41.914476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b8c83-0041-4dc2-8b45-04288f46e14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:41.914753 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b8c83-0041-4dc2-8b45-04288f46e14f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:41.915025 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b8c83-0041-4dc2-8b45-04288f46e14f admin admin] PATH_INFO: `/v3/projects/f92dcf68c02f4814a81f9d290edbb69d` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:41.916185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b8c83-0041-4dc2-8b45-04288f46e14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92dcf68c02f4814a81f9d290edbb69d)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:41.918111 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b8c83-0041-4dc2-8b45-04288f46e14f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:41.997792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9f0b8c83-0041-4dc2-8b45-04288f46e14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92dcf68c02f4814a81f9d290edbb69d', 'request_id': 'req-9f0b8c83-0041-4dc2-8b45-04288f46e14f'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:42.071595 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9f0b8c83-0041-4dc2-8b45-04288f46e14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92dcf68c02f4814a81f9d290edbb69d', 'request_id': 'req-9f0b8c83-0041-4dc2-8b45-04288f46e14f'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:42.078979 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9f0b8c83-0041-4dc2-8b45-04288f46e14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92dcf68c02f4814a81f9d290edbb69d', 'request_id': 'req-9f0b8c83-0041-4dc2-8b45-04288f46e14f'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:42.090543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9f0b8c83-0041-4dc2-8b45-04288f46e14f admin admin] The token cache is being invalidate because project f92dcf68c02f4814a81f9d290edbb69d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:08:42.090926 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9f0b8c83-0041-4dc2-8b45-04288f46e14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:42.091636 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9f0b8c83-0041-4dc2-8b45-04288f46e14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:42.093276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1348/2704] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:08:41 2022] DELETE /identity/v3/projects/f92dcf68c02f4814a81f9d290edbb69d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:42.097155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f06ca-facd-4c65-a9eb-fabae709e0ef admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:42.098625 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4a7f06ca-facd-4c65-a9eb-fabae709e0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:42.112510 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f06ca-facd-4c65-a9eb-fabae709e0ef admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:42.170103 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35417807-2bd1-4eac-8761-9663b26e409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:42.170966 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35417807-2bd1-4eac-8761-9663b26e409d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:42.171249 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35417807-2bd1-4eac-8761-9663b26e409d admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:42.171525 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35417807-2bd1-4eac-8761-9663b26e409d admin admin] PATH_INFO: `/v3/users/3ff4bc97edd047c19b082540361ba5be` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:42.172736 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35417807-2bd1-4eac-8761-9663b26e409d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff4bc97edd047c19b082540361ba5be)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:42.174626 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35417807-2bd1-4eac-8761-9663b26e409d admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:42.176068 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:42.411457 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-35417807-2bd1-4eac-8761-9663b26e409d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff4bc97edd047c19b082540361ba5be'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:42.422967 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-35417807-2bd1-4eac-8761-9663b26e409d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff4bc97edd047c19b082540361ba5be'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:42.505923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-35417807-2bd1-4eac-8761-9663b26e409d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff4bc97edd047c19b082540361ba5be'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:42.506553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-35417807-2bd1-4eac-8761-9663b26e409d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff4bc97edd047c19b082540361ba5be'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:42.514394 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-35417807-2bd1-4eac-8761-9663b26e409d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff4bc97edd047c19b082540361ba5be'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:42.521039 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1357/2705] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:08:42 2022] DELETE /identity/v3/users/3ff4bc97edd047c19b082540361ba5be => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:42.776286 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b8c83-0041-4dc2-8b45-04288f46e14f admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:42.778435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-9f0b8c83-0041-4dc2-8b45-04288f46e14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:42.791547 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b8c83-0041-4dc2-8b45-04288f46e14f admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:42.810418 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:42.849602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f915d-00c0-4f97-8961-0d4505783fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:42.850456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f915d-00c0-4f97-8961-0d4505783fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:42.850736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f915d-00c0-4f97-8961-0d4505783fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:42.851009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f915d-00c0-4f97-8961-0d4505783fa9 admin admin] PATH_INFO: `/v3/projects/3e7f2c5730dc4fecacb8ef11bc2ffdec` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:42.852174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f915d-00c0-4f97-8961-0d4505783fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7f2c5730dc4fecacb8ef11bc2ffdec)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:42.854118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f915d-00c0-4f97-8961-0d4505783fa9 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:42.958330 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-066f915d-00c0-4f97-8961-0d4505783fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7f2c5730dc4fecacb8ef11bc2ffdec', 'request_id': 'req-066f915d-00c0-4f97-8961-0d4505783fa9'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:42.997498 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-066f915d-00c0-4f97-8961-0d4505783fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7f2c5730dc4fecacb8ef11bc2ffdec', 'request_id': 'req-066f915d-00c0-4f97-8961-0d4505783fa9'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:43.004168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-066f915d-00c0-4f97-8961-0d4505783fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7f2c5730dc4fecacb8ef11bc2ffdec', 'request_id': 'req-066f915d-00c0-4f97-8961-0d4505783fa9'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:43.015360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-066f915d-00c0-4f97-8961-0d4505783fa9 admin admin] The token cache is being invalidate because project 3e7f2c5730dc4fecacb8ef11bc2ffdec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:08:43.015649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-066f915d-00c0-4f97-8961-0d4505783fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:43.016289 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-066f915d-00c0-4f97-8961-0d4505783fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:43.017888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1349/2706] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:08:42 2022] DELETE /identity/v3/projects/3e7f2c5730dc4fecacb8ef11bc2ffdec => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:43.022859 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4e3e2-2f1f-427d-9358-88e95bf7ad27 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:43.023095 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4e3e2-2f1f-427d-9358-88e95bf7ad27 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:43.023423 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4e3e2-2f1f-427d-9358-88e95bf7ad27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:43.052667 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-e8e4e3e2-2f1f-427d-9358-88e95bf7ad27 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:43.054228 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-e8e4e3e2-2f1f-427d-9358-88e95bf7ad27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:43.118560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1358/2707] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:43.126424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228b4f8-5e2c-4a5e-90f9-bcb444fbbdfe None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:43.126713 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228b4f8-5e2c-4a5e-90f9-bcb444fbbdfe None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:43.126993 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228b4f8-5e2c-4a5e-90f9-bcb444fbbdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:43.145529 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-f228b4f8-5e2c-4a5e-90f9-bcb444fbbdfe None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:43.146765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-f228b4f8-5e2c-4a5e-90f9-bcb444fbbdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:43.155408 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1350/2708] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:43.159463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4e3e2-2f1f-427d-9358-88e95bf7ad27 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:43.169274 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4e3e2-2f1f-427d-9358-88e95bf7ad27 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:43.173821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d697d7-0e63-47cf-a078-0807f5821f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:43.174488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d697d7-0e63-47cf-a078-0807f5821f1b admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:43.174773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d697d7-0e63-47cf-a078-0807f5821f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:43.175053 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d697d7-0e63-47cf-a078-0807f5821f1b admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:43.175780 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d697d7-0e63-47cf-a078-0807f5821f1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:08:43.176086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d697d7-0e63-47cf-a078-0807f5821f1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:43.177708 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d697d7-0e63-47cf-a078-0807f5821f1b admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:43.189578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1359/2709] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:08:43.193554 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228b4f8-5e2c-4a5e-90f9-bcb444fbbdfe None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:43.203323 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228b4f8-5e2c-4a5e-90f9-bcb444fbbdfe None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:43.207960 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf15e1d-990b-489c-8865-23419265e9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:43.208599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf15e1d-990b-489c-8865-23419265e9ae admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:43.208918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf15e1d-990b-489c-8865-23419265e9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:43.209199 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf15e1d-990b-489c-8865-23419265e9ae admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:43.209886 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf15e1d-990b-489c-8865-23419265e9ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:43.211754 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf15e1d-990b-489c-8865-23419265e9ae admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:43.279327 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1351/2710] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:08:43 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:08:43.283349 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d697d7-0e63-47cf-a078-0807f5821f1b admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:43.293550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d697d7-0e63-47cf-a078-0807f5821f1b admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:43.344906 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:43.350772 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a9d3c-9daf-4332-a027-8e6c734d0c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:43.351444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a9d3c-9daf-4332-a027-8e6c734d0c0c admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:43.351759 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a9d3c-9daf-4332-a027-8e6c734d0c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:43.352037 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a9d3c-9daf-4332-a027-8e6c734d0c0c admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:43.352920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a9d3c-9daf-4332-a027-8e6c734d0c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:43.354960 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a9d3c-9daf-4332-a027-8e6c734d0c0c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:43.426261 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1360/2711] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:08:43 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:08:43.431153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf15e1d-990b-489c-8865-23419265e9ae admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:43.442039 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf15e1d-990b-489c-8865-23419265e9ae admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:43.446681 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af160fb8-1fac-4bf6-99f8-10684c8b4472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:43.447340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af160fb8-1fac-4bf6-99f8-10684c8b4472 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:43.447616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af160fb8-1fac-4bf6-99f8-10684c8b4472 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:43.447894 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af160fb8-1fac-4bf6-99f8-10684c8b4472 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:43.449310 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af160fb8-1fac-4bf6-99f8-10684c8b4472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:43.450869 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af160fb8-1fac-4bf6-99f8-10684c8b4472 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:43.461279 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1352/2712] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:08:43.465478 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a9d3c-9daf-4332-a027-8e6c734d0c0c admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:43.475357 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a9d3c-9daf-4332-a027-8e6c734d0c0c admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:43.480038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347d30e-1bfa-4128-8d88-9b55b389670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:43.480763 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347d30e-1bfa-4128-8d88-9b55b389670e admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:43.481051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347d30e-1bfa-4128-8d88-9b55b389670e admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:43.481328 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347d30e-1bfa-4128-8d88-9b55b389670e admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:43.482174 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347d30e-1bfa-4128-8d88-9b55b389670e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:43.483750 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347d30e-1bfa-4128-8d88-9b55b389670e admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:43.493487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1361/2713] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:08:43.498014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af160fb8-1fac-4bf6-99f8-10684c8b4472 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:43.507890 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af160fb8-1fac-4bf6-99f8-10684c8b4472 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:43.513140 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd93ed-92d8-4714-895b-bc48a1693372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:43.514003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd93ed-92d8-4714-895b-bc48a1693372 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:43.514286 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd93ed-92d8-4714-895b-bc48a1693372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:43.514563 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd93ed-92d8-4714-895b-bc48a1693372 admin admin] PATH_INFO: `/v3/projects/83c359dc679a49afa1b4c6eafbaa9755/users/4eeea5c652a64ce19dcdde36269ba1da/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:43.529549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd93ed-92d8-4714-895b-bc48a1693372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c359dc679a49afa1b4c6eafbaa9755, user_id=4eeea5c652a64ce19dcdde36269ba1da, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:43.532154 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd93ed-92d8-4714-895b-bc48a1693372 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:43.592148 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1353/2714] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:08:43 2022] PUT /identity/v3/projects/83c359dc679a49afa1b4c6eafbaa9755/users/4eeea5c652a64ce19dcdde36269ba1da/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:43.602621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5308cf-d244-4d35-bdf3-c018c2364a53 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:43.602913 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5308cf-d244-4d35-bdf3-c018c2364a53 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:43.603203 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5308cf-d244-4d35-bdf3-c018c2364a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:43.631228 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-db5308cf-d244-4d35-bdf3-c018c2364a53 None None] MFA Rules not processed for user `4eeea5c652a64ce19dcdde36269ba1da`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:43.632462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-db5308cf-d244-4d35-bdf3-c018c2364a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:43.696716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1362/2715] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:43.707954 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd93ed-92d8-4714-895b-bc48a1693372 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:43.709649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6abd93ed-92d8-4714-895b-bc48a1693372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:43.762057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:43.789461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd93ed-92d8-4714-895b-bc48a1693372 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:43.794122 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ac89-81b1-4bd9-b274-29146b49bbd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:43.794844 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ac89-81b1-4bd9-b274-29146b49bbd4 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:43.795131 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ac89-81b1-4bd9-b274-29146b49bbd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:43.795407 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ac89-81b1-4bd9-b274-29146b49bbd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:43.804677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509ac89-81b1-4bd9-b274-29146b49bbd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:43.806074 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509ac89-81b1-4bd9-b274-29146b49bbd4 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:43.814911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1354/2716] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:43.834607 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5308cf-d244-4d35-bdf3-c018c2364a53 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:43.896178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5308cf-d244-4d35-bdf3-c018c2364a53 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:43.900744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6e8f8-afec-49ae-8b99-d5e4ab276ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:43.902250 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6e8f8-afec-49ae-8b99-d5e4ab276ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:43.902530 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6e8f8-afec-49ae-8b99-d5e4ab276ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:43.902806 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6e8f8-afec-49ae-8b99-d5e4ab276ea6 admin admin] PATH_INFO: `/v3/users/4eeea5c652a64ce19dcdde36269ba1da` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:43.904073 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6e8f8-afec-49ae-8b99-d5e4ab276ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eeea5c652a64ce19dcdde36269ba1da)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:43.906042 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6e8f8-afec-49ae-8b99-d5e4ab276ea6 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:44.050539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d8c6e8f8-afec-49ae-8b99-d5e4ab276ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eeea5c652a64ce19dcdde36269ba1da'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:44.062449 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d8c6e8f8-afec-49ae-8b99-d5e4ab276ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eeea5c652a64ce19dcdde36269ba1da'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:44.064902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:44.145872 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d8c6e8f8-afec-49ae-8b99-d5e4ab276ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eeea5c652a64ce19dcdde36269ba1da'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:44.146501 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d8c6e8f8-afec-49ae-8b99-d5e4ab276ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eeea5c652a64ce19dcdde36269ba1da'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:44.154617 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-d8c6e8f8-afec-49ae-8b99-d5e4ab276ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eeea5c652a64ce19dcdde36269ba1da'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:44.160561 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1363/2717] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:08:43 2022] DELETE /identity/v3/users/4eeea5c652a64ce19dcdde36269ba1da => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:44.165222 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16ed68-ac0d-48c7-909f-3e663d4c6695 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:44.165529 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16ed68-ac0d-48c7-909f-3e663d4c6695 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:44.165803 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16ed68-ac0d-48c7-909f-3e663d4c6695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:44.183784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-9f16ed68-ac0d-48c7-909f-3e663d4c6695 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:44.185056 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-9f16ed68-ac0d-48c7-909f-3e663d4c6695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:44.241911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1355/2718] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:44.251981 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6e8f8-afec-49ae-8b99-d5e4ab276ea6 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:44.253429 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d8c6e8f8-afec-49ae-8b99-d5e4ab276ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:44.311581 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6e8f8-afec-49ae-8b99-d5e4ab276ea6 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:44.315061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc0d5e-5f9e-42f7-a3d7-31295439b1a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:44.315695 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc0d5e-5f9e-42f7-a3d7-31295439b1a0 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:44.315978 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc0d5e-5f9e-42f7-a3d7-31295439b1a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:44.316254 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc0d5e-5f9e-42f7-a3d7-31295439b1a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:44.325989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc0d5e-5f9e-42f7-a3d7-31295439b1a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:44.327460 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc0d5e-5f9e-42f7-a3d7-31295439b1a0 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:44.336862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1364/2719] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:44.771125 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16ed68-ac0d-48c7-909f-3e663d4c6695 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:44.772535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-9f16ed68-ac0d-48c7-909f-3e663d4c6695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:44.785365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16ed68-ac0d-48c7-909f-3e663d4c6695 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:44.789900 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce937091-194d-41ff-9edf-758925fab6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:44.790805 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937091-194d-41ff-9edf-758925fab6ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:44.791082 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937091-194d-41ff-9edf-758925fab6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:44.791353 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937091-194d-41ff-9edf-758925fab6ec admin admin] PATH_INFO: `/v3/projects/83c359dc679a49afa1b4c6eafbaa9755` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:44.792541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce937091-194d-41ff-9edf-758925fab6ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c359dc679a49afa1b4c6eafbaa9755)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:44.794548 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce937091-194d-41ff-9edf-758925fab6ec admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:44.895017 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ce937091-194d-41ff-9edf-758925fab6ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c359dc679a49afa1b4c6eafbaa9755', 'request_id': 'req-ce937091-194d-41ff-9edf-758925fab6ec'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:44.957535 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ce937091-194d-41ff-9edf-758925fab6ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c359dc679a49afa1b4c6eafbaa9755', 'request_id': 'req-ce937091-194d-41ff-9edf-758925fab6ec'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:44.964042 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ce937091-194d-41ff-9edf-758925fab6ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c359dc679a49afa1b4c6eafbaa9755', 'request_id': 'req-ce937091-194d-41ff-9edf-758925fab6ec'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:44.974324 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ce937091-194d-41ff-9edf-758925fab6ec admin admin] The token cache is being invalidate because project 83c359dc679a49afa1b4c6eafbaa9755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:08:44.974611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ce937091-194d-41ff-9edf-758925fab6ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:44.975237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ce937091-194d-41ff-9edf-758925fab6ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:08:44.976795 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1356/2720] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:08:44 2022] DELETE /identity/v3/projects/83c359dc679a49afa1b4c6eafbaa9755 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:08:44.981975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be897e-34ab-4bf9-aa13-8726bdf90637 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:44.982500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be897e-34ab-4bf9-aa13-8726bdf90637 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:44.982500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be897e-34ab-4bf9-aa13-8726bdf90637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:45.001123 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-35be897e-34ab-4bf9-aa13-8726bdf90637 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:45.002313 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-35be897e-34ab-4bf9-aa13-8726bdf90637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:45.060694 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1365/2721] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:45.069276 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad119e0d-365f-43ff-98ba-d49dcfb8c232 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:45.069571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad119e0d-365f-43ff-98ba-d49dcfb8c232 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:45.069854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad119e0d-365f-43ff-98ba-d49dcfb8c232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:45.088145 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-ad119e0d-365f-43ff-98ba-d49dcfb8c232 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:45.090003 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ad119e0d-365f-43ff-98ba-d49dcfb8c232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:45.097951 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1357/2722] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:45.102160 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be897e-34ab-4bf9-aa13-8726bdf90637 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:45.112545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be897e-34ab-4bf9-aa13-8726bdf90637 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:45.117154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff4969-00c6-4d51-b361-a8d29a207ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:45.117811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff4969-00c6-4d51-b361-a8d29a207ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:45.118090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff4969-00c6-4d51-b361-a8d29a207ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:45.118366 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff4969-00c6-4d51-b361-a8d29a207ca1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:45.119093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff4969-00c6-4d51-b361-a8d29a207ca1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:08:45.119401 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff4969-00c6-4d51-b361-a8d29a207ca1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:45.121152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff4969-00c6-4d51-b361-a8d29a207ca1 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:45.132920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1366/2723] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:08:45.137675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad119e0d-365f-43ff-98ba-d49dcfb8c232 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:45.152355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad119e0d-365f-43ff-98ba-d49dcfb8c232 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:45.152355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20b5b1-9f6c-401b-a9d2-5f0379617cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:45.152814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b5b1-9f6c-401b-a9d2-5f0379617cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:45.153115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b5b1-9f6c-401b-a9d2-5f0379617cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:45.153368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b5b1-9f6c-401b-a9d2-5f0379617cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:45.154054 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20b5b1-9f6c-401b-a9d2-5f0379617cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:45.155931 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20b5b1-9f6c-401b-a9d2-5f0379617cb7 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:45.216060 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1358/2724] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:08:45 2022] POST /identity/v3/projects => generated 369 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:08:45.220422 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff4969-00c6-4d51-b361-a8d29a207ca1 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:45.230867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff4969-00c6-4d51-b361-a8d29a207ca1 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:45.286183 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbba3ab-1867-41a2-bd56-04eedec28d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:45.286854 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbba3ab-1867-41a2-bd56-04eedec28d1b admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:45.287138 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbba3ab-1867-41a2-bd56-04eedec28d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:45.287414 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbba3ab-1867-41a2-bd56-04eedec28d1b admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:45.288098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbba3ab-1867-41a2-bd56-04eedec28d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:45.290083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbba3ab-1867-41a2-bd56-04eedec28d1b admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:45.380125 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1367/2725] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:08:45 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:08:45.384959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20b5b1-9f6c-401b-a9d2-5f0379617cb7 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:45.396537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20b5b1-9f6c-401b-a9d2-5f0379617cb7 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:45.401158 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cc497-3fba-48be-bfe2-607bc8b68ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:45.402563 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cc497-3fba-48be-bfe2-607bc8b68ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:45.402788 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cc497-3fba-48be-bfe2-607bc8b68ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:45.403057 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cc497-3fba-48be-bfe2-607bc8b68ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:45.403784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cc497-3fba-48be-bfe2-607bc8b68ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:45.405399 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cc497-3fba-48be-bfe2-607bc8b68ac1 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:45.415812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1359/2726] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:08:45.419750 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbba3ab-1867-41a2-bd56-04eedec28d1b admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:45.425959 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:45.429884 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbba3ab-1867-41a2-bd56-04eedec28d1b admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:45.434567 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5101a-6f8b-4e60-ae44-59fd00159cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:45.435213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5101a-6f8b-4e60-ae44-59fd00159cda admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:45.435495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5101a-6f8b-4e60-ae44-59fd00159cda admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:45.435768 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5101a-6f8b-4e60-ae44-59fd00159cda admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:45.436486 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5101a-6f8b-4e60-ae44-59fd00159cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:45.438085 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5101a-6f8b-4e60-ae44-59fd00159cda admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:45.449417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1368/2727] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:08:45.453362 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cc497-3fba-48be-bfe2-607bc8b68ac1 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:45.462996 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cc497-3fba-48be-bfe2-607bc8b68ac1 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:45.468427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0812682-529b-4b03-af44-9eeca4d609d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:45.469320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0812682-529b-4b03-af44-9eeca4d609d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:45.469597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0812682-529b-4b03-af44-9eeca4d609d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:45.473379 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0812682-529b-4b03-af44-9eeca4d609d5 admin admin] PATH_INFO: `/v3/projects/77aaa7af18b14fe488d711c83dc7181f/users/c2bc2b86132d4918a79990c5c78e6120/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:45.480896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:45.484871 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0812682-529b-4b03-af44-9eeca4d609d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77aaa7af18b14fe488d711c83dc7181f, user_id=c2bc2b86132d4918a79990c5c78e6120, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:45.487504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0812682-529b-4b03-af44-9eeca4d609d5 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:45.534502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1360/2728] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:08:45 2022] PUT /identity/v3/projects/77aaa7af18b14fe488d711c83dc7181f/users/c2bc2b86132d4918a79990c5c78e6120/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:08:45.549770 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7164897-124d-4397-ad29-edb9f2d5a48f None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:45.550087 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7164897-124d-4397-ad29-edb9f2d5a48f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:45.550367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7164897-124d-4397-ad29-edb9f2d5a48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:45.577083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-a7164897-124d-4397-ad29-edb9f2d5a48f None None] MFA Rules not processed for user `c2bc2b86132d4918a79990c5c78e6120`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:45.578279 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a7164897-124d-4397-ad29-edb9f2d5a48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:45.640831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1369/2729] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:08:45.652833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0812682-529b-4b03-af44-9eeca4d609d5 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:08:45.654610 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b0812682-529b-4b03-af44-9eeca4d609d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:45.710758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0812682-529b-4b03-af44-9eeca4d609d5 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:08:45.714483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2b5ec-e579-40ee-93a7-af09b24df635 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e93d0321eaa4936a55390155d5aab0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:08:45.715115 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2b5ec-e579-40ee-93a7-af09b24df635 service glance] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:45.715396 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2b5ec-e579-40ee-93a7-af09b24df635 service glance] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:45.715676 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2b5ec-e579-40ee-93a7-af09b24df635 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:45.723842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2b5ec-e579-40ee-93a7-af09b24df635 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:08:45.725284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2b5ec-e579-40ee-93a7-af09b24df635 service glance] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:08:45.733964 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1361/2730] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:08:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:08:55.637993 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=35 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:55.730028 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:08:57.380367 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f4da1-48df-46d7-ba5f-8011bb04b8ec None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:08:57.380889 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f4da1-48df-46d7-ba5f-8011bb04b8ec None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:08:57.381086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f4da1-48df-46d7-ba5f-8011bb04b8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:08:57.399068 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-c71f4da1-48df-46d7-ba5f-8011bb04b8ec None None] MFA Rules not processed for user `e6357e83df904ea09221cfc374d776c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:08:57.400258 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-c71f4da1-48df-46d7-ba5f-8011bb04b8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:08:57.454780 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1370/2731] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:08:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:09:07.447544 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=25 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:09:34.064762 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2b5ec-e579-40ee-93a7-af09b24df635 service glance] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:34.127849 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2b5ec-e579-40ee-93a7-af09b24df635 service glance] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:34.132431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00be7d-f96a-489c-8755-71cf62c81c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:34.133382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00be7d-f96a-489c-8755-71cf62c81c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:34.133669 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00be7d-f96a-489c-8755-71cf62c81c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:34.133929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00be7d-f96a-489c-8755-71cf62c81c0c admin admin] PATH_INFO: `/v3/users/c2bc2b86132d4918a79990c5c78e6120` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:34.135091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00be7d-f96a-489c-8755-71cf62c81c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2bc2b86132d4918a79990c5c78e6120)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:34.137019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00be7d-f96a-489c-8755-71cf62c81c0c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:34.335696 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6e00be7d-f96a-489c-8755-71cf62c81c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2bc2b86132d4918a79990c5c78e6120'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:34.347311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6e00be7d-f96a-489c-8755-71cf62c81c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2bc2b86132d4918a79990c5c78e6120'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:34.408155 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6e00be7d-f96a-489c-8755-71cf62c81c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2bc2b86132d4918a79990c5c78e6120'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:34.408828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6e00be7d-f96a-489c-8755-71cf62c81c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2bc2b86132d4918a79990c5c78e6120'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:34.416596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-6e00be7d-f96a-489c-8755-71cf62c81c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2bc2b86132d4918a79990c5c78e6120'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:34.422428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1362/2732] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:09:34 2022] DELETE /identity/v3/users/c2bc2b86132d4918a79990c5c78e6120 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:09:34.426892 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73206b53-8c70-4a7f-88c9-27b2a8067de0 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:34.427769 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73206b53-8c70-4a7f-88c9-27b2a8067de0 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:34.427769 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73206b53-8c70-4a7f-88c9-27b2a8067de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:34.445093 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-73206b53-8c70-4a7f-88c9-27b2a8067de0 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:09:34.446299 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-73206b53-8c70-4a7f-88c9-27b2a8067de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:34.508298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1371/2733] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:09:34.517920 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00be7d-f96a-489c-8755-71cf62c81c0c admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:34.519311 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-6e00be7d-f96a-489c-8755-71cf62c81c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:34.580358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00be7d-f96a-489c-8755-71cf62c81c0c admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:34.584654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc363b-5ddc-4197-a8d1-d0470f1848c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:34.585317 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc363b-5ddc-4197-a8d1-d0470f1848c4 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:34.585599 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc363b-5ddc-4197-a8d1-d0470f1848c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:34.585930 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc363b-5ddc-4197-a8d1-d0470f1848c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:34.595146 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc363b-5ddc-4197-a8d1-d0470f1848c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:34.596552 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc363b-5ddc-4197-a8d1-d0470f1848c4 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:34.606064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1363/2734] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:09:35.018772 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73206b53-8c70-4a7f-88c9-27b2a8067de0 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:35.018772 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-73206b53-8c70-4a7f-88c9-27b2a8067de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:35.029727 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73206b53-8c70-4a7f-88c9-27b2a8067de0 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:35.034477 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c0e9b-6d45-4061-9487-933447fe8d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:35.035416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c0e9b-6d45-4061-9487-933447fe8d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:35.035694 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c0e9b-6d45-4061-9487-933447fe8d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:35.035964 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c0e9b-6d45-4061-9487-933447fe8d2c admin admin] PATH_INFO: `/v3/projects/77aaa7af18b14fe488d711c83dc7181f` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:35.037384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c0e9b-6d45-4061-9487-933447fe8d2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=77aaa7af18b14fe488d711c83dc7181f)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:35.039445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c0e9b-6d45-4061-9487-933447fe8d2c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:35.140527 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-337c0e9b-6d45-4061-9487-933447fe8d2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77aaa7af18b14fe488d711c83dc7181f', 'request_id': 'req-337c0e9b-6d45-4061-9487-933447fe8d2c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:35.146561 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-337c0e9b-6d45-4061-9487-933447fe8d2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77aaa7af18b14fe488d711c83dc7181f', 'request_id': 'req-337c0e9b-6d45-4061-9487-933447fe8d2c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:35.213912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-337c0e9b-6d45-4061-9487-933447fe8d2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77aaa7af18b14fe488d711c83dc7181f', 'request_id': 'req-337c0e9b-6d45-4061-9487-933447fe8d2c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:35.224592 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-337c0e9b-6d45-4061-9487-933447fe8d2c admin admin] The token cache is being invalidate because project 77aaa7af18b14fe488d711c83dc7181f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:09:35.224902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-337c0e9b-6d45-4061-9487-933447fe8d2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:35.225553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-337c0e9b-6d45-4061-9487-933447fe8d2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:35.227039 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1372/2735] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:09:35 2022] DELETE /identity/v3/projects/77aaa7af18b14fe488d711c83dc7181f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:09:35.231939 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012c941-4788-4475-84ac-7f6ed5ea19d3 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:35.232503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012c941-4788-4475-84ac-7f6ed5ea19d3 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:35.232503 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012c941-4788-4475-84ac-7f6ed5ea19d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:35.250093 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-a012c941-4788-4475-84ac-7f6ed5ea19d3 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:09:35.251272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-a012c941-4788-4475-84ac-7f6ed5ea19d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:35.268013 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:09:35.310398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1364/2736] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:09:35.318812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26d64c-8b6b-4903-8bc5-730f347bba25 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:35.319302 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26d64c-8b6b-4903-8bc5-730f347bba25 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:35.319572 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26d64c-8b6b-4903-8bc5-730f347bba25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:35.337951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-3e26d64c-8b6b-4903-8bc5-730f347bba25 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:09:35.339151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-3e26d64c-8b6b-4903-8bc5-730f347bba25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:35.346986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1373/2737] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:09:35.351698 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012c941-4788-4475-84ac-7f6ed5ea19d3 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:35.361441 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012c941-4788-4475-84ac-7f6ed5ea19d3 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:35.366697 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfbe51-1739-4df9-8171-630fe6609f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:35.367337 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfbe51-1739-4df9-8171-630fe6609f67 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:35.367620 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfbe51-1739-4df9-8171-630fe6609f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:35.367895 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfbe51-1739-4df9-8171-630fe6609f67 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:35.368619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfbe51-1739-4df9-8171-630fe6609f67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:09:35.368954 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfbe51-1739-4df9-8171-630fe6609f67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:35.370526 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfbe51-1739-4df9-8171-630fe6609f67 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:35.382265 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1365/2738] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:09:35.386346 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26d64c-8b6b-4903-8bc5-730f347bba25 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:35.395440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26d64c-8b6b-4903-8bc5-730f347bba25 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:35.400288 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc335-055d-4c20-a6d6-3cd7fd70b417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:35.400972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc335-055d-4c20-a6d6-3cd7fd70b417 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:35.401255 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc335-055d-4c20-a6d6-3cd7fd70b417 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:35.401534 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc335-055d-4c20-a6d6-3cd7fd70b417 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:35.402229 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc335-055d-4c20-a6d6-3cd7fd70b417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:35.404115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc335-055d-4c20-a6d6-3cd7fd70b417 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:35.472264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1374/2739] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:09:35 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:09:35.476934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfbe51-1739-4df9-8171-630fe6609f67 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:35.486867 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfbe51-1739-4df9-8171-630fe6609f67 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:35.542549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f51549-0e63-41b1-b4c0-f665513c6781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:35.543230 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f51549-0e63-41b1-b4c0-f665513c6781 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:35.543509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f51549-0e63-41b1-b4c0-f665513c6781 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:35.543784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f51549-0e63-41b1-b4c0-f665513c6781 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:35.544475 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f51549-0e63-41b1-b4c0-f665513c6781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:35.546424 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f51549-0e63-41b1-b4c0-f665513c6781 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:35.654540 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1366/2740] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:09:35 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:09:35.659915 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc335-055d-4c20-a6d6-3cd7fd70b417 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:35.671032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc335-055d-4c20-a6d6-3cd7fd70b417 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:35.675652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407231f4-4398-4ac2-a17c-cf2567dbc156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:35.676300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407231f4-4398-4ac2-a17c-cf2567dbc156 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:35.676579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407231f4-4398-4ac2-a17c-cf2567dbc156 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:35.676891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407231f4-4398-4ac2-a17c-cf2567dbc156 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:35.678360 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407231f4-4398-4ac2-a17c-cf2567dbc156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:35.679927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407231f4-4398-4ac2-a17c-cf2567dbc156 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:35.690131 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1375/2741] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:09:35.693933 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f51549-0e63-41b1-b4c0-f665513c6781 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:35.704281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f51549-0e63-41b1-b4c0-f665513c6781 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:35.709634 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136ef84-3aac-4968-9fed-7d52b36d2802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:35.710283 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136ef84-3aac-4968-9fed-7d52b36d2802 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:35.710559 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136ef84-3aac-4968-9fed-7d52b36d2802 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:35.710827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136ef84-3aac-4968-9fed-7d52b36d2802 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:35.711549 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136ef84-3aac-4968-9fed-7d52b36d2802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:35.713135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136ef84-3aac-4968-9fed-7d52b36d2802 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:35.722910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1367/2742] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:09:35.727499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407231f4-4398-4ac2-a17c-cf2567dbc156 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:35.737320 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407231f4-4398-4ac2-a17c-cf2567dbc156 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:35.741891 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3761c91-e8d0-4826-90df-59efbee11b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:35.742745 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3761c91-e8d0-4826-90df-59efbee11b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:35.743030 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3761c91-e8d0-4826-90df-59efbee11b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:35.743304 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3761c91-e8d0-4826-90df-59efbee11b55 admin admin] PATH_INFO: `/v3/projects/6fc08bf915f74b80a54e48df2d26bc42/users/27bec8a046334ea5bb97d6243417608b/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:35.757353 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3761c91-e8d0-4826-90df-59efbee11b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc08bf915f74b80a54e48df2d26bc42, user_id=27bec8a046334ea5bb97d6243417608b, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:35.759969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3761c91-e8d0-4826-90df-59efbee11b55 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:35.859596 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1376/2743] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:09:35 2022] PUT /identity/v3/projects/6fc08bf915f74b80a54e48df2d26bc42/users/27bec8a046334ea5bb97d6243417608b/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:09:35.869877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf2bec-a167-408e-9986-3a82aacfaaae None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:35.870167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf2bec-a167-408e-9986-3a82aacfaaae None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:35.870446 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf2bec-a167-408e-9986-3a82aacfaaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:35.898014 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-4ddf2bec-a167-408e-9986-3a82aacfaaae None None] MFA Rules not processed for user `27bec8a046334ea5bb97d6243417608b`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:09:35.899213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-4ddf2bec-a167-408e-9986-3a82aacfaaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:35.961385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1368/2744] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:09:35.972126 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3761c91-e8d0-4826-90df-59efbee11b55 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:35.974004 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f3761c91-e8d0-4826-90df-59efbee11b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:35.995783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:09:36.030195 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3761c91-e8d0-4826-90df-59efbee11b55 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:36.033808 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cd68f-59d4-43ac-aa0c-c56e3e7dc1eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:36.034438 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cd68f-59d4-43ac-aa0c-c56e3e7dc1eb service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:36.034720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cd68f-59d4-43ac-aa0c-c56e3e7dc1eb service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:36.035026 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cd68f-59d4-43ac-aa0c-c56e3e7dc1eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:36.044451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cd68f-59d4-43ac-aa0c-c56e3e7dc1eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:36.047029 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cd68f-59d4-43ac-aa0c-c56e3e7dc1eb service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:36.055047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1377/2745] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:09:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:09:40.100621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf2bec-a167-408e-9986-3a82aacfaaae None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:40.119281 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:09:40.162312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf2bec-a167-408e-9986-3a82aacfaaae None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:40.166818 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf81791-6c92-4273-8f57-b3b9461f06d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:40.167685 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf81791-6c92-4273-8f57-b3b9461f06d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:40.168161 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf81791-6c92-4273-8f57-b3b9461f06d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:40.168709 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf81791-6c92-4273-8f57-b3b9461f06d1 admin admin] PATH_INFO: `/v3/users/27bec8a046334ea5bb97d6243417608b` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:40.170273 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf81791-6c92-4273-8f57-b3b9461f06d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27bec8a046334ea5bb97d6243417608b)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:40.172207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf81791-6c92-4273-8f57-b3b9461f06d1 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:40.364144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0cf81791-6c92-4273-8f57-b3b9461f06d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27bec8a046334ea5bb97d6243417608b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:40.376499 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0cf81791-6c92-4273-8f57-b3b9461f06d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27bec8a046334ea5bb97d6243417608b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:40.453781 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0cf81791-6c92-4273-8f57-b3b9461f06d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27bec8a046334ea5bb97d6243417608b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:40.454393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0cf81791-6c92-4273-8f57-b3b9461f06d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27bec8a046334ea5bb97d6243417608b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:40.461494 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0cf81791-6c92-4273-8f57-b3b9461f06d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27bec8a046334ea5bb97d6243417608b'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:40.467363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1369/2746] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:09:40 2022] DELETE /identity/v3/users/27bec8a046334ea5bb97d6243417608b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:09:40.471881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2838c-7837-475b-99b2-632eb9a8d8bf None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:40.472347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2838c-7837-475b-99b2-632eb9a8d8bf None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:40.472468 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2838c-7837-475b-99b2-632eb9a8d8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:40.490036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d5a2838c-7837-475b-99b2-632eb9a8d8bf None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:09:40.491429 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d5a2838c-7837-475b-99b2-632eb9a8d8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:40.548720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1378/2747] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:09:40.559163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf81791-6c92-4273-8f57-b3b9461f06d1 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:40.560545 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0cf81791-6c92-4273-8f57-b3b9461f06d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:40.617110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf81791-6c92-4273-8f57-b3b9461f06d1 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:40.620587 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c2174-dcdf-43f7-bbb2-c777fbbd9201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:40.621247 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c2174-dcdf-43f7-bbb2-c777fbbd9201 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:40.621524 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c2174-dcdf-43f7-bbb2-c777fbbd9201 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:40.621795 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c2174-dcdf-43f7-bbb2-c777fbbd9201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:40.630905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c2174-dcdf-43f7-bbb2-c777fbbd9201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:40.632306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c2174-dcdf-43f7-bbb2-c777fbbd9201 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:40.641583 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1370/2748] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:09:41.009816 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2838c-7837-475b-99b2-632eb9a8d8bf None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:41.014536 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d5a2838c-7837-475b-99b2-632eb9a8d8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:41.025454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2838c-7837-475b-99b2-632eb9a8d8bf None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:41.030198 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24366a-03e9-4da9-955a-7285c960416f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:41.031066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24366a-03e9-4da9-955a-7285c960416f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:41.031352 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24366a-03e9-4da9-955a-7285c960416f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:41.031764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24366a-03e9-4da9-955a-7285c960416f admin admin] PATH_INFO: `/v3/projects/6fc08bf915f74b80a54e48df2d26bc42` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:41.033119 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24366a-03e9-4da9-955a-7285c960416f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc08bf915f74b80a54e48df2d26bc42)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:41.034973 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24366a-03e9-4da9-955a-7285c960416f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:41.186405 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5c24366a-03e9-4da9-955a-7285c960416f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc08bf915f74b80a54e48df2d26bc42', 'request_id': 'req-5c24366a-03e9-4da9-955a-7285c960416f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:41.192678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5c24366a-03e9-4da9-955a-7285c960416f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc08bf915f74b80a54e48df2d26bc42', 'request_id': 'req-5c24366a-03e9-4da9-955a-7285c960416f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:41.253581 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5c24366a-03e9-4da9-955a-7285c960416f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc08bf915f74b80a54e48df2d26bc42', 'request_id': 'req-5c24366a-03e9-4da9-955a-7285c960416f'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:41.263867 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5c24366a-03e9-4da9-955a-7285c960416f admin admin] The token cache is being invalidate because project 6fc08bf915f74b80a54e48df2d26bc42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:09:41.264152 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5c24366a-03e9-4da9-955a-7285c960416f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:41.264810 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5c24366a-03e9-4da9-955a-7285c960416f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:41.266362 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1379/2749] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:09:41 2022] DELETE /identity/v3/projects/6fc08bf915f74b80a54e48df2d26bc42 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:09:41.272193 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3fdd9-ad3b-46b5-af84-7b26d5abff07 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:41.272715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3fdd9-ad3b-46b5-af84-7b26d5abff07 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:41.272844 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3fdd9-ad3b-46b5-af84-7b26d5abff07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:41.291174 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-86f3fdd9-ad3b-46b5-af84-7b26d5abff07 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:09:41.292383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-86f3fdd9-ad3b-46b5-af84-7b26d5abff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:41.327353 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:09:41.353622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1371/2750] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:09:41.361210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4a483-ee37-443e-b67c-c9cc362fc49c None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:41.361500 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4a483-ee37-443e-b67c-c9cc362fc49c None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:41.361777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4a483-ee37-443e-b67c-c9cc362fc49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:41.379878 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-4be4a483-ee37-443e-b67c-c9cc362fc49c None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:09:41.381704 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4be4a483-ee37-443e-b67c-c9cc362fc49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:41.389928 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1380/2751] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:09:41.394008 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3fdd9-ad3b-46b5-af84-7b26d5abff07 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:41.404134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3fdd9-ad3b-46b5-af84-7b26d5abff07 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:41.408698 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128d870-cfa1-42f0-b889-8ec82ded5f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:41.409341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128d870-cfa1-42f0-b889-8ec82ded5f7f admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:41.409649 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128d870-cfa1-42f0-b889-8ec82ded5f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:41.409924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128d870-cfa1-42f0-b889-8ec82ded5f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:41.410644 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128d870-cfa1-42f0-b889-8ec82ded5f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:09:41.410948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128d870-cfa1-42f0-b889-8ec82ded5f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:41.412533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128d870-cfa1-42f0-b889-8ec82ded5f7f admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:41.425919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1372/2752] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:09:41.429517 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4a483-ee37-443e-b67c-c9cc362fc49c None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:41.438672 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4a483-ee37-443e-b67c-c9cc362fc49c None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:41.443758 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff319a4-389e-4846-9c40-0af83de195e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:41.444398 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff319a4-389e-4846-9c40-0af83de195e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:41.444721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff319a4-389e-4846-9c40-0af83de195e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:41.445002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff319a4-389e-4846-9c40-0af83de195e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:41.445683 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff319a4-389e-4846-9c40-0af83de195e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:41.447586 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff319a4-389e-4846-9c40-0af83de195e9 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:41.534877 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1381/2753] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:09:41 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:09:41.538881 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128d870-cfa1-42f0-b889-8ec82ded5f7f admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:41.548868 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128d870-cfa1-42f0-b889-8ec82ded5f7f admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:41.606837 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7d242-cab7-4dfe-9c95-e4d2956558b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:41.607500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7d242-cab7-4dfe-9c95-e4d2956558b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:41.607800 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7d242-cab7-4dfe-9c95-e4d2956558b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:41.608085 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7d242-cab7-4dfe-9c95-e4d2956558b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:41.608839 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7d242-cab7-4dfe-9c95-e4d2956558b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:41.610800 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7d242-cab7-4dfe-9c95-e4d2956558b7 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:41.671510 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1373/2754] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:09:41 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:09:41.675694 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff319a4-389e-4846-9c40-0af83de195e9 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:41.687458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff319a4-389e-4846-9c40-0af83de195e9 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:41.692263 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2072f11-c9f3-4422-9321-dae807a58f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:41.693489 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2072f11-c9f3-4422-9321-dae807a58f1e admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:41.693773 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2072f11-c9f3-4422-9321-dae807a58f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:41.694051 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2072f11-c9f3-4422-9321-dae807a58f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:41.694813 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2072f11-c9f3-4422-9321-dae807a58f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:41.696396 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2072f11-c9f3-4422-9321-dae807a58f1e admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:41.707446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1382/2755] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:09:41.712062 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7d242-cab7-4dfe-9c95-e4d2956558b7 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:41.721838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7d242-cab7-4dfe-9c95-e4d2956558b7 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:41.726532 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82396191-2ed3-4371-83da-ca858d487848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:41.727178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82396191-2ed3-4371-83da-ca858d487848 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:41.727458 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82396191-2ed3-4371-83da-ca858d487848 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:41.727730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82396191-2ed3-4371-83da-ca858d487848 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:41.728448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82396191-2ed3-4371-83da-ca858d487848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:41.730136 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82396191-2ed3-4371-83da-ca858d487848 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:41.740654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1374/2756] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:09:41.744485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2072f11-c9f3-4422-9321-dae807a58f1e admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:41.754300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2072f11-c9f3-4422-9321-dae807a58f1e admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:41.759548 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66d65b-9497-4afe-8026-d933d6134193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:41.760409 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66d65b-9497-4afe-8026-d933d6134193 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:41.760716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66d65b-9497-4afe-8026-d933d6134193 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:41.760994 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66d65b-9497-4afe-8026-d933d6134193 admin admin] PATH_INFO: `/v3/projects/3a2b05448a954a9b8156cc95be782351/users/65321d33e9574f509c1e6645118af76f/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:41.763179 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:09:41.775832 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66d65b-9497-4afe-8026-d933d6134193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2b05448a954a9b8156cc95be782351, user_id=65321d33e9574f509c1e6645118af76f, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:41.778505 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66d65b-9497-4afe-8026-d933d6134193 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:41.847594 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1383/2757] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:09:41 2022] PUT /identity/v3/projects/3a2b05448a954a9b8156cc95be782351/users/65321d33e9574f509c1e6645118af76f/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:09:41.858729 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56687ea-bbe3-45b2-ab43-8be0fefd77bb None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:41.859022 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56687ea-bbe3-45b2-ab43-8be0fefd77bb None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:41.859306 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56687ea-bbe3-45b2-ab43-8be0fefd77bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:41.886595 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b56687ea-bbe3-45b2-ab43-8be0fefd77bb None None] MFA Rules not processed for user `65321d33e9574f509c1e6645118af76f`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:09:41.887849 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b56687ea-bbe3-45b2-ab43-8be0fefd77bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:41.951670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1375/2758] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:09:41.962048 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66d65b-9497-4afe-8026-d933d6134193 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:41.963718 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9b66d65b-9497-4afe-8026-d933d6134193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:42.019021 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66d65b-9497-4afe-8026-d933d6134193 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:42.022735 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45f2a9-ddd4-49f8-89d6-50c3887984fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:42.023366 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45f2a9-ddd4-49f8-89d6-50c3887984fb service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:42.023644 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45f2a9-ddd4-49f8-89d6-50c3887984fb service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:42.023918 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45f2a9-ddd4-49f8-89d6-50c3887984fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:42.032054 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45f2a9-ddd4-49f8-89d6-50c3887984fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:42.033497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45f2a9-ddd4-49f8-89d6-50c3887984fb service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:42.042509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1384/2759] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:09:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:09:51.948664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:09:52.038454 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:09:52.805525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56687ea-bbe3-45b2-ab43-8be0fefd77bb None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:52.872347 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56687ea-bbe3-45b2-ab43-8be0fefd77bb None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:52.879035 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2811cb-7b6f-420a-a671-1bf7a9d27542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:52.879934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2811cb-7b6f-420a-a671-1bf7a9d27542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:52.880223 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2811cb-7b6f-420a-a671-1bf7a9d27542 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:52.880565 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2811cb-7b6f-420a-a671-1bf7a9d27542 admin admin] PATH_INFO: `/v3/users/65321d33e9574f509c1e6645118af76f` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:52.882536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2811cb-7b6f-420a-a671-1bf7a9d27542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65321d33e9574f509c1e6645118af76f)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:52.885361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2811cb-7b6f-420a-a671-1bf7a9d27542 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:53.074836 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ae2811cb-7b6f-420a-a671-1bf7a9d27542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65321d33e9574f509c1e6645118af76f'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:53.087502 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ae2811cb-7b6f-420a-a671-1bf7a9d27542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65321d33e9574f509c1e6645118af76f'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:53.151122 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ae2811cb-7b6f-420a-a671-1bf7a9d27542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65321d33e9574f509c1e6645118af76f'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:53.151752 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ae2811cb-7b6f-420a-a671-1bf7a9d27542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65321d33e9574f509c1e6645118af76f'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:53.159803 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-ae2811cb-7b6f-420a-a671-1bf7a9d27542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65321d33e9574f509c1e6645118af76f'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:53.166525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1376/2760] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:09:52 2022] DELETE /identity/v3/users/65321d33e9574f509c1e6645118af76f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:09:53.171264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5dd85-44d2-42cf-83e9-c0165c080809 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:53.171991 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5dd85-44d2-42cf-83e9-c0165c080809 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:53.172232 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5dd85-44d2-42cf-83e9-c0165c080809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:53.195083 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-35d5dd85-44d2-42cf-83e9-c0165c080809 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:09:53.196306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-35d5dd85-44d2-42cf-83e9-c0165c080809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:53.257037 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1385/2761] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:09:53.266462 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2811cb-7b6f-420a-a671-1bf7a9d27542 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:53.267936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ae2811cb-7b6f-420a-a671-1bf7a9d27542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:53.329020 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2811cb-7b6f-420a-a671-1bf7a9d27542 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:53.333297 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cee70a-f185-4fe4-9e5c-f651b28ebc96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:53.333982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cee70a-f185-4fe4-9e5c-f651b28ebc96 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:53.334296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cee70a-f185-4fe4-9e5c-f651b28ebc96 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:53.334579 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cee70a-f185-4fe4-9e5c-f651b28ebc96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:53.344130 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cee70a-f185-4fe4-9e5c-f651b28ebc96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:53.345591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cee70a-f185-4fe4-9e5c-f651b28ebc96 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:53.356440 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1377/2762] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:09:53.746497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5dd85-44d2-42cf-83e9-c0165c080809 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:53.748080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-35d5dd85-44d2-42cf-83e9-c0165c080809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:53.760747 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5dd85-44d2-42cf-83e9-c0165c080809 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:53.765673 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:53.766618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:53.766904 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:53.767180 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b admin admin] PATH_INFO: `/v3/projects/3a2b05448a954a9b8156cc95be782351` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:53.768417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2b05448a954a9b8156cc95be782351)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:53.770480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:53.870821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2b05448a954a9b8156cc95be782351', 'request_id': 'req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:53.876895 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2b05448a954a9b8156cc95be782351', 'request_id': 'req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:53.933322 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2b05448a954a9b8156cc95be782351', 'request_id': 'req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:53.944249 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b admin admin] The token cache is being invalidate because project 3a2b05448a954a9b8156cc95be782351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:09:53.944535 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:53.945208 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:09:53.946783 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1386/2763] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:09:53 2022] DELETE /identity/v3/projects/3a2b05448a954a9b8156cc95be782351 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:09:54.906647 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cee70a-f185-4fe4-9e5c-f651b28ebc96 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:09:54.908074 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-84cee70a-f185-4fe4-9e5c-f651b28ebc96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:54.933417 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:09:54.997560 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cee70a-f185-4fe4-9e5c-f651b28ebc96 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:09:55.056800 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96436a-24e5-488e-b321-a911353f2b35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:09:55.057448 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96436a-24e5-488e-b321-a911353f2b35 service placement] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:09:55.057741 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96436a-24e5-488e-b321-a911353f2b35 service placement] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:09:55.058034 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96436a-24e5-488e-b321-a911353f2b35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:09:55.059783 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8d96436a-24e5-488e-b321-a911353f2b35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:09:55.071537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96436a-24e5-488e-b321-a911353f2b35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:09:55.073139 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96436a-24e5-488e-b321-a911353f2b35 service placement] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:09:55.082883 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1378/2764] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:09:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:10:03.941002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:10:05.078708 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=57 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:24.227316 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:24.228757 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:24.284668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c36c6-26d1-4bd4-85c1-d7214ca5326b admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:24.288236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce3adf-ac62-4912-a496-16e6924ef61f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:24.289394 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce3adf-ac62-4912-a496-16e6924ef61f service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:24.289677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce3adf-ac62-4912-a496-16e6924ef61f service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:24.289939 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce3adf-ac62-4912-a496-16e6924ef61f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:24.291662 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-03ce3adf-ac62-4912-a496-16e6924ef61f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:24.349817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce3adf-ac62-4912-a496-16e6924ef61f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:24.351252 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce3adf-ac62-4912-a496-16e6924ef61f service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:24.361059 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1387/2765] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:11:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:11:30.215881 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96436a-24e5-488e-b321-a911353f2b35 service placement] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:30.217326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8d96436a-24e5-488e-b321-a911353f2b35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:30.228592 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96436a-24e5-488e-b321-a911353f2b35 service placement] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:30.232243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ea1ee-f5bf-42ac-a8da-85c8e3099b65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:30.232912 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ea1ee-f5bf-42ac-a8da-85c8e3099b65 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:30.233195 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ea1ee-f5bf-42ac-a8da-85c8e3099b65 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:30.233467 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ea1ee-f5bf-42ac-a8da-85c8e3099b65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:30.235192 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-083ea1ee-f5bf-42ac-a8da-85c8e3099b65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:30.328040 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ea1ee-f5bf-42ac-a8da-85c8e3099b65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:30.329415 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ea1ee-f5bf-42ac-a8da-85c8e3099b65 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:30.350630 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1379/2766] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:11:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:11:34.356759 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=48 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:35.813209 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90067a2a-e206-4a4b-b464-1a6fdc144e42 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:35.813825 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90067a2a-e206-4a4b-b464-1a6fdc144e42 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:35.813825 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90067a2a-e206-4a4b-b464-1a6fdc144e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:35.831633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-90067a2a-e206-4a4b-b464-1a6fdc144e42 None None] MFA Rules not processed for user `e6357e83df904ea09221cfc374d776c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:11:35.832879 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-90067a2a-e206-4a4b-b464-1a6fdc144e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:35.839880 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1388/2767] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:11:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:11:39.800816 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ea1ee-f5bf-42ac-a8da-85c8e3099b65 service cinder] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:39.802263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-083ea1ee-f5bf-42ac-a8da-85c8e3099b65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:39.867369 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ea1ee-f5bf-42ac-a8da-85c8e3099b65 service cinder] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:39.871541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d3ed5-2d03-4d90-a428-5f7f21c06212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:39.872211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d3ed5-2d03-4d90-a428-5f7f21c06212 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:39.872495 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d3ed5-2d03-4d90-a428-5f7f21c06212 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:39.872808 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d3ed5-2d03-4d90-a428-5f7f21c06212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:39.874769 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0d7d3ed5-2d03-4d90-a428-5f7f21c06212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:39.885167 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d3ed5-2d03-4d90-a428-5f7f21c06212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:39.886654 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d3ed5-2d03-4d90-a428-5f7f21c06212 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:39.896566 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1380/2768] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:11:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:11:45.826465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:49.893030 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=72 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:11:55.155032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90067a2a-e206-4a4b-b464-1a6fdc144e42 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:11:55.164546 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90067a2a-e206-4a4b-b464-1a6fdc144e42 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:11:55.168669 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6c369-839e-4599-b814-21324b393e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:11:55.169379 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6c369-839e-4599-b814-21324b393e9f service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:11:55.169655 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6c369-839e-4599-b814-21324b393e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:11:55.169930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6c369-839e-4599-b814-21324b393e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:11:55.171680 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a0e6c369-839e-4599-b814-21324b393e9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:11:55.232323 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6c369-839e-4599-b814-21324b393e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:11:55.233774 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6c369-839e-4599-b814-21324b393e9f service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:11:55.243142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1389/2769] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:11:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:12:05.238882 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=30 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:13.400563 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4fa24-4536-449d-9e42-bafd5ff2865e None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:13.407959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4fa24-4536-449d-9e42-bafd5ff2865e None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:13.407959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4fa24-4536-449d-9e42-bafd5ff2865e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:13.419212 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-05b4fa24-4536-449d-9e42-bafd5ff2865e None None] MFA Rules not processed for user `093402db51104953a681418b958b2c38`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:13:13.420425 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-05b4fa24-4536-449d-9e42-bafd5ff2865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:13.476591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1381/2770] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:13:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:13:14.141043 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6c369-839e-4599-b814-21324b393e9f service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:14.142512 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a0e6c369-839e-4599-b814-21324b393e9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:14.159038 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6c369-839e-4599-b814-21324b393e9f service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:14.164539 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c221a95-e48a-4de6-afc9-6d0b7ac814c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:14.165216 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c221a95-e48a-4de6-afc9-6d0b7ac814c1 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:14.165493 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c221a95-e48a-4de6-afc9-6d0b7ac814c1 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:14.165766 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c221a95-e48a-4de6-afc9-6d0b7ac814c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:14.167537 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4c221a95-e48a-4de6-afc9-6d0b7ac814c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:14.178776 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c221a95-e48a-4de6-afc9-6d0b7ac814c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:14.180352 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c221a95-e48a-4de6-afc9-6d0b7ac814c1 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:14.189297 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1390/2771] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:13:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:13:23.469086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=25 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:24.185177 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=6 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:13:49.412779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4fa24-4536-449d-9e42-bafd5ff2865e None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:13:49.426892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4fa24-4536-449d-9e42-bafd5ff2865e None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:13:49.432500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5fd79-74ab-408b-ad75-614c9d039ed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:13:49.433195 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5fd79-74ab-408b-ad75-614c9d039ed4 service nova] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:13:49.433479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5fd79-74ab-408b-ad75-614c9d039ed4 service nova] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:13:49.433757 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5fd79-74ab-408b-ad75-614c9d039ed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:13:49.436355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0ea5fd79-74ab-408b-ad75-614c9d039ed4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:13:49.449909 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5fd79-74ab-408b-ad75-614c9d039ed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:13:49.451536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5fd79-74ab-408b-ad75-614c9d039ed4 service nova] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:13:49.463689 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1382/2772] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:13:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:13:59.458231 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=6 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:00.520716 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c221a95-e48a-4de6-afc9-6d0b7ac814c1 service nova] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:00.532440 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c221a95-e48a-4de6-afc9-6d0b7ac814c1 service nova] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:00.537928 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76b898-08fa-460d-9f97-9157afe157f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08529776af224c36ab560c13f5941e0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:00.538556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76b898-08fa-460d-9f97-9157afe157f9 service nova] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:00.538837 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76b898-08fa-460d-9f97-9157afe157f9 service nova] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:00.539107 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76b898-08fa-460d-9f97-9157afe157f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:00.540865 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-6b76b898-08fa-460d-9f97-9157afe157f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:00.553489 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76b898-08fa-460d-9f97-9157afe157f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:00.555037 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76b898-08fa-460d-9f97-9157afe157f9 service nova] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:00.566372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1391/2773] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:14:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:14:04.802106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5fd79-74ab-408b-ad75-614c9d039ed4 service nova] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:04.803545 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0ea5fd79-74ab-408b-ad75-614c9d039ed4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:04.815558 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5fd79-74ab-408b-ad75-614c9d039ed4 service nova] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:04.819152 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3af85-26e0-4c29-8df4-6019f2c57a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:04.819784 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3af85-26e0-4c29-8df4-6019f2c57a59 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:04.820067 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3af85-26e0-4c29-8df4-6019f2c57a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:04.820343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3af85-26e0-4c29-8df4-6019f2c57a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:04.822094 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-95a3af85-26e0-4c29-8df4-6019f2c57a59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:04.884516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3af85-26e0-4c29-8df4-6019f2c57a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:04.886001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3af85-26e0-4c29-8df4-6019f2c57a59 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:04.898985 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1383/2774] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:14:08.252556 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76b898-08fa-460d-9f97-9157afe157f9 service nova] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:08.254048 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-6b76b898-08fa-460d-9f97-9157afe157f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:08.272584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76b898-08fa-460d-9f97-9157afe157f9 service nova] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:08.277665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba9fe8-9577-413f-9e72-57a9112ea931 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:08.278336 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba9fe8-9577-413f-9e72-57a9112ea931 service placement] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:08.278621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba9fe8-9577-413f-9e72-57a9112ea931 service placement] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:08.278899 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba9fe8-9577-413f-9e72-57a9112ea931 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:08.280821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-dcba9fe8-9577-413f-9e72-57a9112ea931 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:08.292450 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba9fe8-9577-413f-9e72-57a9112ea931 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:08.294067 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba9fe8-9577-413f-9e72-57a9112ea931 service placement] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:08.305465 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1392/2775] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:14:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:14:11.902046 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3af85-26e0-4c29-8df4-6019f2c57a59 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:11.914263 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3af85-26e0-4c29-8df4-6019f2c57a59 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:11.919401 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f473cb6-9ffe-4c27-873f-bf24b6a8a87b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:11.920138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f473cb6-9ffe-4c27-873f-bf24b6a8a87b service placement] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:11.920427 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f473cb6-9ffe-4c27-873f-bf24b6a8a87b service placement] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:11.920735 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f473cb6-9ffe-4c27-873f-bf24b6a8a87b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:11.922519 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2f473cb6-9ffe-4c27-873f-bf24b6a8a87b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:11.934678 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f473cb6-9ffe-4c27-873f-bf24b6a8a87b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:11.936295 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f473cb6-9ffe-4c27-873f-bf24b6a8a87b service placement] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:11.946482 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1384/2776] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:14:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:14:11.999671 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba9fe8-9577-413f-9e72-57a9112ea931 service placement] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:12.001157 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-dcba9fe8-9577-413f-9e72-57a9112ea931 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:12.015165 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba9fe8-9577-413f-9e72-57a9112ea931 service placement] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:12.019585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690df4eb-74f9-4bb4-b8c9-7031648e88de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:12.020444 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690df4eb-74f9-4bb4-b8c9-7031648e88de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:12.020760 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690df4eb-74f9-4bb4-b8c9-7031648e88de admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:12.021155 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690df4eb-74f9-4bb4-b8c9-7031648e88de admin admin] PATH_INFO: `/v3/users/e6357e83df904ea09221cfc374d776c4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:12.022341 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690df4eb-74f9-4bb4-b8c9-7031648e88de admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6357e83df904ea09221cfc374d776c4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:12.024246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690df4eb-74f9-4bb4-b8c9-7031648e88de admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:12.184286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-690df4eb-74f9-4bb4-b8c9-7031648e88de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6357e83df904ea09221cfc374d776c4'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:12.196712 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-690df4eb-74f9-4bb4-b8c9-7031648e88de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6357e83df904ea09221cfc374d776c4'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:12.273315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-690df4eb-74f9-4bb4-b8c9-7031648e88de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6357e83df904ea09221cfc374d776c4'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:12.273969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-690df4eb-74f9-4bb4-b8c9-7031648e88de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6357e83df904ea09221cfc374d776c4'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:12.282043 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-690df4eb-74f9-4bb4-b8c9-7031648e88de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6357e83df904ea09221cfc374d776c4'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:12.287923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1393/2777] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:14:11 2022] DELETE /identity/v3/users/e6357e83df904ea09221cfc374d776c4 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:14:12.565972 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f473cb6-9ffe-4c27-873f-bf24b6a8a87b service placement] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:12.577282 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f473cb6-9ffe-4c27-873f-bf24b6a8a87b service placement] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:12.634078 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197275ca-b2fb-40ed-bb29-892960321265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:12.634929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197275ca-b2fb-40ed-bb29-892960321265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:12.635206 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197275ca-b2fb-40ed-bb29-892960321265 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:12.635476 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197275ca-b2fb-40ed-bb29-892960321265 admin admin] PATH_INFO: `/v3/projects/2bba2dfe000d427b9ab9dff2601436f1` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:12.636700 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197275ca-b2fb-40ed-bb29-892960321265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bba2dfe000d427b9ab9dff2601436f1)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:12.638533 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197275ca-b2fb-40ed-bb29-892960321265 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:12.747034 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-197275ca-b2fb-40ed-bb29-892960321265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bba2dfe000d427b9ab9dff2601436f1', 'request_id': 'req-197275ca-b2fb-40ed-bb29-892960321265'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:12.828320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-197275ca-b2fb-40ed-bb29-892960321265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bba2dfe000d427b9ab9dff2601436f1', 'request_id': 'req-197275ca-b2fb-40ed-bb29-892960321265'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:12.835038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-197275ca-b2fb-40ed-bb29-892960321265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bba2dfe000d427b9ab9dff2601436f1', 'request_id': 'req-197275ca-b2fb-40ed-bb29-892960321265'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:12.845884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-197275ca-b2fb-40ed-bb29-892960321265 admin admin] The token cache is being invalidate because project 2bba2dfe000d427b9ab9dff2601436f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:14:12.846171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-197275ca-b2fb-40ed-bb29-892960321265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:12.846802 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-197275ca-b2fb-40ed-bb29-892960321265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:12.848334 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1385/2778] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:14:12 2022] DELETE /identity/v3/projects/2bba2dfe000d427b9ab9dff2601436f1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:14:12.852355 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690df4eb-74f9-4bb4-b8c9-7031648e88de admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:12.853788 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-690df4eb-74f9-4bb4-b8c9-7031648e88de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:12.867150 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690df4eb-74f9-4bb4-b8c9-7031648e88de admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:12.923154 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7c608-a26b-483e-b34e-abc8096b8582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:12.924018 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7c608-a26b-483e-b34e-abc8096b8582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:12.924298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7c608-a26b-483e-b34e-abc8096b8582 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:12.924573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7c608-a26b-483e-b34e-abc8096b8582 admin admin] PATH_INFO: `/v3/users/42f7b953d44a41208339e3d1a9dd6efb` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:12.925779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7c608-a26b-483e-b34e-abc8096b8582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f7b953d44a41208339e3d1a9dd6efb)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:12.927680 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7c608-a26b-483e-b34e-abc8096b8582 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:13.110920 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-78f7c608-a26b-483e-b34e-abc8096b8582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f7b953d44a41208339e3d1a9dd6efb'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:13.112033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:13.124212 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-78f7c608-a26b-483e-b34e-abc8096b8582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f7b953d44a41208339e3d1a9dd6efb'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:13.180236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-78f7c608-a26b-483e-b34e-abc8096b8582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f7b953d44a41208339e3d1a9dd6efb'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:13.180236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-78f7c608-a26b-483e-b34e-abc8096b8582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f7b953d44a41208339e3d1a9dd6efb'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:13.184660 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-78f7c608-a26b-483e-b34e-abc8096b8582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f7b953d44a41208339e3d1a9dd6efb'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:13.190824 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1394/2779] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:14:12 2022] DELETE /identity/v3/users/42f7b953d44a41208339e3d1a9dd6efb => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:14:13.417358 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197275ca-b2fb-40ed-bb29-892960321265 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:13.418814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-197275ca-b2fb-40ed-bb29-892960321265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:14:13.433162 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197275ca-b2fb-40ed-bb29-892960321265 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:14:13.441121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:13.490237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:14:13.491100 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:14:13.491378 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:14:13.491646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696 admin admin] PATH_INFO: `/v3/projects/c18eff6a350c4ae898fca69a92227024` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:14:13.492850 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c18eff6a350c4ae898fca69a92227024)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:14:13.494727 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:14:13.586304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c18eff6a350c4ae898fca69a92227024', 'request_id': 'req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:13.665848 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c18eff6a350c4ae898fca69a92227024', 'request_id': 'req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:13.672355 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c18eff6a350c4ae898fca69a92227024', 'request_id': 'req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:13.683328 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696 admin admin] The token cache is being invalidate because project c18eff6a350c4ae898fca69a92227024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:14:13.683602 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:13.684214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:14:13.685757 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1386/2780] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:14:13 2022] DELETE /identity/v3/projects/c18eff6a350c4ae898fca69a92227024 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:14:23.250522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=12,keystone:DELETE=3,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:23.680313 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:14:59.965755 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7c608-a26b-483e-b34e-abc8096b8582 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:14:59.967182 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-78f7c608-a26b-483e-b34e-abc8096b8582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:00.036088 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7c608-a26b-483e-b34e-abc8096b8582 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:00.094286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e10db-e4e7-48a4-b019-c196e88561db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:00.094926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e10db-e4e7-48a4-b019-c196e88561db service placement] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:00.095270 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e10db-e4e7-48a4-b019-c196e88561db service placement] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:00.095545 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e10db-e4e7-48a4-b019-c196e88561db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:00.097419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-541e10db-e4e7-48a4-b019-c196e88561db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:00.109183 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e10db-e4e7-48a4-b019-c196e88561db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:00.110862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e10db-e4e7-48a4-b019-c196e88561db service placement] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:00.121143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1395/2781] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:14:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:15:10.116704 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=58 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:18.344694 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:18.346109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:18.402751 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcbff3-dc1d-4314-8a59-3c8ef3245696 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:18.407126 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d266b3d-6b99-480d-94e6-aebba504084c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:18.407763 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d266b3d-6b99-480d-94e6-aebba504084c service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:18.408046 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d266b3d-6b99-480d-94e6-aebba504084c service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:18.408322 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d266b3d-6b99-480d-94e6-aebba504084c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:18.410183 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-3d266b3d-6b99-480d-94e6-aebba504084c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:18.471623 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d266b3d-6b99-480d-94e6-aebba504084c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:18.473065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d266b3d-6b99-480d-94e6-aebba504084c service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:18.482473 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1387/2782] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:15:22.008277 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e10db-e4e7-48a4-b019-c196e88561db service placement] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:22.009952 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-541e10db-e4e7-48a4-b019-c196e88561db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:22.024893 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e10db-e4e7-48a4-b019-c196e88561db service placement] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:22.029563 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10cbf3-4a91-4742-801f-9af85792fa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:22.030423 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10cbf3-4a91-4742-801f-9af85792fa70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:22.030696 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10cbf3-4a91-4742-801f-9af85792fa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:22.030969 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10cbf3-4a91-4742-801f-9af85792fa70 admin admin] PATH_INFO: `/v3/users/093402db51104953a681418b958b2c38` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:22.032144 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10cbf3-4a91-4742-801f-9af85792fa70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093402db51104953a681418b958b2c38)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:22.034236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10cbf3-4a91-4742-801f-9af85792fa70 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:22.231956 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5a10cbf3-4a91-4742-801f-9af85792fa70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093402db51104953a681418b958b2c38'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:22.244721 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5a10cbf3-4a91-4742-801f-9af85792fa70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093402db51104953a681418b958b2c38'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:22.309842 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5a10cbf3-4a91-4742-801f-9af85792fa70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093402db51104953a681418b958b2c38'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:22.310462 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5a10cbf3-4a91-4742-801f-9af85792fa70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093402db51104953a681418b958b2c38'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:22.317665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-5a10cbf3-4a91-4742-801f-9af85792fa70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093402db51104953a681418b958b2c38'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:22.323677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1396/2783] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:15:22 2022] DELETE /identity/v3/users/093402db51104953a681418b958b2c38 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:22.580906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d266b3d-6b99-480d-94e6-aebba504084c service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:22.590757 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d266b3d-6b99-480d-94e6-aebba504084c service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:22.648768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed0423-2ea1-4e5a-a43f-e566fa077702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:22.649637 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed0423-2ea1-4e5a-a43f-e566fa077702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:22.649923 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed0423-2ea1-4e5a-a43f-e566fa077702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:22.650202 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed0423-2ea1-4e5a-a43f-e566fa077702 admin admin] PATH_INFO: `/v3/projects/fa77b298448a40bbb2f12e1b5b9c5967` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:22.651407 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed0423-2ea1-4e5a-a43f-e566fa077702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa77b298448a40bbb2f12e1b5b9c5967)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:22.653380 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed0423-2ea1-4e5a-a43f-e566fa077702 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:22.768326 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-76ed0423-2ea1-4e5a-a43f-e566fa077702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa77b298448a40bbb2f12e1b5b9c5967', 'request_id': 'req-76ed0423-2ea1-4e5a-a43f-e566fa077702'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:22.770842 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:22.835598 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-76ed0423-2ea1-4e5a-a43f-e566fa077702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa77b298448a40bbb2f12e1b5b9c5967', 'request_id': 'req-76ed0423-2ea1-4e5a-a43f-e566fa077702'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:22.842225 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-76ed0423-2ea1-4e5a-a43f-e566fa077702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa77b298448a40bbb2f12e1b5b9c5967', 'request_id': 'req-76ed0423-2ea1-4e5a-a43f-e566fa077702'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:22.852915 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-76ed0423-2ea1-4e5a-a43f-e566fa077702 admin admin] The token cache is being invalidate because project fa77b298448a40bbb2f12e1b5b9c5967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:15:22.853243 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-76ed0423-2ea1-4e5a-a43f-e566fa077702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:22.853874 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-76ed0423-2ea1-4e5a-a43f-e566fa077702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:22.855404 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1388/2784] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:15:22 2022] DELETE /identity/v3/projects/fa77b298448a40bbb2f12e1b5b9c5967 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:22.860797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af744d9-5bc8-43d6-9199-5f3245f1d480 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:22.861087 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af744d9-5bc8-43d6-9199-5f3245f1d480 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:22.861363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af744d9-5bc8-43d6-9199-5f3245f1d480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:22.880054 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1af744d9-5bc8-43d6-9199-5f3245f1d480 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:22.881268 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1af744d9-5bc8-43d6-9199-5f3245f1d480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:22.940307 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1397/2785] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:22.948443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260639c0-9938-4fd6-9c3e-cd144b86ac53 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:22.948770 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260639c0-9938-4fd6-9c3e-cd144b86ac53 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:22.949049 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260639c0-9938-4fd6-9c3e-cd144b86ac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:22.967662 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-260639c0-9938-4fd6-9c3e-cd144b86ac53 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:22.968906 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-260639c0-9938-4fd6-9c3e-cd144b86ac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:22.976783 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1389/2786] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:22.986469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af744d9-5bc8-43d6-9199-5f3245f1d480 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:22.996149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af744d9-5bc8-43d6-9199-5f3245f1d480 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:23.001363 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb6120-f98a-4960-a621-a1b1e9e15342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:23.002010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb6120-f98a-4960-a621-a1b1e9e15342 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:23.002297 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb6120-f98a-4960-a621-a1b1e9e15342 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:23.002578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb6120-f98a-4960-a621-a1b1e9e15342 admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:23.003306 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb6120-f98a-4960-a621-a1b1e9e15342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:23.003616 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb6120-f98a-4960-a621-a1b1e9e15342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:23.005242 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb6120-f98a-4960-a621-a1b1e9e15342 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:23.017657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1398/2787] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:23.021591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260639c0-9938-4fd6-9c3e-cd144b86ac53 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:23.030780 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260639c0-9938-4fd6-9c3e-cd144b86ac53 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:23.035466 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec028940-56f6-4c4f-80d9-5565481e5d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:23.036109 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec028940-56f6-4c4f-80d9-5565481e5d60 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:23.036394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec028940-56f6-4c4f-80d9-5565481e5d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:23.036690 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec028940-56f6-4c4f-80d9-5565481e5d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:23.037384 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec028940-56f6-4c4f-80d9-5565481e5d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:23.039262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec028940-56f6-4c4f-80d9-5565481e5d60 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:23.135857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1390/2788] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:15:23 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:23.139259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb6120-f98a-4960-a621-a1b1e9e15342 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:23.149492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb6120-f98a-4960-a621-a1b1e9e15342 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:23.208070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f0b4e-829b-4906-9a38-d6d880229cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:23.208784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f0b4e-829b-4906-9a38-d6d880229cde admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:23.209068 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f0b4e-829b-4906-9a38-d6d880229cde admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:23.209345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f0b4e-829b-4906-9a38-d6d880229cde admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:23.210048 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f0b4e-829b-4906-9a38-d6d880229cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:23.211951 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f0b4e-829b-4906-9a38-d6d880229cde admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:23.218647 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:23.310518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1399/2789] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:15:23 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:23.315373 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec028940-56f6-4c4f-80d9-5565481e5d60 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:23.325615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec028940-56f6-4c4f-80d9-5565481e5d60 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:23.330463 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42706e6d-e196-49fb-9dfb-966ae955bd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:23.331121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42706e6d-e196-49fb-9dfb-966ae955bd97 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:23.331403 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42706e6d-e196-49fb-9dfb-966ae955bd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:23.331677 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42706e6d-e196-49fb-9dfb-966ae955bd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:23.332413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42706e6d-e196-49fb-9dfb-966ae955bd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:23.334074 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42706e6d-e196-49fb-9dfb-966ae955bd97 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:23.344315 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1391/2790] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:23.348204 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f0b4e-829b-4906-9a38-d6d880229cde admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:23.359033 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f0b4e-829b-4906-9a38-d6d880229cde admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:23.363677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec57e4e-39af-4173-9760-866895044f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:23.364330 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec57e4e-39af-4173-9760-866895044f6f admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:23.364612 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec57e4e-39af-4173-9760-866895044f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:23.364914 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec57e4e-39af-4173-9760-866895044f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:23.365638 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec57e4e-39af-4173-9760-866895044f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:23.367206 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec57e4e-39af-4173-9760-866895044f6f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:23.378342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1400/2791] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:23.382403 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42706e6d-e196-49fb-9dfb-966ae955bd97 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:23.392849 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42706e6d-e196-49fb-9dfb-966ae955bd97 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:23.397487 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea956a5-caa3-4ca8-978b-2cdbd5303960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:23.398357 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea956a5-caa3-4ca8-978b-2cdbd5303960 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:23.398638 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea956a5-caa3-4ca8-978b-2cdbd5303960 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:23.398914 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea956a5-caa3-4ca8-978b-2cdbd5303960 admin admin] PATH_INFO: `/v3/projects/96b34a0e513b459197a488ad9cdf2257/users/1ccfed6099914b96a022bb3ff8a74fef/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:23.413856 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea956a5-caa3-4ca8-978b-2cdbd5303960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b34a0e513b459197a488ad9cdf2257, user_id=1ccfed6099914b96a022bb3ff8a74fef, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:23.416479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea956a5-caa3-4ca8-978b-2cdbd5303960 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:23.516107 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1392/2792] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:15:23 2022] PUT /identity/v3/projects/96b34a0e513b459197a488ad9cdf2257/users/1ccfed6099914b96a022bb3ff8a74fef/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:23.526850 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e63bf6-5541-40b4-8418-ae737ff728fc None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:23.527134 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e63bf6-5541-40b4-8418-ae737ff728fc None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:23.527412 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e63bf6-5541-40b4-8418-ae737ff728fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:23.555281 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-34e63bf6-5541-40b4-8418-ae737ff728fc None None] MFA Rules not processed for user `1ccfed6099914b96a022bb3ff8a74fef`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:23.556499 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-34e63bf6-5541-40b4-8418-ae737ff728fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:23.620301 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1401/2793] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:23.631132 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea956a5-caa3-4ca8-978b-2cdbd5303960 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:23.632838 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-eea956a5-caa3-4ca8-978b-2cdbd5303960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:23.688383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea956a5-caa3-4ca8-978b-2cdbd5303960 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:23.692089 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09b96b-bfc5-47c3-8339-51b4ee8d3026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:23.692746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09b96b-bfc5-47c3-8339-51b4ee8d3026 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:23.693030 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09b96b-bfc5-47c3-8339-51b4ee8d3026 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:23.693304 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09b96b-bfc5-47c3-8339-51b4ee8d3026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:23.701736 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09b96b-bfc5-47c3-8339-51b4ee8d3026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:23.703217 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09b96b-bfc5-47c3-8339-51b4ee8d3026 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:23.711791 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1393/2794] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:15:23 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:15:33.189151 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e63bf6-5541-40b4-8418-ae737ff728fc None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:33.251150 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e63bf6-5541-40b4-8418-ae737ff728fc None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:33.255652 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844f9eb-3efb-4e75-be25-e7291394606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:33.256509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844f9eb-3efb-4e75-be25-e7291394606c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:33.256821 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844f9eb-3efb-4e75-be25-e7291394606c admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:33.257095 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844f9eb-3efb-4e75-be25-e7291394606c admin admin] PATH_INFO: `/v3/users/1ccfed6099914b96a022bb3ff8a74fef` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:33.258266 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844f9eb-3efb-4e75-be25-e7291394606c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ccfed6099914b96a022bb3ff8a74fef)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:33.260177 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844f9eb-3efb-4e75-be25-e7291394606c admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:33.438098 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4844f9eb-3efb-4e75-be25-e7291394606c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ccfed6099914b96a022bb3ff8a74fef'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:33.450204 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4844f9eb-3efb-4e75-be25-e7291394606c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ccfed6099914b96a022bb3ff8a74fef'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:33.454384 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:33.509678 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4844f9eb-3efb-4e75-be25-e7291394606c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ccfed6099914b96a022bb3ff8a74fef'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:33.510294 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4844f9eb-3efb-4e75-be25-e7291394606c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ccfed6099914b96a022bb3ff8a74fef'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:33.518020 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4844f9eb-3efb-4e75-be25-e7291394606c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ccfed6099914b96a022bb3ff8a74fef'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:33.524881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1402/2795] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:15:33 2022] DELETE /identity/v3/users/1ccfed6099914b96a022bb3ff8a74fef => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:33.529381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965730c-6b84-43ec-bb67-bb731fc4db9b None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:33.529864 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965730c-6b84-43ec-bb67-bb731fc4db9b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:33.530012 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965730c-6b84-43ec-bb67-bb731fc4db9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:33.547828 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-4965730c-6b84-43ec-bb67-bb731fc4db9b None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:33.549083 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-4965730c-6b84-43ec-bb67-bb731fc4db9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:33.609312 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1394/2796] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:33.618862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844f9eb-3efb-4e75-be25-e7291394606c admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:33.620237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4844f9eb-3efb-4e75-be25-e7291394606c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:33.678240 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844f9eb-3efb-4e75-be25-e7291394606c admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:33.681829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8b134-498b-445c-a94c-e3dbffc0655f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:33.682467 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8b134-498b-445c-a94c-e3dbffc0655f service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:33.682747 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8b134-498b-445c-a94c-e3dbffc0655f service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:33.683016 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8b134-498b-445c-a94c-e3dbffc0655f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:33.692555 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8b134-498b-445c-a94c-e3dbffc0655f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:33.693947 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8b134-498b-445c-a94c-e3dbffc0655f service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:33.703584 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1403/2797] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:15:34.141779 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965730c-6b84-43ec-bb67-bb731fc4db9b None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:34.145361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-4965730c-6b84-43ec-bb67-bb731fc4db9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:34.155962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965730c-6b84-43ec-bb67-bb731fc4db9b None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:34.161170 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4f2d8-694d-4d72-b1ad-c46f4aa413f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:34.162020 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4f2d8-694d-4d72-b1ad-c46f4aa413f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:34.162298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4f2d8-694d-4d72-b1ad-c46f4aa413f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:34.162568 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4f2d8-694d-4d72-b1ad-c46f4aa413f6 admin admin] PATH_INFO: `/v3/projects/96b34a0e513b459197a488ad9cdf2257` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:34.163744 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4f2d8-694d-4d72-b1ad-c46f4aa413f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b34a0e513b459197a488ad9cdf2257)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:34.165670 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4f2d8-694d-4d72-b1ad-c46f4aa413f6 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:34.174430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:34.252818 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8de4f2d8-694d-4d72-b1ad-c46f4aa413f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b34a0e513b459197a488ad9cdf2257', 'request_id': 'req-8de4f2d8-694d-4d72-b1ad-c46f4aa413f6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:34.340459 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8de4f2d8-694d-4d72-b1ad-c46f4aa413f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b34a0e513b459197a488ad9cdf2257', 'request_id': 'req-8de4f2d8-694d-4d72-b1ad-c46f4aa413f6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:34.347746 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8de4f2d8-694d-4d72-b1ad-c46f4aa413f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b34a0e513b459197a488ad9cdf2257', 'request_id': 'req-8de4f2d8-694d-4d72-b1ad-c46f4aa413f6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:34.358559 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8de4f2d8-694d-4d72-b1ad-c46f4aa413f6 admin admin] The token cache is being invalidate because project 96b34a0e513b459197a488ad9cdf2257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:15:34.358849 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8de4f2d8-694d-4d72-b1ad-c46f4aa413f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:34.359481 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8de4f2d8-694d-4d72-b1ad-c46f4aa413f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:34.361050 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1395/2798] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:15:34 2022] DELETE /identity/v3/projects/96b34a0e513b459197a488ad9cdf2257 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:34.365926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa61cd8-0148-4363-9003-a15e284f0c3e None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:34.366431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa61cd8-0148-4363-9003-a15e284f0c3e None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:34.366538 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa61cd8-0148-4363-9003-a15e284f0c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:34.384259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-9aa61cd8-0148-4363-9003-a15e284f0c3e None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:34.385514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9aa61cd8-0148-4363-9003-a15e284f0c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:34.443490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1404/2799] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:34.454287 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c615cd-d36a-4605-b716-5311a94f7a78 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:34.454573 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c615cd-d36a-4605-b716-5311a94f7a78 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:34.454853 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c615cd-d36a-4605-b716-5311a94f7a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:34.473833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-33c615cd-d36a-4605-b716-5311a94f7a78 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:34.475032 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-33c615cd-d36a-4605-b716-5311a94f7a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:34.483215 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1396/2800] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:34.487485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa61cd8-0148-4363-9003-a15e284f0c3e None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:34.496985 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa61cd8-0148-4363-9003-a15e284f0c3e None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:34.501560 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb15c4-2cc4-423a-ba10-aa7c1b8d961f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:34.502195 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb15c4-2cc4-423a-ba10-aa7c1b8d961f admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:34.502474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb15c4-2cc4-423a-ba10-aa7c1b8d961f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:34.502747 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb15c4-2cc4-423a-ba10-aa7c1b8d961f admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:34.503518 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb15c4-2cc4-423a-ba10-aa7c1b8d961f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:34.503764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb15c4-2cc4-423a-ba10-aa7c1b8d961f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:34.505389 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb15c4-2cc4-423a-ba10-aa7c1b8d961f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:34.517267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1405/2801] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:34.521376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c615cd-d36a-4605-b716-5311a94f7a78 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:34.531158 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c615cd-d36a-4605-b716-5311a94f7a78 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:34.535865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829e5b7-da2b-4d63-97d8-b71e7ec4a4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:34.536507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829e5b7-da2b-4d63-97d8-b71e7ec4a4b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:34.536827 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829e5b7-da2b-4d63-97d8-b71e7ec4a4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:34.537104 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829e5b7-da2b-4d63-97d8-b71e7ec4a4b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:34.537787 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829e5b7-da2b-4d63-97d8-b71e7ec4a4b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:34.539653 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829e5b7-da2b-4d63-97d8-b71e7ec4a4b2 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:34.621655 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1397/2802] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:15:34 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:34.626578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb15c4-2cc4-423a-ba10-aa7c1b8d961f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:34.636608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb15c4-2cc4-423a-ba10-aa7c1b8d961f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:34.694553 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51ceb7-3b5f-4a03-a47d-10fbffaf19d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:34.695222 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51ceb7-3b5f-4a03-a47d-10fbffaf19d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:34.695637 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51ceb7-3b5f-4a03-a47d-10fbffaf19d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:34.695952 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51ceb7-3b5f-4a03-a47d-10fbffaf19d9 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:34.696776 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51ceb7-3b5f-4a03-a47d-10fbffaf19d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:34.699156 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51ceb7-3b5f-4a03-a47d-10fbffaf19d9 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:34.962320 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1406/2803] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:15:34 2022] POST /identity/v3/users => generated 282 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:34.966466 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829e5b7-da2b-4d63-97d8-b71e7ec4a4b2 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:34.976872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829e5b7-da2b-4d63-97d8-b71e7ec4a4b2 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:34.981298 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2df05-f500-49e3-93ef-1170da494b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:34.981941 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2df05-f500-49e3-93ef-1170da494b96 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:34.982591 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2df05-f500-49e3-93ef-1170da494b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:34.982868 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2df05-f500-49e3-93ef-1170da494b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:34.983590 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2df05-f500-49e3-93ef-1170da494b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:34.985211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2df05-f500-49e3-93ef-1170da494b96 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:34.995411 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1398/2804] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:34.999975 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51ceb7-3b5f-4a03-a47d-10fbffaf19d9 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:35.009927 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51ceb7-3b5f-4a03-a47d-10fbffaf19d9 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:35.015189 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbab8b4-288d-42a2-89fb-c7ec64e6dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:35.015830 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbab8b4-288d-42a2-89fb-c7ec64e6dc94 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:35.016116 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbab8b4-288d-42a2-89fb-c7ec64e6dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:35.016390 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbab8b4-288d-42a2-89fb-c7ec64e6dc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:35.017146 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbab8b4-288d-42a2-89fb-c7ec64e6dc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:35.018720 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbab8b4-288d-42a2-89fb-c7ec64e6dc94 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:35.019930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:35.029633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1407/2805] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:35.041081 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2df05-f500-49e3-93ef-1170da494b96 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:35.051738 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2df05-f500-49e3-93ef-1170da494b96 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:35.056227 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a1f30-543d-48c5-9a7a-e89a2428dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:35.057121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a1f30-543d-48c5-9a7a-e89a2428dd25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:35.057392 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a1f30-543d-48c5-9a7a-e89a2428dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:35.057663 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a1f30-543d-48c5-9a7a-e89a2428dd25 admin admin] PATH_INFO: `/v3/projects/263247ca9acb4cb08d182bf5f9186e29/users/9fb548b58d864c18b567a23cf11306e1/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:35.073832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a1f30-543d-48c5-9a7a-e89a2428dd25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=263247ca9acb4cb08d182bf5f9186e29, user_id=9fb548b58d864c18b567a23cf11306e1, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:35.076478 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a1f30-543d-48c5-9a7a-e89a2428dd25 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:35.156207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1399/2806] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:15:35 2022] PUT /identity/v3/projects/263247ca9acb4cb08d182bf5f9186e29/users/9fb548b58d864c18b567a23cf11306e1/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:35.166469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a984cd7-b1d4-44ae-84b1-5615c87e0a84 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:35.170460 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a984cd7-b1d4-44ae-84b1-5615c87e0a84 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:35.170460 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a984cd7-b1d4-44ae-84b1-5615c87e0a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:35.194466 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-9a984cd7-b1d4-44ae-84b1-5615c87e0a84 None None] MFA Rules not processed for user `9fb548b58d864c18b567a23cf11306e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:35.195645 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-9a984cd7-b1d4-44ae-84b1-5615c87e0a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:35.257623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1408/2807] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:35.261934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a1f30-543d-48c5-9a7a-e89a2428dd25 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:35.322734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a1f30-543d-48c5-9a7a-e89a2428dd25 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:35.327681 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676d333-e68f-403e-9def-a5c13b95cc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:35.328857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676d333-e68f-403e-9def-a5c13b95cc21 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:35.328857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676d333-e68f-403e-9def-a5c13b95cc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:35.329080 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676d333-e68f-403e-9def-a5c13b95cc21 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:35.329796 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676d333-e68f-403e-9def-a5c13b95cc21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:35.331675 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676d333-e68f-403e-9def-a5c13b95cc21 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:35.420471 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1400/2808] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:15:35 2022] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:35.424451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a984cd7-b1d4-44ae-84b1-5615c87e0a84 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:35.435171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a984cd7-b1d4-44ae-84b1-5615c87e0a84 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:35.490392 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85180a-afe8-4f1d-b223-25f867a47d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:35.491055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85180a-afe8-4f1d-b223-25f867a47d08 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:35.491338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85180a-afe8-4f1d-b223-25f867a47d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:35.491613 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85180a-afe8-4f1d-b223-25f867a47d08 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:35.492296 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85180a-afe8-4f1d-b223-25f867a47d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:35.494238 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85180a-afe8-4f1d-b223-25f867a47d08 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:35.584521 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1409/2809] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:15:35 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:35.588211 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676d333-e68f-403e-9def-a5c13b95cc21 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:35.599214 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676d333-e68f-403e-9def-a5c13b95cc21 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:35.603862 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17d533-7f2e-47ce-887c-0ee861a0e54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:35.604516 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17d533-7f2e-47ce-887c-0ee861a0e54a admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:35.604833 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17d533-7f2e-47ce-887c-0ee861a0e54a admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:35.605112 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17d533-7f2e-47ce-887c-0ee861a0e54a admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:35.605839 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17d533-7f2e-47ce-887c-0ee861a0e54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:35.608284 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17d533-7f2e-47ce-887c-0ee861a0e54a admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:35.619007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1401/2810] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:35.623219 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85180a-afe8-4f1d-b223-25f867a47d08 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:35.633759 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85180a-afe8-4f1d-b223-25f867a47d08 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:35.638435 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd726dc-fdbc-421b-9d5a-cb524760fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:35.639338 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd726dc-fdbc-421b-9d5a-cb524760fd03 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:35.639621 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd726dc-fdbc-421b-9d5a-cb524760fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:35.639898 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd726dc-fdbc-421b-9d5a-cb524760fd03 admin admin] PATH_INFO: `/v3/projects/0538e53e859e48a391a7df406ce44cde/users/50ea3fc9f1e54add97a075253da46a5c/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:35.654881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd726dc-fdbc-421b-9d5a-cb524760fd03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0538e53e859e48a391a7df406ce44cde, user_id=50ea3fc9f1e54add97a075253da46a5c, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:35.657540 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd726dc-fdbc-421b-9d5a-cb524760fd03 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:35.727171 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1410/2811] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:15:35 2022] PUT /identity/v3/projects/0538e53e859e48a391a7df406ce44cde/users/50ea3fc9f1e54add97a075253da46a5c/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:35.731097 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17d533-7f2e-47ce-887c-0ee861a0e54a admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:35.738513 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:35.742501 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17d533-7f2e-47ce-887c-0ee861a0e54a admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:35.799224 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab37b9-d4d9-47c4-a407-9a80decfb59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:35.799888 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab37b9-d4d9-47c4-a407-9a80decfb59c admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:35.800173 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab37b9-d4d9-47c4-a407-9a80decfb59c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:35.800452 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab37b9-d4d9-47c4-a407-9a80decfb59c admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:35.801205 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab37b9-d4d9-47c4-a407-9a80decfb59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:35.802783 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab37b9-d4d9-47c4-a407-9a80decfb59c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:35.812363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1402/2812] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:35.816589 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd726dc-fdbc-421b-9d5a-cb524760fd03 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:35.827459 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd726dc-fdbc-421b-9d5a-cb524760fd03 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:35.832073 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138661a-d589-4cef-a185-e66407d16d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:35.832987 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138661a-d589-4cef-a185-e66407d16d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:35.833275 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138661a-d589-4cef-a185-e66407d16d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:35.833550 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138661a-d589-4cef-a185-e66407d16d89 admin admin] PATH_INFO: `/v3/projects/0538e53e859e48a391a7df406ce44cde/users/50ea3fc9f1e54add97a075253da46a5c/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:35.835573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138661a-d589-4cef-a185-e66407d16d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0538e53e859e48a391a7df406ce44cde, user_id=50ea3fc9f1e54add97a075253da46a5c, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:35.838178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138661a-d589-4cef-a185-e66407d16d89 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:35.848930 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1411/2813] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:15:35 2022] PUT /identity/v3/projects/0538e53e859e48a391a7df406ce44cde/users/50ea3fc9f1e54add97a075253da46a5c/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:35.860394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ae05a-fec9-469f-983c-d4d28cd12f0f None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:35.864164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ae05a-fec9-469f-983c-d4d28cd12f0f None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:35.864164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ae05a-fec9-469f-983c-d4d28cd12f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:35.889758 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-ad3ae05a-fec9-469f-983c-d4d28cd12f0f None None] MFA Rules not processed for user `50ea3fc9f1e54add97a075253da46a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:35.890983 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-ad3ae05a-fec9-469f-983c-d4d28cd12f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:35.965347 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1403/2814] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:35 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:15:35.977532 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138661a-d589-4cef-a185-e66407d16d89 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:35.979187 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-f138661a-d589-4cef-a185-e66407d16d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:36.021961 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:36.038629 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138661a-d589-4cef-a185-e66407d16d89 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:36.042507 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c9b29-b103-420d-91ca-b213f1cedd2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:36.043230 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c9b29-b103-420d-91ca-b213f1cedd2d service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:36.043587 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c9b29-b103-420d-91ca-b213f1cedd2d service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:36.043936 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c9b29-b103-420d-91ca-b213f1cedd2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:36.054162 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c9b29-b103-420d-91ca-b213f1cedd2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:36.055649 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c9b29-b103-420d-91ca-b213f1cedd2d service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:36.067007 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1412/2815] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:15:35 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:15:36.266984 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ae05a-fec9-469f-983c-d4d28cd12f0f None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:36.289203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ae05a-fec9-469f-983c-d4d28cd12f0f None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:36.289203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623e01e-a71a-4ccd-aabf-79b1001995f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:36.289203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623e01e-a71a-4ccd-aabf-79b1001995f2 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:36.289203 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623e01e-a71a-4ccd-aabf-79b1001995f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:36.289646 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623e01e-a71a-4ccd-aabf-79b1001995f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:36.338764 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623e01e-a71a-4ccd-aabf-79b1001995f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:36.340183 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623e01e-a71a-4ccd-aabf-79b1001995f2 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:36.349534 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1404/2816] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:15:36 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:15:39.766193 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c9b29-b103-420d-91ca-b213f1cedd2d service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:39.823812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c9b29-b103-420d-91ca-b213f1cedd2d service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:39.829522 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dbc8e-c35c-4ef6-91b1-a296ebaaa8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:39.830380 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dbc8e-c35c-4ef6-91b1-a296ebaaa8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:39.830666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dbc8e-c35c-4ef6-91b1-a296ebaaa8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:39.830942 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dbc8e-c35c-4ef6-91b1-a296ebaaa8ca admin admin] PATH_INFO: `/v3/users/9fb548b58d864c18b567a23cf11306e1` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:39.832133 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dbc8e-c35c-4ef6-91b1-a296ebaaa8ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fb548b58d864c18b567a23cf11306e1)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:39.834080 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dbc8e-c35c-4ef6-91b1-a296ebaaa8ca admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:39.988812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a03dbc8e-c35c-4ef6-91b1-a296ebaaa8ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fb548b58d864c18b567a23cf11306e1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:40.001643 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a03dbc8e-c35c-4ef6-91b1-a296ebaaa8ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fb548b58d864c18b567a23cf11306e1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:40.083618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a03dbc8e-c35c-4ef6-91b1-a296ebaaa8ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fb548b58d864c18b567a23cf11306e1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:40.084169 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a03dbc8e-c35c-4ef6-91b1-a296ebaaa8ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fb548b58d864c18b567a23cf11306e1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:40.091407 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-a03dbc8e-c35c-4ef6-91b1-a296ebaaa8ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fb548b58d864c18b567a23cf11306e1'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:40.097358 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1413/2817] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:15:39 2022] DELETE /identity/v3/users/9fb548b58d864c18b567a23cf11306e1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:40.101800 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60008d50-5973-4054-8ef4-8d2c2b5c7b52 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:40.102314 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60008d50-5973-4054-8ef4-8d2c2b5c7b52 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:40.102604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60008d50-5973-4054-8ef4-8d2c2b5c7b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:40.120183 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-60008d50-5973-4054-8ef4-8d2c2b5c7b52 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:40.121438 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-60008d50-5973-4054-8ef4-8d2c2b5c7b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:40.141536 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:40.179873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1405/2818] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:40.189976 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dbc8e-c35c-4ef6-91b1-a296ebaaa8ca admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:40.191452 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-a03dbc8e-c35c-4ef6-91b1-a296ebaaa8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:40.250399 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dbc8e-c35c-4ef6-91b1-a296ebaaa8ca admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:40.254078 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bed94-44ac-4df9-9a96-54457b57feee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:40.254717 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bed94-44ac-4df9-9a96-54457b57feee service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:40.255090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bed94-44ac-4df9-9a96-54457b57feee service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:40.255283 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bed94-44ac-4df9-9a96-54457b57feee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:40.265264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bed94-44ac-4df9-9a96-54457b57feee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:40.266889 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bed94-44ac-4df9-9a96-54457b57feee service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:40.276403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1414/2819] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:15:40.645981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60008d50-5973-4054-8ef4-8d2c2b5c7b52 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:40.647395 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-60008d50-5973-4054-8ef4-8d2c2b5c7b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:40.659837 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60008d50-5973-4054-8ef4-8d2c2b5c7b52 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:40.664606 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e227338-f5ce-4233-86ca-3d7de4170714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:40.665492 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e227338-f5ce-4233-86ca-3d7de4170714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:40.665773 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e227338-f5ce-4233-86ca-3d7de4170714 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:40.666050 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e227338-f5ce-4233-86ca-3d7de4170714 admin admin] PATH_INFO: `/v3/projects/263247ca9acb4cb08d182bf5f9186e29` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:40.667241 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e227338-f5ce-4233-86ca-3d7de4170714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=263247ca9acb4cb08d182bf5f9186e29)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:40.669172 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e227338-f5ce-4233-86ca-3d7de4170714 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:40.775663 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0e227338-f5ce-4233-86ca-3d7de4170714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '263247ca9acb4cb08d182bf5f9186e29', 'request_id': 'req-0e227338-f5ce-4233-86ca-3d7de4170714'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:40.837884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0e227338-f5ce-4233-86ca-3d7de4170714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '263247ca9acb4cb08d182bf5f9186e29', 'request_id': 'req-0e227338-f5ce-4233-86ca-3d7de4170714'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:40.844292 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0e227338-f5ce-4233-86ca-3d7de4170714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '263247ca9acb4cb08d182bf5f9186e29', 'request_id': 'req-0e227338-f5ce-4233-86ca-3d7de4170714'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:40.854657 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0e227338-f5ce-4233-86ca-3d7de4170714 admin admin] The token cache is being invalidate because project 263247ca9acb4cb08d182bf5f9186e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:15:40.854941 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0e227338-f5ce-4233-86ca-3d7de4170714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:40.855561 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-0e227338-f5ce-4233-86ca-3d7de4170714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:40.857138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1406/2820] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:15:40 2022] DELETE /identity/v3/projects/263247ca9acb4cb08d182bf5f9186e29 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:15:40.861218 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bed94-44ac-4df9-9a96-54457b57feee service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:40.866013 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:40.871210 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bed94-44ac-4df9-9a96-54457b57feee service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:40.927715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5a3fd-0e4d-4ead-b6f1-b1e9223b71e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:40.928579 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5a3fd-0e4d-4ead-b6f1-b1e9223b71e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:40.928950 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5a3fd-0e4d-4ead-b6f1-b1e9223b71e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:40.929221 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5a3fd-0e4d-4ead-b6f1-b1e9223b71e2 admin admin] PATH_INFO: `/v3/users/50ea3fc9f1e54add97a075253da46a5c` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:40.930395 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5a3fd-0e4d-4ead-b6f1-b1e9223b71e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ea3fc9f1e54add97a075253da46a5c)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:40.932286 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5a3fd-0e4d-4ead-b6f1-b1e9223b71e2 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:41.094695 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b2c5a3fd-0e4d-4ead-b6f1-b1e9223b71e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ea3fc9f1e54add97a075253da46a5c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:41.106446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b2c5a3fd-0e4d-4ead-b6f1-b1e9223b71e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ea3fc9f1e54add97a075253da46a5c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:41.189741 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b2c5a3fd-0e4d-4ead-b6f1-b1e9223b71e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ea3fc9f1e54add97a075253da46a5c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:41.190314 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b2c5a3fd-0e4d-4ead-b6f1-b1e9223b71e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ea3fc9f1e54add97a075253da46a5c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:41.197480 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-b2c5a3fd-0e4d-4ead-b6f1-b1e9223b71e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ea3fc9f1e54add97a075253da46a5c'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:41.203650 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1415/2821] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:15:40 2022] DELETE /identity/v3/users/50ea3fc9f1e54add97a075253da46a5c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:41.622510 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e227338-f5ce-4233-86ca-3d7de4170714 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:41.625138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-0e227338-f5ce-4233-86ca-3d7de4170714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:41.638368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e227338-f5ce-4233-86ca-3d7de4170714 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:41.696500 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e451cd-417f-4ef4-b4c6-9007cfd9ebb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:41.697377 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e451cd-417f-4ef4-b4c6-9007cfd9ebb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:41.697656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e451cd-417f-4ef4-b4c6-9007cfd9ebb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:41.697942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e451cd-417f-4ef4-b4c6-9007cfd9ebb6 admin admin] PATH_INFO: `/v3/projects/0538e53e859e48a391a7df406ce44cde` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:41.699097 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e451cd-417f-4ef4-b4c6-9007cfd9ebb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0538e53e859e48a391a7df406ce44cde)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:41.701055 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e451cd-417f-4ef4-b4c6-9007cfd9ebb6 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:41.827413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-92e451cd-417f-4ef4-b4c6-9007cfd9ebb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0538e53e859e48a391a7df406ce44cde', 'request_id': 'req-92e451cd-417f-4ef4-b4c6-9007cfd9ebb6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:41.829087 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:41.886823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-92e451cd-417f-4ef4-b4c6-9007cfd9ebb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0538e53e859e48a391a7df406ce44cde', 'request_id': 'req-92e451cd-417f-4ef4-b4c6-9007cfd9ebb6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:41.894061 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-92e451cd-417f-4ef4-b4c6-9007cfd9ebb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0538e53e859e48a391a7df406ce44cde', 'request_id': 'req-92e451cd-417f-4ef4-b4c6-9007cfd9ebb6'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:41.904303 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-92e451cd-417f-4ef4-b4c6-9007cfd9ebb6 admin admin] The token cache is being invalidate because project 0538e53e859e48a391a7df406ce44cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:15:41.904586 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-92e451cd-417f-4ef4-b4c6-9007cfd9ebb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:41.905957 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-92e451cd-417f-4ef4-b4c6-9007cfd9ebb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:41.907513 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1407/2822] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:15:41 2022] DELETE /identity/v3/projects/0538e53e859e48a391a7df406ce44cde => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:41.912434 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928a080-f188-4a6e-a203-f9ee004ef4f9 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:41.912934 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928a080-f188-4a6e-a203-f9ee004ef4f9 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:41.913071 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928a080-f188-4a6e-a203-f9ee004ef4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:41.931292 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-d928a080-f188-4a6e-a203-f9ee004ef4f9 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:41.932482 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d928a080-f188-4a6e-a203-f9ee004ef4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:41.991015 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1416/2823] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:41.998530 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7755b9d-e5b5-47d7-a59f-d63f257d4e9c None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:41.998876 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7755b9d-e5b5-47d7-a59f-d63f257d4e9c None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:41.999262 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7755b9d-e5b5-47d7-a59f-d63f257d4e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.017568 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-b7755b9d-e5b5-47d7-a59f-d63f257d4e9c None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:42.018765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-b7755b9d-e5b5-47d7-a59f-d63f257d4e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:42.026543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1408/2824] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:42.031417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928a080-f188-4a6e-a203-f9ee004ef4f9 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:42.041066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928a080-f188-4a6e-a203-f9ee004ef4f9 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:42.045706 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ca4af-a0fc-4915-9845-e30be672704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:42.046817 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ca4af-a0fc-4915-9845-e30be672704d admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:42.047105 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ca4af-a0fc-4915-9845-e30be672704d admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:42.047385 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ca4af-a0fc-4915-9845-e30be672704d admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.048111 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ca4af-a0fc-4915-9845-e30be672704d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:42.048419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ca4af-a0fc-4915-9845-e30be672704d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:42.050061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ca4af-a0fc-4915-9845-e30be672704d admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:42.061774 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1417/2825] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:42.065880 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7755b9d-e5b5-47d7-a59f-d63f257d4e9c None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:42.075004 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7755b9d-e5b5-47d7-a59f-d63f257d4e9c None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:42.080289 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67669469-a686-4933-9063-a1206551cdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:42.080964 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67669469-a686-4933-9063-a1206551cdcb admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:42.081249 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67669469-a686-4933-9063-a1206551cdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:42.081523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67669469-a686-4933-9063-a1206551cdcb admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.082237 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67669469-a686-4933-9063-a1206551cdcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:42.084117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67669469-a686-4933-9063-a1206551cdcb admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:42.171428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1409/2826] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:15:42 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:42.175635 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ca4af-a0fc-4915-9845-e30be672704d admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:42.185479 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ca4af-a0fc-4915-9845-e30be672704d admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:42.190573 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:42.240959 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23a3fa-0990-4d52-953b-21f8f6f46c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:42.241698 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23a3fa-0990-4d52-953b-21f8f6f46c8d admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:42.241924 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23a3fa-0990-4d52-953b-21f8f6f46c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:42.242197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23a3fa-0990-4d52-953b-21f8f6f46c8d admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.242883 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23a3fa-0990-4d52-953b-21f8f6f46c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:42.244800 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23a3fa-0990-4d52-953b-21f8f6f46c8d admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:42.321246 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1418/2827] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:15:42 2022] POST /identity/v3/users => generated 301 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:42.325483 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67669469-a686-4933-9063-a1206551cdcb admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:42.336918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67669469-a686-4933-9063-a1206551cdcb admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:42.341498 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e4b2d-d787-4fc5-b673-d86779035cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:42.342141 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e4b2d-d787-4fc5-b673-d86779035cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:42.342815 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e4b2d-d787-4fc5-b673-d86779035cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:42.343097 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e4b2d-d787-4fc5-b673-d86779035cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.343821 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e4b2d-d787-4fc5-b673-d86779035cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:42.345434 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e4b2d-d787-4fc5-b673-d86779035cd5 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:42.356836 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1410/2828] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:42.360811 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23a3fa-0990-4d52-953b-21f8f6f46c8d admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:42.370633 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23a3fa-0990-4d52-953b-21f8f6f46c8d admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:42.375888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af76321-70a0-4ab0-858a-a527f1e7a8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:42.376533 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af76321-70a0-4ab0-858a-a527f1e7a8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:42.376852 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af76321-70a0-4ab0-858a-a527f1e7a8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:42.377130 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af76321-70a0-4ab0-858a-a527f1e7a8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.377851 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af76321-70a0-4ab0-858a-a527f1e7a8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:42.379447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af76321-70a0-4ab0-858a-a527f1e7a8b9 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:42.390045 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1419/2829] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:42.394048 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e4b2d-d787-4fc5-b673-d86779035cd5 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:42.404135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e4b2d-d787-4fc5-b673-d86779035cd5 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:42.408823 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a07765-6158-43ab-8332-10e389976292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:42.409732 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a07765-6158-43ab-8332-10e389976292 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:42.410015 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a07765-6158-43ab-8332-10e389976292 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:42.410292 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a07765-6158-43ab-8332-10e389976292 admin admin] PATH_INFO: `/v3/projects/f402092453f4444f9e2d2e0bb2084424/users/fc8d47bc28a7498eba5a382f76704df2/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.424723 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a07765-6158-43ab-8332-10e389976292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f402092453f4444f9e2d2e0bb2084424, user_id=fc8d47bc28a7498eba5a382f76704df2, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:42.427340 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a07765-6158-43ab-8332-10e389976292 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:42.518764 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1411/2830] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:15:42 2022] PUT /identity/v3/projects/f402092453f4444f9e2d2e0bb2084424/users/fc8d47bc28a7498eba5a382f76704df2/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:42.530381 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50979474-729d-48ca-9f30-2e98db788e1f None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:42.530815 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50979474-729d-48ca-9f30-2e98db788e1f None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:42.531100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50979474-729d-48ca-9f30-2e98db788e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.557719 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-50979474-729d-48ca-9f30-2e98db788e1f None None] MFA Rules not processed for user `fc8d47bc28a7498eba5a382f76704df2`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:42.558912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-50979474-729d-48ca-9f30-2e98db788e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:42.621519 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1420/2831] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:42.626710 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a07765-6158-43ab-8332-10e389976292 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:42.687121 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a07765-6158-43ab-8332-10e389976292 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:42.692734 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3504c7-5b1d-441f-b01a-e71b98d975d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:42.693381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3504c7-5b1d-441f-b01a-e71b98d975d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:42.693663 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3504c7-5b1d-441f-b01a-e71b98d975d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:42.693936 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3504c7-5b1d-441f-b01a-e71b98d975d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.694612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3504c7-5b1d-441f-b01a-e71b98d975d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:42.696479 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3504c7-5b1d-441f-b01a-e71b98d975d1 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:42.768446 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1412/2832] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:15:42 2022] POST /identity/v3/projects => generated 401 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:42.772535 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50979474-729d-48ca-9f30-2e98db788e1f None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:42.783149 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50979474-729d-48ca-9f30-2e98db788e1f None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:42.838795 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c913c5-3643-4362-bb9c-9d923a8ecf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:42.839458 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c913c5-3643-4362-bb9c-9d923a8ecf39 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:42.839739 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c913c5-3643-4362-bb9c-9d923a8ecf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:42.840011 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c913c5-3643-4362-bb9c-9d923a8ecf39 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.840739 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c913c5-3643-4362-bb9c-9d923a8ecf39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:42.843256 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c913c5-3643-4362-bb9c-9d923a8ecf39 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:42.924006 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1421/2833] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:15:42 2022] POST /identity/v3/users => generated 307 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:42.927896 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3504c7-5b1d-441f-b01a-e71b98d975d1 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:42.938051 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3504c7-5b1d-441f-b01a-e71b98d975d1 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:42.942615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a636d-1240-43d1-b9de-9bf6fa304834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:42.943257 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a636d-1240-43d1-b9de-9bf6fa304834 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:42.943539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a636d-1240-43d1-b9de-9bf6fa304834 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:42.943813 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a636d-1240-43d1-b9de-9bf6fa304834 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.944562 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a636d-1240-43d1-b9de-9bf6fa304834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:42.946231 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a636d-1240-43d1-b9de-9bf6fa304834 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:42.956456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1413/2834] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:42.960423 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c913c5-3643-4362-bb9c-9d923a8ecf39 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:42.971023 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c913c5-3643-4362-bb9c-9d923a8ecf39 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:42.975631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264f702-dd8f-4a40-ada9-24b607cb01f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:42.976495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264f702-dd8f-4a40-ada9-24b607cb01f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:42.976812 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264f702-dd8f-4a40-ada9-24b607cb01f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:42.977087 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264f702-dd8f-4a40-ada9-24b607cb01f5 admin admin] PATH_INFO: `/v3/projects/9bdf7afb7e55486094727dcab545ffee/users/bde060fea67742f7b591138bae00453b/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:42.979245 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:42.992801 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264f702-dd8f-4a40-ada9-24b607cb01f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bdf7afb7e55486094727dcab545ffee, user_id=bde060fea67742f7b591138bae00453b, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:42.995463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264f702-dd8f-4a40-ada9-24b607cb01f5 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:43.071984 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1422/2835] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:15:42 2022] PUT /identity/v3/projects/9bdf7afb7e55486094727dcab545ffee/users/bde060fea67742f7b591138bae00453b/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:15:43.075885 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a636d-1240-43d1-b9de-9bf6fa304834 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:43.086074 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a636d-1240-43d1-b9de-9bf6fa304834 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:43.130555 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:43.142165 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f400c-4ed2-4cc5-85e0-0fdba3d63a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:43.142825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f400c-4ed2-4cc5-85e0-0fdba3d63a9e admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:43.143107 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f400c-4ed2-4cc5-85e0-0fdba3d63a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:43.143382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f400c-4ed2-4cc5-85e0-0fdba3d63a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:43.144106 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f400c-4ed2-4cc5-85e0-0fdba3d63a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:43.145749 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f400c-4ed2-4cc5-85e0-0fdba3d63a9e admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:43.156947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1414/2836] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:43.161077 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264f702-dd8f-4a40-ada9-24b607cb01f5 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:43.172220 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264f702-dd8f-4a40-ada9-24b607cb01f5 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:43.176848 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff54a20-0f60-4551-bc69-d604874f9172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:43.177715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff54a20-0f60-4551-bc69-d604874f9172 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:43.177996 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff54a20-0f60-4551-bc69-d604874f9172 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:43.178269 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff54a20-0f60-4551-bc69-d604874f9172 admin admin] PATH_INFO: `/v3/projects/9bdf7afb7e55486094727dcab545ffee/users/bde060fea67742f7b591138bae00453b/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:43.180235 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff54a20-0f60-4551-bc69-d604874f9172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bdf7afb7e55486094727dcab545ffee, user_id=bde060fea67742f7b591138bae00453b, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:43.182857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff54a20-0f60-4551-bc69-d604874f9172 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:43.193527 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1423/2837] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:15:43 2022] PUT /identity/v3/projects/9bdf7afb7e55486094727dcab545ffee/users/bde060fea67742f7b591138bae00453b/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:43.203576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc938d3e-8738-408b-9054-f6d7538a5f34 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:43.203865 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc938d3e-8738-408b-9054-f6d7538a5f34 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:43.204144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc938d3e-8738-408b-9054-f6d7538a5f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:43.229917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-cc938d3e-8738-408b-9054-f6d7538a5f34 None None] MFA Rules not processed for user `bde060fea67742f7b591138bae00453b`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:43.231113 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-cc938d3e-8738-408b-9054-f6d7538a5f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:43.297231 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1415/2838] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:43 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:43.307657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff54a20-0f60-4551-bc69-d604874f9172 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:43.309387 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4ff54a20-0f60-4551-bc69-d604874f9172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:43.367431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff54a20-0f60-4551-bc69-d604874f9172 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:43.371003 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a4ea9-4626-476a-b063-a6ca762b9541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:43.371638 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a4ea9-4626-476a-b063-a6ca762b9541 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:43.371923 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a4ea9-4626-476a-b063-a6ca762b9541 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:43.372200 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a4ea9-4626-476a-b063-a6ca762b9541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:43.381359 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a4ea9-4626-476a-b063-a6ca762b9541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:43.382777 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a4ea9-4626-476a-b063-a6ca762b9541 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:43.392588 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1424/2839] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:15:43 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:15:43.580576 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc938d3e-8738-408b-9054-f6d7538a5f34 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:43.590135 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc938d3e-8738-408b-9054-f6d7538a5f34 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:43.594387 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb83bf3-69c9-41fd-9b92-8c9eb67dbb56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:43.595007 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83bf3-69c9-41fd-9b92-8c9eb67dbb56 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:43.595285 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83bf3-69c9-41fd-9b92-8c9eb67dbb56 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:43.595556 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb83bf3-69c9-41fd-9b92-8c9eb67dbb56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:43.650345 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb83bf3-69c9-41fd-9b92-8c9eb67dbb56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:43.651751 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb83bf3-69c9-41fd-9b92-8c9eb67dbb56 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:43.660507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1416/2840] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:15:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:15:48.687611 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a4ea9-4626-476a-b063-a6ca762b9541 service cinder] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:48.750574 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a4ea9-4626-476a-b063-a6ca762b9541 service cinder] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:48.755578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0cfc5-ce6c-4937-8353-5d9da0e8978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:48.756479 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0cfc5-ce6c-4937-8353-5d9da0e8978e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:48.756790 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0cfc5-ce6c-4937-8353-5d9da0e8978e admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:48.757187 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0cfc5-ce6c-4937-8353-5d9da0e8978e admin admin] PATH_INFO: `/v3/users/fc8d47bc28a7498eba5a382f76704df2` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:48.758415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0cfc5-ce6c-4937-8353-5d9da0e8978e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8d47bc28a7498eba5a382f76704df2)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:48.760413 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0cfc5-ce6c-4937-8353-5d9da0e8978e admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:48.959967 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-76d0cfc5-ce6c-4937-8353-5d9da0e8978e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8d47bc28a7498eba5a382f76704df2'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:48.972236 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-76d0cfc5-ce6c-4937-8353-5d9da0e8978e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8d47bc28a7498eba5a382f76704df2'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:49.047213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-76d0cfc5-ce6c-4937-8353-5d9da0e8978e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8d47bc28a7498eba5a382f76704df2'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:49.047816 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-76d0cfc5-ce6c-4937-8353-5d9da0e8978e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8d47bc28a7498eba5a382f76704df2'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:49.049898 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:49.055088 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-76d0cfc5-ce6c-4937-8353-5d9da0e8978e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8d47bc28a7498eba5a382f76704df2'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:49.061416 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1425/2841] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:15:48 2022] DELETE /identity/v3/users/fc8d47bc28a7498eba5a382f76704df2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:49.065919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5db326-ad3e-45f9-a75e-f851535410b9 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:49.066398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5db326-ad3e-45f9-a75e-f851535410b9 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:49.066522 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5db326-ad3e-45f9-a75e-f851535410b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:49.083321 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-8c5db326-ad3e-45f9-a75e-f851535410b9 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:49.084545 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8c5db326-ad3e-45f9-a75e-f851535410b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:49.146360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1417/2842] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:49.156791 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0cfc5-ce6c-4937-8353-5d9da0e8978e admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:49.158187 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-76d0cfc5-ce6c-4937-8353-5d9da0e8978e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:49.215540 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0cfc5-ce6c-4937-8353-5d9da0e8978e admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:49.219847 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c84f8-87ed-4dc6-87ca-5f4444936fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:49.220511 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c84f8-87ed-4dc6-87ca-5f4444936fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:49.220827 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c84f8-87ed-4dc6-87ca-5f4444936fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:49.221100 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c84f8-87ed-4dc6-87ca-5f4444936fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:49.229784 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c84f8-87ed-4dc6-87ca-5f4444936fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:49.231188 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c84f8-87ed-4dc6-87ca-5f4444936fa7 service neutron] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:49.241213 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1426/2843] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:15:49.628674 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5db326-ad3e-45f9-a75e-f851535410b9 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:49.635180 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8c5db326-ad3e-45f9-a75e-f851535410b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:49.642981 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5db326-ad3e-45f9-a75e-f851535410b9 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:49.647496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e89fc-f819-4c81-8da6-651a06d9fc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:49.648343 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e89fc-f819-4c81-8da6-651a06d9fc19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:49.648625 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e89fc-f819-4c81-8da6-651a06d9fc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:49.648963 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e89fc-f819-4c81-8da6-651a06d9fc19 admin admin] PATH_INFO: `/v3/projects/f402092453f4444f9e2d2e0bb2084424` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:49.650134 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e89fc-f819-4c81-8da6-651a06d9fc19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f402092453f4444f9e2d2e0bb2084424)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:49.652019 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e89fc-f819-4c81-8da6-651a06d9fc19 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:49.654504 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=100 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:49.769450 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e34e89fc-f819-4c81-8da6-651a06d9fc19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f402092453f4444f9e2d2e0bb2084424', 'request_id': 'req-e34e89fc-f819-4c81-8da6-651a06d9fc19'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:49.849329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e34e89fc-f819-4c81-8da6-651a06d9fc19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f402092453f4444f9e2d2e0bb2084424', 'request_id': 'req-e34e89fc-f819-4c81-8da6-651a06d9fc19'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:49.855792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e34e89fc-f819-4c81-8da6-651a06d9fc19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f402092453f4444f9e2d2e0bb2084424', 'request_id': 'req-e34e89fc-f819-4c81-8da6-651a06d9fc19'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:49.866879 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e34e89fc-f819-4c81-8da6-651a06d9fc19 admin admin] The token cache is being invalidate because project f402092453f4444f9e2d2e0bb2084424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:15:49.867163 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e34e89fc-f819-4c81-8da6-651a06d9fc19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:49.867794 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-e34e89fc-f819-4c81-8da6-651a06d9fc19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:49.869360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1418/2844] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:15:49 2022] DELETE /identity/v3/projects/f402092453f4444f9e2d2e0bb2084424 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:49.873520 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c84f8-87ed-4dc6-87ca-5f4444936fa7 service neutron] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:49.883142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c84f8-87ed-4dc6-87ca-5f4444936fa7 service neutron] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:49.940558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29b94d-53f9-4f1b-9fc4-a430ead81ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:49.941487 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29b94d-53f9-4f1b-9fc4-a430ead81ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:49.941771 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29b94d-53f9-4f1b-9fc4-a430ead81ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:49.942049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29b94d-53f9-4f1b-9fc4-a430ead81ae5 admin admin] PATH_INFO: `/v3/users/bde060fea67742f7b591138bae00453b` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:49.943237 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29b94d-53f9-4f1b-9fc4-a430ead81ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde060fea67742f7b591138bae00453b)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:49.945197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29b94d-53f9-4f1b-9fc4-a430ead81ae5 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:50.111063 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ed29b94d-53f9-4f1b-9fc4-a430ead81ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde060fea67742f7b591138bae00453b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:50.122936 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ed29b94d-53f9-4f1b-9fc4-a430ead81ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde060fea67742f7b591138bae00453b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:50.203257 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ed29b94d-53f9-4f1b-9fc4-a430ead81ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde060fea67742f7b591138bae00453b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:50.203871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ed29b94d-53f9-4f1b-9fc4-a430ead81ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde060fea67742f7b591138bae00453b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:50.211029 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-ed29b94d-53f9-4f1b-9fc4-a430ead81ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde060fea67742f7b591138bae00453b'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:50.216990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1427/2845] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:15:49 2022] DELETE /identity/v3/users/bde060fea67742f7b591138bae00453b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:50.687361 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e89fc-f819-4c81-8da6-651a06d9fc19 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:50.688858 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-e34e89fc-f819-4c81-8da6-651a06d9fc19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:50.702267 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e89fc-f819-4c81-8da6-651a06d9fc19 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:50.759055 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb3e90-7133-44c9-81a8-53155b7bbbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:50.759918 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb3e90-7133-44c9-81a8-53155b7bbbec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:50.760199 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb3e90-7133-44c9-81a8-53155b7bbbec admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:50.760477 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb3e90-7133-44c9-81a8-53155b7bbbec admin admin] PATH_INFO: `/v3/projects/9bdf7afb7e55486094727dcab545ffee` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:50.761704 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb3e90-7133-44c9-81a8-53155b7bbbec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bdf7afb7e55486094727dcab545ffee)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:50.763611 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb3e90-7133-44c9-81a8-53155b7bbbec admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:50.868862 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-36fb3e90-7133-44c9-81a8-53155b7bbbec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bdf7afb7e55486094727dcab545ffee', 'request_id': 'req-36fb3e90-7133-44c9-81a8-53155b7bbbec'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:50.954990 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-36fb3e90-7133-44c9-81a8-53155b7bbbec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bdf7afb7e55486094727dcab545ffee', 'request_id': 'req-36fb3e90-7133-44c9-81a8-53155b7bbbec'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:50.961435 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-36fb3e90-7133-44c9-81a8-53155b7bbbec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bdf7afb7e55486094727dcab545ffee', 'request_id': 'req-36fb3e90-7133-44c9-81a8-53155b7bbbec'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:50.972054 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-36fb3e90-7133-44c9-81a8-53155b7bbbec admin admin] The token cache is being invalidate because project 9bdf7afb7e55486094727dcab545ffee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91927) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:15:50.976596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-36fb3e90-7133-44c9-81a8-53155b7bbbec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:50.976596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-36fb3e90-7133-44c9-81a8-53155b7bbbec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:50.976596 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1419/2846] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:15:50 2022] DELETE /identity/v3/projects/9bdf7afb7e55486094727dcab545ffee => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:50.979437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b561785-dac6-473b-961e-d2b04baa0478 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:50.979948 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b561785-dac6-473b-961e-d2b04baa0478 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:50.980061 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b561785-dac6-473b-961e-d2b04baa0478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:50.997752 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-1b561785-dac6-473b-961e-d2b04baa0478 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:50.999523 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-1b561785-dac6-473b-961e-d2b04baa0478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:51.007766 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:51.058549 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1428/2847] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:51.066855 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cd704-2931-4a1a-8a46-1b11224ff24b None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.067149 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cd704-2931-4a1a-8a46-1b11224ff24b None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.067433 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cd704-2931-4a1a-8a46-1b11224ff24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.087810 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-8a1cd704-2931-4a1a-8a46-1b11224ff24b None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:51.089065 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8a1cd704-2931-4a1a-8a46-1b11224ff24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:51.097612 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1420/2848] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:51.101932 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b561785-dac6-473b-961e-d2b04baa0478 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:51.111766 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b561785-dac6-473b-961e-d2b04baa0478 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:51.117141 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49bdee-9d13-4446-a86d-bd78cc3e70cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:51.117792 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49bdee-9d13-4446-a86d-bd78cc3e70cc admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.118078 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49bdee-9d13-4446-a86d-bd78cc3e70cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.118359 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49bdee-9d13-4446-a86d-bd78cc3e70cc admin admin] PATH_INFO: `/v3/domains` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.119089 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49bdee-9d13-4446-a86d-bd78cc3e70cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91926) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:51.119446 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49bdee-9d13-4446-a86d-bd78cc3e70cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:51.121023 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49bdee-9d13-4446-a86d-bd78cc3e70cc admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:51.133727 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1429/2849] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:51.138103 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cd704-2931-4a1a-8a46-1b11224ff24b None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:51.147947 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cd704-2931-4a1a-8a46-1b11224ff24b None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:51.152560 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a277e1a-d494-4ee5-82d2-92c8121f8792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:51.153246 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a277e1a-d494-4ee5-82d2-92c8121f8792 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.153530 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a277e1a-d494-4ee5-82d2-92c8121f8792 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.153807 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a277e1a-d494-4ee5-82d2-92c8121f8792 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.154541 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a277e1a-d494-4ee5-82d2-92c8121f8792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:51.156751 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a277e1a-d494-4ee5-82d2-92c8121f8792 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:51.169955 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:51.230634 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1421/2850] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:15:51 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:51.235191 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49bdee-9d13-4446-a86d-bd78cc3e70cc admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:51.244949 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49bdee-9d13-4446-a86d-bd78cc3e70cc admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:51.301485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d16bb-00f9-4cf6-a1b8-e951074ce8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:51.302142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d16bb-00f9-4cf6-a1b8-e951074ce8bb admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.302425 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d16bb-00f9-4cf6-a1b8-e951074ce8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.302697 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d16bb-00f9-4cf6-a1b8-e951074ce8bb admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.303409 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d16bb-00f9-4cf6-a1b8-e951074ce8bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:51.305325 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d16bb-00f9-4cf6-a1b8-e951074ce8bb admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:51.366642 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1430/2851] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:15:51 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:51.370778 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a277e1a-d494-4ee5-82d2-92c8121f8792 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:51.381711 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a277e1a-d494-4ee5-82d2-92c8121f8792 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:51.386247 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e602d77-0833-43d5-a3cb-6c4a95fd2ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:51.386910 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e602d77-0833-43d5-a3cb-6c4a95fd2ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.387171 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e602d77-0833-43d5-a3cb-6c4a95fd2ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.387444 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e602d77-0833-43d5-a3cb-6c4a95fd2ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.388168 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e602d77-0833-43d5-a3cb-6c4a95fd2ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:51.389825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e602d77-0833-43d5-a3cb-6c4a95fd2ed3 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:51.400365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1422/2852] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:51.409452 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d16bb-00f9-4cf6-a1b8-e951074ce8bb admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:51.419608 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d16bb-00f9-4cf6-a1b8-e951074ce8bb admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:51.425170 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3d8c6-3891-47a2-93a5-6b62cdbad398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:51.425819 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3d8c6-3891-47a2-93a5-6b62cdbad398 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.426102 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3d8c6-3891-47a2-93a5-6b62cdbad398 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.426372 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3d8c6-3891-47a2-93a5-6b62cdbad398 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.427090 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3d8c6-3891-47a2-93a5-6b62cdbad398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:51.428666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3d8c6-3891-47a2-93a5-6b62cdbad398 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:51.439010 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1431/2853] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:51.443430 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e602d77-0833-43d5-a3cb-6c4a95fd2ed3 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:51.453456 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e602d77-0833-43d5-a3cb-6c4a95fd2ed3 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:51.458053 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40299dc7-f05c-4d70-9ca2-a6785561a174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:51.458919 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40299dc7-f05c-4d70-9ca2-a6785561a174 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.459202 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40299dc7-f05c-4d70-9ca2-a6785561a174 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.459557 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40299dc7-f05c-4d70-9ca2-a6785561a174 admin admin] PATH_INFO: `/v3/projects/b08d3998ec0b4cc8b34709b73370a04d/users/ddf88be2258e4e539039034ee38984ff/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.473839 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40299dc7-f05c-4d70-9ca2-a6785561a174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b08d3998ec0b4cc8b34709b73370a04d, user_id=ddf88be2258e4e539039034ee38984ff, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:51.476550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40299dc7-f05c-4d70-9ca2-a6785561a174 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:51.553512 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1423/2854] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:15:51 2022] PUT /identity/v3/projects/b08d3998ec0b4cc8b34709b73370a04d/users/ddf88be2258e4e539039034ee38984ff/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:51.565048 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3410f5-e049-4286-a9c9-075e2e8fc6cf None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.565345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3410f5-e049-4286-a9c9-075e2e8fc6cf None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.565627 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3410f5-e049-4286-a9c9-075e2e8fc6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.592707 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-6d3410f5-e049-4286-a9c9-075e2e8fc6cf None None] MFA Rules not processed for user `ddf88be2258e4e539039034ee38984ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:51.593936 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-6d3410f5-e049-4286-a9c9-075e2e8fc6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:51.657490 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1432/2855] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:51.662136 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40299dc7-f05c-4d70-9ca2-a6785561a174 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:51.723940 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40299dc7-f05c-4d70-9ca2-a6785561a174 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:51.728619 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2fddc-aa10-4557-bfc0-f28d53930964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:51.729296 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2fddc-aa10-4557-bfc0-f28d53930964 admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.729579 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2fddc-aa10-4557-bfc0-f28d53930964 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.729852 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2fddc-aa10-4557-bfc0-f28d53930964 admin admin] PATH_INFO: `/v3/projects` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.730534 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2fddc-aa10-4557-bfc0-f28d53930964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:51.732413 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2fddc-aa10-4557-bfc0-f28d53930964 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:51.825210 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1424/2856] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:15:51 2022] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:51.829114 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3410f5-e049-4286-a9c9-075e2e8fc6cf None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:51.839776 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3410f5-e049-4286-a9c9-075e2e8fc6cf None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:51.844871 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:51.896168 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38e363-cbfd-4e4f-b245-3b34f8581d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:51.896857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38e363-cbfd-4e4f-b245-3b34f8581d50 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.897141 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38e363-cbfd-4e4f-b245-3b34f8581d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.897417 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38e363-cbfd-4e4f-b245-3b34f8581d50 admin admin] PATH_INFO: `/v3/users` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.898099 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38e363-cbfd-4e4f-b245-3b34f8581d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:51.900068 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38e363-cbfd-4e4f-b245-3b34f8581d50 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:51.969732 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1433/2857] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:15:51 2022] POST /identity/v3/users => generated 301 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:51.973481 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2fddc-aa10-4557-bfc0-f28d53930964 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:51.983854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2fddc-aa10-4557-bfc0-f28d53930964 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:51.988529 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80454cd3-36ed-468d-994e-65e0e7562914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:51.989204 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80454cd3-36ed-468d-994e-65e0e7562914 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:51.989489 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80454cd3-36ed-468d-994e-65e0e7562914 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:51.989768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80454cd3-36ed-468d-994e-65e0e7562914 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:51.990494 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80454cd3-36ed-468d-994e-65e0e7562914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:51.992068 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80454cd3-36ed-468d-994e-65e0e7562914 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:52.002517 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1425/2858] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:52.006508 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38e363-cbfd-4e4f-b245-3b34f8581d50 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:52.016967 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38e363-cbfd-4e4f-b245-3b34f8581d50 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:52.021517 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f862269-9268-46c4-a0fc-323cd2afe0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:52.022379 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f862269-9268-46c4-a0fc-323cd2afe0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:52.022658 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f862269-9268-46c4-a0fc-323cd2afe0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:52.022926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f862269-9268-46c4-a0fc-323cd2afe0bc admin admin] PATH_INFO: `/v3/projects/36d4560132454e99adf96ccec6588f13/users/ff86a143aad54833844988582bff904c/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:52.038809 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f862269-9268-46c4-a0fc-323cd2afe0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d4560132454e99adf96ccec6588f13, user_id=ff86a143aad54833844988582bff904c, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:52.041463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f862269-9268-46c4-a0fc-323cd2afe0bc admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:52.129668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1434/2859] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:15:52 2022] PUT /identity/v3/projects/36d4560132454e99adf96ccec6588f13/users/ff86a143aad54833844988582bff904c/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:52.133622 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80454cd3-36ed-468d-994e-65e0e7562914 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:52.144231 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80454cd3-36ed-468d-994e-65e0e7562914 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:52.199745 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99538d7f-4ad3-43ce-8d90-ca86e4851a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:52.200402 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99538d7f-4ad3-43ce-8d90-ca86e4851a87 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:52.200720 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99538d7f-4ad3-43ce-8d90-ca86e4851a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:52.201001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99538d7f-4ad3-43ce-8d90-ca86e4851a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:52.202383 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99538d7f-4ad3-43ce-8d90-ca86e4851a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:52.203959 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99538d7f-4ad3-43ce-8d90-ca86e4851a87 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:52.213538 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1426/2860] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:52.218432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f862269-9268-46c4-a0fc-323cd2afe0bc admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:52.228519 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f862269-9268-46c4-a0fc-323cd2afe0bc admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:52.233494 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f8d55-91f4-4033-a6a7-08d0102c9f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:52.234357 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f8d55-91f4-4033-a6a7-08d0102c9f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:52.234634 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f8d55-91f4-4033-a6a7-08d0102c9f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:52.234912 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f8d55-91f4-4033-a6a7-08d0102c9f86 admin admin] PATH_INFO: `/v3/projects/36d4560132454e99adf96ccec6588f13/users/ff86a143aad54833844988582bff904c/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:52.236888 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f8d55-91f4-4033-a6a7-08d0102c9f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d4560132454e99adf96ccec6588f13, user_id=ff86a143aad54833844988582bff904c, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:52.239488 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f8d55-91f4-4033-a6a7-08d0102c9f86 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:52.250139 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1435/2861] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:15:52 2022] PUT /identity/v3/projects/36d4560132454e99adf96ccec6588f13/users/ff86a143aad54833844988582bff904c/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:52.260246 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0215a8-9064-41f3-945b-c9ddea2b9662 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:52.260543 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0215a8-9064-41f3-945b-c9ddea2b9662 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:52.260854 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0215a8-9064-41f3-945b-c9ddea2b9662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:52.287190 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-df0215a8-9064-41f3-945b-c9ddea2b9662 None None] MFA Rules not processed for user `ff86a143aad54833844988582bff904c`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:52.288395 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-df0215a8-9064-41f3-945b-c9ddea2b9662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:52.304858 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:52.355409 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1427/2862] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:52.366085 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f8d55-91f4-4033-a6a7-08d0102c9f86 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:52.367738 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-299f8d55-91f4-4033-a6a7-08d0102c9f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:52.425142 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f8d55-91f4-4033-a6a7-08d0102c9f86 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:52.428763 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468fc0a-499d-4565-abce-7d5479a4fe28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:52.429400 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468fc0a-499d-4565-abce-7d5479a4fe28 service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:52.429685 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468fc0a-499d-4565-abce-7d5479a4fe28 service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:52.429961 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468fc0a-499d-4565-abce-7d5479a4fe28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:52.439473 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468fc0a-499d-4565-abce-7d5479a4fe28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:52.440945 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468fc0a-499d-4565-abce-7d5479a4fe28 service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:52.450267 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1436/2863] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:15:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:15:52.581287 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0215a8-9064-41f3-945b-c9ddea2b9662 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:52.640917 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0215a8-9064-41f3-945b-c9ddea2b9662 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:52.645308 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4091c4-ff22-4e33-88b6-5bac6a02a6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:52.646153 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4091c4-ff22-4e33-88b6-5bac6a02a6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:52.646431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4091c4-ff22-4e33-88b6-5bac6a02a6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:52.646705 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4091c4-ff22-4e33-88b6-5bac6a02a6d1 admin admin] PATH_INFO: `/v3/users/ddf88be2258e4e539039034ee38984ff` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:52.647861 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4091c4-ff22-4e33-88b6-5bac6a02a6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf88be2258e4e539039034ee38984ff)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:52.649821 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4091c4-ff22-4e33-88b6-5bac6a02a6d1 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:52.803664 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8a4091c4-ff22-4e33-88b6-5bac6a02a6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf88be2258e4e539039034ee38984ff'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:52.816873 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8a4091c4-ff22-4e33-88b6-5bac6a02a6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf88be2258e4e539039034ee38984ff'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:52.881118 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8a4091c4-ff22-4e33-88b6-5bac6a02a6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf88be2258e4e539039034ee38984ff'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:52.881741 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8a4091c4-ff22-4e33-88b6-5bac6a02a6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf88be2258e4e539039034ee38984ff'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:52.889084 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-8a4091c4-ff22-4e33-88b6-5bac6a02a6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf88be2258e4e539039034ee38984ff'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:52.895329 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1428/2864] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:15:52 2022] DELETE /identity/v3/users/ddf88be2258e4e539039034ee38984ff => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:52.900049 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c84f92-f3d7-4053-af52-bb9e51b654e9 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:52.900340 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c84f92-f3d7-4053-af52-bb9e51b654e9 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:52.900618 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c84f92-f3d7-4053-af52-bb9e51b654e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:52.918298 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-38c84f92-f3d7-4053-af52-bb9e51b654e9 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:52.919495 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-38c84f92-f3d7-4053-af52-bb9e51b654e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:52.977177 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1437/2865] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:52.987578 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4091c4-ff22-4e33-88b6-5bac6a02a6d1 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:52.989206 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8a4091c4-ff22-4e33-88b6-5bac6a02a6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:53.024884 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:53.047198 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4091c4-ff22-4e33-88b6-5bac6a02a6d1 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:53.050832 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63c5b4-7339-485e-a24b-eb68e9ba43ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:53.051468 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63c5b4-7339-485e-a24b-eb68e9ba43ff service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:53.051751 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63c5b4-7339-485e-a24b-eb68e9ba43ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:53.052030 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63c5b4-7339-485e-a24b-eb68e9ba43ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:53.061537 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63c5b4-7339-485e-a24b-eb68e9ba43ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:53.062942 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63c5b4-7339-485e-a24b-eb68e9ba43ff service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:53.072360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1429/2866] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:15:53.433232 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c84f92-f3d7-4053-af52-bb9e51b654e9 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:53.434715 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-38c84f92-f3d7-4053-af52-bb9e51b654e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:53.443740 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:53.448008 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c84f92-f3d7-4053-af52-bb9e51b654e9 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:53.453324 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00f523-146f-4ca7-aad8-3096fc6cdc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:53.454648 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00f523-146f-4ca7-aad8-3096fc6cdc60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:53.454937 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00f523-146f-4ca7-aad8-3096fc6cdc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:53.455447 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00f523-146f-4ca7-aad8-3096fc6cdc60 admin admin] PATH_INFO: `/v3/projects/b08d3998ec0b4cc8b34709b73370a04d` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:53.456668 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00f523-146f-4ca7-aad8-3096fc6cdc60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b08d3998ec0b4cc8b34709b73370a04d)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:53.460557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00f523-146f-4ca7-aad8-3096fc6cdc60 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:53.567168 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4c00f523-146f-4ca7-aad8-3096fc6cdc60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b08d3998ec0b4cc8b34709b73370a04d', 'request_id': 'req-4c00f523-146f-4ca7-aad8-3096fc6cdc60'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:53.573336 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4c00f523-146f-4ca7-aad8-3096fc6cdc60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b08d3998ec0b4cc8b34709b73370a04d', 'request_id': 'req-4c00f523-146f-4ca7-aad8-3096fc6cdc60'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:53.635445 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4c00f523-146f-4ca7-aad8-3096fc6cdc60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b08d3998ec0b4cc8b34709b73370a04d', 'request_id': 'req-4c00f523-146f-4ca7-aad8-3096fc6cdc60'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:53.646665 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4c00f523-146f-4ca7-aad8-3096fc6cdc60 admin admin] The token cache is being invalidate because project b08d3998ec0b4cc8b34709b73370a04d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:15:53.646952 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4c00f523-146f-4ca7-aad8-3096fc6cdc60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:53.647578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4c00f523-146f-4ca7-aad8-3096fc6cdc60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:53.649143 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1438/2867] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:15:53 2022] DELETE /identity/v3/projects/b08d3998ec0b4cc8b34709b73370a04d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:53.653086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63c5b4-7339-485e-a24b-eb68e9ba43ff service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:53.663331 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63c5b4-7339-485e-a24b-eb68e9ba43ff service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:53.719405 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c020f-3b52-49d7-b2eb-47385da0a7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:53.720182 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c020f-3b52-49d7-b2eb-47385da0a7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:53.720465 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c020f-3b52-49d7-b2eb-47385da0a7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:53.720771 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c020f-3b52-49d7-b2eb-47385da0a7bc admin admin] PATH_INFO: `/v3/users/ff86a143aad54833844988582bff904c` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:53.721934 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c020f-3b52-49d7-b2eb-47385da0a7bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff86a143aad54833844988582bff904c)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:53.723863 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c020f-3b52-49d7-b2eb-47385da0a7bc admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:53.907946 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4c0c020f-3b52-49d7-b2eb-47385da0a7bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff86a143aad54833844988582bff904c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:53.919445 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4c0c020f-3b52-49d7-b2eb-47385da0a7bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff86a143aad54833844988582bff904c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:53.980570 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4c0c020f-3b52-49d7-b2eb-47385da0a7bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff86a143aad54833844988582bff904c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:53.981159 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4c0c020f-3b52-49d7-b2eb-47385da0a7bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff86a143aad54833844988582bff904c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:53.988272 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4c0c020f-3b52-49d7-b2eb-47385da0a7bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff86a143aad54833844988582bff904c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:53.994117 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1430/2868] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:15:53 2022] DELETE /identity/v3/users/ff86a143aad54833844988582bff904c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:54.382578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00f523-146f-4ca7-aad8-3096fc6cdc60 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:54.384019 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4c00f523-146f-4ca7-aad8-3096fc6cdc60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:54.398115 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00f523-146f-4ca7-aad8-3096fc6cdc60 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:54.456132 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819bab9-a246-43c6-8add-ee854b57be37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:54.457053 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819bab9-a246-43c6-8add-ee854b57be37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:54.457334 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819bab9-a246-43c6-8add-ee854b57be37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:54.457606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819bab9-a246-43c6-8add-ee854b57be37 admin admin] PATH_INFO: `/v3/projects/36d4560132454e99adf96ccec6588f13` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:54.458768 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819bab9-a246-43c6-8add-ee854b57be37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d4560132454e99adf96ccec6588f13)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:54.460673 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819bab9-a246-43c6-8add-ee854b57be37 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:54.615315 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6819bab9-a246-43c6-8add-ee854b57be37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d4560132454e99adf96ccec6588f13', 'request_id': 'req-6819bab9-a246-43c6-8add-ee854b57be37'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:54.621437 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6819bab9-a246-43c6-8add-ee854b57be37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d4560132454e99adf96ccec6588f13', 'request_id': 'req-6819bab9-a246-43c6-8add-ee854b57be37'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:54.700734 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6819bab9-a246-43c6-8add-ee854b57be37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d4560132454e99adf96ccec6588f13', 'request_id': 'req-6819bab9-a246-43c6-8add-ee854b57be37'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:54.711351 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6819bab9-a246-43c6-8add-ee854b57be37 admin admin] The token cache is being invalidate because project 36d4560132454e99adf96ccec6588f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:15:54.711638 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6819bab9-a246-43c6-8add-ee854b57be37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:54.712264 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-6819bab9-a246-43c6-8add-ee854b57be37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:15:54.713857 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1439/2869] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:15:54 2022] DELETE /identity/v3/projects/36d4560132454e99adf96ccec6588f13 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:54.719394 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ff0d4-7b9f-4728-97b8-7b68dee480e8 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:54.719684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ff0d4-7b9f-4728-97b8-7b68dee480e8 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:54.719962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ff0d4-7b9f-4728-97b8-7b68dee480e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:54.738197 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-197ff0d4-7b9f-4728-97b8-7b68dee480e8 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:54.739382 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-197ff0d4-7b9f-4728-97b8-7b68dee480e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:54.787571 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:54.799494 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1431/2870] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:54.806954 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77892b12-3633-4279-a1cf-b6d142c65b33 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:54.807631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77892b12-3633-4279-a1cf-b6d142c65b33 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:54.807631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77892b12-3633-4279-a1cf-b6d142c65b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:54.825485 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-77892b12-3633-4279-a1cf-b6d142c65b33 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:54.826744 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-77892b12-3633-4279-a1cf-b6d142c65b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:54.834666 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1440/2871] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:54.838705 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ff0d4-7b9f-4728-97b8-7b68dee480e8 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:54.849368 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ff0d4-7b9f-4728-97b8-7b68dee480e8 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:54.853965 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff37a8-3f82-4593-8ee8-af75cdb9d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:54.854877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff37a8-3f82-4593-8ee8-af75cdb9d9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:54.855324 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff37a8-3f82-4593-8ee8-af75cdb9d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:54.855950 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff37a8-3f82-4593-8ee8-af75cdb9d9f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:54.856792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff37a8-3f82-4593-8ee8-af75cdb9d9f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:15:54.857099 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff37a8-3f82-4593-8ee8-af75cdb9d9f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:54.859414 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff37a8-3f82-4593-8ee8-af75cdb9d9f1 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:54.870841 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1432/2872] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:15:54.875047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77892b12-3633-4279-a1cf-b6d142c65b33 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:54.884896 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77892b12-3633-4279-a1cf-b6d142c65b33 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:54.890682 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670b1c9-fc3d-49c6-9313-57c63846e540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:54.891347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670b1c9-fc3d-49c6-9313-57c63846e540 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:54.891631 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670b1c9-fc3d-49c6-9313-57c63846e540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:54.891910 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670b1c9-fc3d-49c6-9313-57c63846e540 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:54.892702 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670b1c9-fc3d-49c6-9313-57c63846e540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:54.894779 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670b1c9-fc3d-49c6-9313-57c63846e540 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:54.903182 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:54.975798 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1441/2873] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:15:54 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:54.986332 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff37a8-3f82-4593-8ee8-af75cdb9d9f1 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:54.996428 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff37a8-3f82-4593-8ee8-af75cdb9d9f1 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:55.051575 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac52920-e9cb-43b0-ab5c-3a38f2c592cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:55.052226 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac52920-e9cb-43b0-ab5c-3a38f2c592cb admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:55.052507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac52920-e9cb-43b0-ab5c-3a38f2c592cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:55.052814 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac52920-e9cb-43b0-ab5c-3a38f2c592cb admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:55.053509 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac52920-e9cb-43b0-ab5c-3a38f2c592cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:55.055390 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac52920-e9cb-43b0-ab5c-3a38f2c592cb admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:55.133219 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1433/2874] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:15:54 2022] POST /identity/v3/users => generated 283 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:55.137178 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670b1c9-fc3d-49c6-9313-57c63846e540 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:55.147868 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670b1c9-fc3d-49c6-9313-57c63846e540 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:55.152575 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e49f12-2bb3-4062-b925-d199475c8be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:55.153272 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e49f12-2bb3-4062-b925-d199475c8be7 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:55.153558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e49f12-2bb3-4062-b925-d199475c8be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:55.153838 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e49f12-2bb3-4062-b925-d199475c8be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:55.155202 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e49f12-2bb3-4062-b925-d199475c8be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:55.157047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e49f12-2bb3-4062-b925-d199475c8be7 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:55.167032 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1442/2875] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:55.171207 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac52920-e9cb-43b0-ab5c-3a38f2c592cb admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:55.181179 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac52920-e9cb-43b0-ab5c-3a38f2c592cb admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:55.185663 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b1121-feee-4be1-80af-326678cd019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:55.186756 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1121-feee-4be1-80af-326678cd019b admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:55.187268 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1121-feee-4be1-80af-326678cd019b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:55.187699 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1121-feee-4be1-80af-326678cd019b admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:55.188431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b1121-feee-4be1-80af-326678cd019b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:55.190038 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b1121-feee-4be1-80af-326678cd019b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:55.199730 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1434/2876] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:55.204312 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e49f12-2bb3-4062-b925-d199475c8be7 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:55.214433 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e49f12-2bb3-4062-b925-d199475c8be7 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:55.219870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750ed03-825f-4eba-b4df-5751240e7991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:55.220803 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750ed03-825f-4eba-b4df-5751240e7991 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:55.221101 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750ed03-825f-4eba-b4df-5751240e7991 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:55.221352 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750ed03-825f-4eba-b4df-5751240e7991 admin admin] PATH_INFO: `/v3/projects/43ce8d04877e4048b0982e69c238a9c3/users/ed72f850cab0491e84eacc5b4a10aedf/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:55.235463 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750ed03-825f-4eba-b4df-5751240e7991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ce8d04877e4048b0982e69c238a9c3, user_id=ed72f850cab0491e84eacc5b4a10aedf, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:55.238122 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750ed03-825f-4eba-b4df-5751240e7991 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:55.306415 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1443/2877] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:15:55 2022] PUT /identity/v3/projects/43ce8d04877e4048b0982e69c238a9c3/users/ed72f850cab0491e84eacc5b4a10aedf/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:55.370756 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554038a1-1c81-4ab4-8653-9914c2853f5f None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:55.371047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554038a1-1c81-4ab4-8653-9914c2853f5f None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:55.371330 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554038a1-1c81-4ab4-8653-9914c2853f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:55.398461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-554038a1-1c81-4ab4-8653-9914c2853f5f None None] MFA Rules not processed for user `ed72f850cab0491e84eacc5b4a10aedf`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:55.399672 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-554038a1-1c81-4ab4-8653-9914c2853f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:55.463138 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1435/2878] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:15:55.467890 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750ed03-825f-4eba-b4df-5751240e7991 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:55.528797 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750ed03-825f-4eba-b4df-5751240e7991 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:55.533630 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5039ee9-3944-453a-9872-984e69d93a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:55.534294 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5039ee9-3944-453a-9872-984e69d93a84 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:55.534602 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5039ee9-3944-453a-9872-984e69d93a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:55.534862 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5039ee9-3944-453a-9872-984e69d93a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:55.535570 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5039ee9-3944-453a-9872-984e69d93a84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:55.537509 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5039ee9-3944-453a-9872-984e69d93a84 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:55.636475 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1444/2879] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:15:55 2022] POST /identity/v3/projects => generated 367 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:15:55.640997 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554038a1-1c81-4ab4-8653-9914c2853f5f None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:55.656377 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554038a1-1c81-4ab4-8653-9914c2853f5f None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:55.697169 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:55.706615 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4554624-ae17-4869-87ff-4b5453b55fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:55.707269 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554624-ae17-4869-87ff-4b5453b55fcd admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:55.707544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554624-ae17-4869-87ff-4b5453b55fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:55.707812 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554624-ae17-4869-87ff-4b5453b55fcd admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:55.708496 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4554624-ae17-4869-87ff-4b5453b55fcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:55.710412 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4554624-ae17-4869-87ff-4b5453b55fcd admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:55.789385 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1436/2880] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:15:55 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 15:15:55.793324 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5039ee9-3944-453a-9872-984e69d93a84 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:55.804903 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5039ee9-3944-453a-9872-984e69d93a84 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:55.809474 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f2060-1373-4227-8c37-8e7326736f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:55.810282 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f2060-1373-4227-8c37-8e7326736f3f admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:55.810566 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f2060-1373-4227-8c37-8e7326736f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:55.811503 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f2060-1373-4227-8c37-8e7326736f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:55.812253 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f2060-1373-4227-8c37-8e7326736f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:55.813858 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f2060-1373-4227-8c37-8e7326736f3f admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:55.824453 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1445/2881] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:55.828459 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4554624-ae17-4869-87ff-4b5453b55fcd admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:55.838443 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4554624-ae17-4869-87ff-4b5453b55fcd admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:55.843120 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c637ff3-0419-47ad-a7a3-08238dfc7de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:55.843982 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c637ff3-0419-47ad-a7a3-08238dfc7de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:55.844266 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c637ff3-0419-47ad-a7a3-08238dfc7de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:55.844550 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c637ff3-0419-47ad-a7a3-08238dfc7de0 admin admin] PATH_INFO: `/v3/projects/1884560979d14efbba35105d36491962/users/cd41c5c6b72a4d019711a5777e674d84/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:55.859603 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c637ff3-0419-47ad-a7a3-08238dfc7de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1884560979d14efbba35105d36491962, user_id=cd41c5c6b72a4d019711a5777e674d84, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:55.862279 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c637ff3-0419-47ad-a7a3-08238dfc7de0 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:55.949510 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1437/2882] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:15:55 2022] PUT /identity/v3/projects/1884560979d14efbba35105d36491962/users/cd41c5c6b72a4d019711a5777e674d84/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:55.953747 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f2060-1373-4227-8c37-8e7326736f3f admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:55.963780 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f2060-1373-4227-8c37-8e7326736f3f admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:56.020387 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efe1cc-743c-42ab-aaab-3f85c1984045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:56.021066 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efe1cc-743c-42ab-aaab-3f85c1984045 admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:56.021347 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efe1cc-743c-42ab-aaab-3f85c1984045 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:56.021623 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efe1cc-743c-42ab-aaab-3f85c1984045 admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:56.022335 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efe1cc-743c-42ab-aaab-3f85c1984045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:56.023907 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efe1cc-743c-42ab-aaab-3f85c1984045 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:56.033800 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1446/2883] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:15:56.037911 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c637ff3-0419-47ad-a7a3-08238dfc7de0 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:56.049366 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c637ff3-0419-47ad-a7a3-08238dfc7de0 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:56.053949 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ce904-cb49-41a3-b57e-2ce6b1e43fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:56.054793 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ce904-cb49-41a3-b57e-2ce6b1e43fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:56.055068 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ce904-cb49-41a3-b57e-2ce6b1e43fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:56.055337 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ce904-cb49-41a3-b57e-2ce6b1e43fd8 admin admin] PATH_INFO: `/v3/projects/1884560979d14efbba35105d36491962/users/cd41c5c6b72a4d019711a5777e674d84/roles/6036efe96c1948fb98d01c8703a0561a` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:56.057365 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ce904-cb49-41a3-b57e-2ce6b1e43fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1884560979d14efbba35105d36491962, user_id=cd41c5c6b72a4d019711a5777e674d84, role_id=6036efe96c1948fb98d01c8703a0561a)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:56.059967 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ce904-cb49-41a3-b57e-2ce6b1e43fd8 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:56.070164 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1438/2884] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:15:56 2022] PUT /identity/v3/projects/1884560979d14efbba35105d36491962/users/cd41c5c6b72a4d019711a5777e674d84/roles/6036efe96c1948fb98d01c8703a0561a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:15:56.080262 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef9d11-6cef-4a33-934a-3afc65ef50c6 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:56.080558 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef9d11-6cef-4a33-934a-3afc65ef50c6 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:56.080881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef9d11-6cef-4a33-934a-3afc65ef50c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:56.108431 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-82ef9d11-6cef-4a33-934a-3afc65ef50c6 None None] MFA Rules not processed for user `cd41c5c6b72a4d019711a5777e674d84`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:15:56.109300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-82ef9d11-6cef-4a33-934a-3afc65ef50c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:56.120873 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:15:56.175806 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1447/2885] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:15:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 15:15:56.187835 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ce904-cb49-41a3-b57e-2ce6b1e43fd8 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:56.189523 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-c78ce904-cb49-41a3-b57e-2ce6b1e43fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:15:56.245643 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ce904-cb49-41a3-b57e-2ce6b1e43fd8 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:56.249426 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31dae6a-98cd-4e54-899a-dfe432d86d62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:56.250055 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31dae6a-98cd-4e54-899a-dfe432d86d62 service cinder] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:56.250338 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31dae6a-98cd-4e54-899a-dfe432d86d62 service cinder] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:56.250616 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31dae6a-98cd-4e54-899a-dfe432d86d62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:56.259461 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31dae6a-98cd-4e54-899a-dfe432d86d62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:56.260901 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31dae6a-98cd-4e54-899a-dfe432d86d62 service cinder] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:56.270353 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1439/2886] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:15:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:15:56.495452 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef9d11-6cef-4a33-934a-3afc65ef50c6 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:15:56.507756 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef9d11-6cef-4a33-934a-3afc65ef50c6 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:15:56.511476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc966d-a790-40d2-8eb4-d37c2271dd5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015326e75ae14b778e4478627d07c17f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:15:56.513686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc966d-a790-40d2-8eb4-d37c2271dd5c service cinder] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:15:56.513686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc966d-a790-40d2-8eb4-d37c2271dd5c service cinder] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:15:56.513686 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc966d-a790-40d2-8eb4-d37c2271dd5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:15:56.584943 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc966d-a790-40d2-8eb4-d37c2271dd5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:15:56.586685 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc966d-a790-40d2-8eb4-d37c2271dd5c service cinder] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:15:56.596900 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1448/2887] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:15:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:16:03.073349 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31dae6a-98cd-4e54-899a-dfe432d86d62 service cinder] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:03.137477 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31dae6a-98cd-4e54-899a-dfe432d86d62 service cinder] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:03.142073 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544af31-06f8-4fc8-8612-618c6bb162fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:03.142929 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544af31-06f8-4fc8-8612-618c6bb162fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:03.143213 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544af31-06f8-4fc8-8612-618c6bb162fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:03.143488 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544af31-06f8-4fc8-8612-618c6bb162fd admin admin] PATH_INFO: `/v3/users/ed72f850cab0491e84eacc5b4a10aedf` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:03.144671 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544af31-06f8-4fc8-8612-618c6bb162fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed72f850cab0491e84eacc5b4a10aedf)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:03.146621 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544af31-06f8-4fc8-8612-618c6bb162fd admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:03.314092 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3544af31-06f8-4fc8-8612-618c6bb162fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed72f850cab0491e84eacc5b4a10aedf'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:03.315110 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:03.325905 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3544af31-06f8-4fc8-8612-618c6bb162fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed72f850cab0491e84eacc5b4a10aedf'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:03.383980 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3544af31-06f8-4fc8-8612-618c6bb162fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed72f850cab0491e84eacc5b4a10aedf'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:03.384597 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3544af31-06f8-4fc8-8612-618c6bb162fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed72f850cab0491e84eacc5b4a10aedf'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:03.391924 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-3544af31-06f8-4fc8-8612-618c6bb162fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed72f850cab0491e84eacc5b4a10aedf'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:03.397857 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1440/2888] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:16:03 2022] DELETE /identity/v3/users/ed72f850cab0491e84eacc5b4a10aedf => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:16:03.402375 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec7ba-8427-4b33-acce-e33cef195cf3 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:03.402881 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec7ba-8427-4b33-acce-e33cef195cf3 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:03.402990 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec7ba-8427-4b33-acce-e33cef195cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:03.421882 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-4efec7ba-8427-4b33-acce-e33cef195cf3 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:16:03.423086 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4efec7ba-8427-4b33-acce-e33cef195cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:16:03.481535 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1449/2889] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:16:03.492009 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544af31-06f8-4fc8-8612-618c6bb162fd admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:03.494862 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-3544af31-06f8-4fc8-8612-618c6bb162fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:16:03.550144 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544af31-06f8-4fc8-8612-618c6bb162fd admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:03.553872 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f32b95-04d9-400e-8797-5776cfea80b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:03.554507 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f32b95-04d9-400e-8797-5776cfea80b7 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:03.554788 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f32b95-04d9-400e-8797-5776cfea80b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:03.555064 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f32b95-04d9-400e-8797-5776cfea80b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:03.564375 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f32b95-04d9-400e-8797-5776cfea80b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:03.565776 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f32b95-04d9-400e-8797-5776cfea80b7 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:03.578320 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1441/2890] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:16:03.967606 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efec7ba-8427-4b33-acce-e33cef195cf3 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:03.969471 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-4efec7ba-8427-4b33-acce-e33cef195cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:16:03.983764 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efec7ba-8427-4b33-acce-e33cef195cf3 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:03.988793 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ffb75-6ec1-4817-9073-e96820c45d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:03.989273 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ffb75-6ec1-4817-9073-e96820c45d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:03.989554 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ffb75-6ec1-4817-9073-e96820c45d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:03.989824 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ffb75-6ec1-4817-9073-e96820c45d43 admin admin] PATH_INFO: `/v3/projects/43ce8d04877e4048b0982e69c238a9c3` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:03.991002 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ffb75-6ec1-4817-9073-e96820c45d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ce8d04877e4048b0982e69c238a9c3)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:03.992926 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ffb75-6ec1-4817-9073-e96820c45d43 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:04.106469 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:04.110476 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-805ffb75-6ec1-4817-9073-e96820c45d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ce8d04877e4048b0982e69c238a9c3', 'request_id': 'req-805ffb75-6ec1-4817-9073-e96820c45d43'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:04.116685 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-805ffb75-6ec1-4817-9073-e96820c45d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ce8d04877e4048b0982e69c238a9c3', 'request_id': 'req-805ffb75-6ec1-4817-9073-e96820c45d43'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:04.200470 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-805ffb75-6ec1-4817-9073-e96820c45d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ce8d04877e4048b0982e69c238a9c3', 'request_id': 'req-805ffb75-6ec1-4817-9073-e96820c45d43'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:04.211766 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-805ffb75-6ec1-4817-9073-e96820c45d43 admin admin] The token cache is being invalidate because project 43ce8d04877e4048b0982e69c238a9c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:16:04.212065 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-805ffb75-6ec1-4817-9073-e96820c45d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:04.212700 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-805ffb75-6ec1-4817-9073-e96820c45d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:04.214285 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1450/2891] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:16:03 2022] DELETE /identity/v3/projects/43ce8d04877e4048b0982e69c238a9c3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:16:04.218656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f32b95-04d9-400e-8797-5776cfea80b7 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:04.228363 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f32b95-04d9-400e-8797-5776cfea80b7 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:04.285047 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347dee7-1f72-44b1-8259-b0229637c58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:04.285909 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347dee7-1f72-44b1-8259-b0229637c58c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:04.286222 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347dee7-1f72-44b1-8259-b0229637c58c admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:04.286470 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347dee7-1f72-44b1-8259-b0229637c58c admin admin] PATH_INFO: `/v3/users/cd41c5c6b72a4d019711a5777e674d84` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:04.287651 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347dee7-1f72-44b1-8259-b0229637c58c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd41c5c6b72a4d019711a5777e674d84)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:04.289601 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347dee7-1f72-44b1-8259-b0229637c58c admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:04.456628 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4347dee7-1f72-44b1-8259-b0229637c58c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd41c5c6b72a4d019711a5777e674d84'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:04.468701 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4347dee7-1f72-44b1-8259-b0229637c58c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd41c5c6b72a4d019711a5777e674d84'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:04.472309 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:04.580620 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4347dee7-1f72-44b1-8259-b0229637c58c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd41c5c6b72a4d019711a5777e674d84'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:04.581250 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4347dee7-1f72-44b1-8259-b0229637c58c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd41c5c6b72a4d019711a5777e674d84'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:04.588360 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-4347dee7-1f72-44b1-8259-b0229637c58c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd41c5c6b72a4d019711a5777e674d84'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:04.594178 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1442/2892] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:16:04 2022] DELETE /identity/v3/users/cd41c5c6b72a4d019711a5777e674d84 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:16:05.045070 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ffb75-6ec1-4817-9073-e96820c45d43 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:05.047604 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-805ffb75-6ec1-4817-9073-e96820c45d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:16:05.061117 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ffb75-6ec1-4817-9073-e96820c45d43 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:05.120162 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a615e54-1016-465d-bef6-ff8168226e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:05.121069 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a615e54-1016-465d-bef6-ff8168226e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:05.121357 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a615e54-1016-465d-bef6-ff8168226e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:05.121637 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a615e54-1016-465d-bef6-ff8168226e3a admin admin] PATH_INFO: `/v3/projects/1884560979d14efbba35105d36491962` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:05.122860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a615e54-1016-465d-bef6-ff8168226e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1884560979d14efbba35105d36491962)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:05.124989 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a615e54-1016-465d-bef6-ff8168226e3a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:05.248703 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a615e54-1016-465d-bef6-ff8168226e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1884560979d14efbba35105d36491962', 'request_id': 'req-4a615e54-1016-465d-bef6-ff8168226e3a'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:05.254740 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a615e54-1016-465d-bef6-ff8168226e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1884560979d14efbba35105d36491962', 'request_id': 'req-4a615e54-1016-465d-bef6-ff8168226e3a'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:05.317630 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a615e54-1016-465d-bef6-ff8168226e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1884560979d14efbba35105d36491962', 'request_id': 'req-4a615e54-1016-465d-bef6-ff8168226e3a'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:05.328514 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a615e54-1016-465d-bef6-ff8168226e3a admin admin] The token cache is being invalidate because project 1884560979d14efbba35105d36491962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:16:05.328829 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a615e54-1016-465d-bef6-ff8168226e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:05.329451 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-4a615e54-1016-465d-bef6-ff8168226e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:05.330973 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1451/2893] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:16:05 2022] DELETE /identity/v3/projects/1884560979d14efbba35105d36491962 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:16:05.335839 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c562823-e7c3-458f-8215-f8e4e3285f8d None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:05.336341 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c562823-e7c3-458f-8215-f8e4e3285f8d None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:05.336575 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c562823-e7c3-458f-8215-f8e4e3285f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:05.354191 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-2c562823-e7c3-458f-8215-f8e4e3285f8d None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:16:05.355371 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-2c562823-e7c3-458f-8215-f8e4e3285f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:16:05.416877 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1443/2894] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:16:05.427483 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce9e3f-a406-4fe4-81a0-38c792585594 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:05.427767 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce9e3f-a406-4fe4-81a0-38c792585594 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:05.428050 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce9e3f-a406-4fe4-81a0-38c792585594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:05.448870 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-77ce9e3f-a406-4fe4-81a0-38c792585594 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:16:05.450079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-77ce9e3f-a406-4fe4-81a0-38c792585594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:16:05.460421 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1452/2895] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:16:05.464870 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c562823-e7c3-458f-8215-f8e4e3285f8d None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:05.476809 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c562823-e7c3-458f-8215-f8e4e3285f8d None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:05.482768 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d1372-c8e5-460a-96c7-0837530c5d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:05.484068 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d1372-c8e5-460a-96c7-0837530c5d2b admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:05.484376 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d1372-c8e5-460a-96c7-0837530c5d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:05.485001 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d1372-c8e5-460a-96c7-0837530c5d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:05.485777 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d1372-c8e5-460a-96c7-0837530c5d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91927) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 15:16:05.486091 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d1372-c8e5-460a-96c7-0837530c5d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:05.487963 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d1372-c8e5-460a-96c7-0837530c5d2b admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:05.503252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1444/2896] 10.222.0.44 () {58 vars in 1152 bytes} [Mon Jun 27 15:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 15:16:05.507629 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce9e3f-a406-4fe4-81a0-38c792585594 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:05.517762 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce9e3f-a406-4fe4-81a0-38c792585594 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:05.522578 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c256d7b-2a3d-442f-be38-1e0fd7066db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:05.523259 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c256d7b-2a3d-442f-be38-1e0fd7066db3 admin admin] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:05.523540 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c256d7b-2a3d-442f-be38-1e0fd7066db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:05.523823 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c256d7b-2a3d-442f-be38-1e0fd7066db3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:05.524511 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c256d7b-2a3d-442f-be38-1e0fd7066db3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:05.526432 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c256d7b-2a3d-442f-be38-1e0fd7066db3 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:05.653886 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1453/2897] 10.222.0.44 () {60 vars in 1152 bytes} [Mon Jun 27 15:16:05 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:16:05.658086 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d1372-c8e5-460a-96c7-0837530c5d2b admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:05.668230 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d1372-c8e5-460a-96c7-0837530c5d2b admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:05.722765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225f89f-30c9-422a-97d0-e43eb2683f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:05.723419 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225f89f-30c9-422a-97d0-e43eb2683f0e admin admin] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:05.723698 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225f89f-30c9-422a-97d0-e43eb2683f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:05.723972 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225f89f-30c9-422a-97d0-e43eb2683f0e admin admin] PATH_INFO: `/v3/users` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:05.724648 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225f89f-30c9-422a-97d0-e43eb2683f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:05.726539 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225f89f-30c9-422a-97d0-e43eb2683f0e admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:05.794958 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1445/2898] 10.222.0.44 () {60 vars in 1143 bytes} [Mon Jun 27 15:16:05 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 15:16:05.799690 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c256d7b-2a3d-442f-be38-1e0fd7066db3 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:05.809986 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c256d7b-2a3d-442f-be38-1e0fd7066db3 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:05.815370 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d03076-9e53-49b8-a931-6f8b9d78184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:05.816017 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d03076-9e53-49b8-a931-6f8b9d78184a admin admin] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:05.816300 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d03076-9e53-49b8-a931-6f8b9d78184a admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:05.816575 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d03076-9e53-49b8-a931-6f8b9d78184a admin admin] PATH_INFO: `/v3/roles` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:05.817342 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d03076-9e53-49b8-a931-6f8b9d78184a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:05.818908 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d03076-9e53-49b8-a931-6f8b9d78184a admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:05.829339 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1454/2899] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:16:05.833416 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225f89f-30c9-422a-97d0-e43eb2683f0e admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:05.843398 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225f89f-30c9-422a-97d0-e43eb2683f0e admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:05.848033 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f18b08-4f69-41b4-9e7a-1d98ad9bb636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:05.848714 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18b08-4f69-41b4-9e7a-1d98ad9bb636 admin admin] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:05.848998 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18b08-4f69-41b4-9e7a-1d98ad9bb636 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:05.849294 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18b08-4f69-41b4-9e7a-1d98ad9bb636 admin admin] PATH_INFO: `/v3/roles` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:05.850016 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f18b08-4f69-41b4-9e7a-1d98ad9bb636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:05.851604 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f18b08-4f69-41b4-9e7a-1d98ad9bb636 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:05.861939 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1446/2900] 10.222.0.44 () {58 vars in 1121 bytes} [Mon Jun 27 15:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 15:16:05.865959 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d03076-9e53-49b8-a931-6f8b9d78184a admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:05.876345 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d03076-9e53-49b8-a931-6f8b9d78184a admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:05.880902 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815753c-fc0c-4755-bbe4-0321c78048e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:05.881759 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815753c-fc0c-4755-bbe4-0321c78048e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:05.882036 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815753c-fc0c-4755-bbe4-0321c78048e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:05.882313 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815753c-fc0c-4755-bbe4-0321c78048e0 admin admin] PATH_INFO: `/v3/projects/5b7c5911c6f34f9681a90ca5d62f696f/users/1ea9625956ff498793167b8a23798f8c/roles/4568d65f55c74c2bbc8265f34e62bbc4` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:05.896340 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815753c-fc0c-4755-bbe4-0321c78048e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7c5911c6f34f9681a90ca5d62f696f, user_id=1ea9625956ff498793167b8a23798f8c, role_id=4568d65f55c74c2bbc8265f34e62bbc4)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:05.898979 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815753c-fc0c-4755-bbe4-0321c78048e0 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:05.958197 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:05.963547 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1455/2901] 10.222.0.44 () {60 vars in 1482 bytes} [Mon Jun 27 15:16:05 2022] PUT /identity/v3/projects/5b7c5911c6f34f9681a90ca5d62f696f/users/1ea9625956ff498793167b8a23798f8c/roles/4568d65f55c74c2bbc8265f34e62bbc4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 15:16:05.973892 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880ce6b-8fc6-447e-a30b-3288f9d39226 None None] REQUEST_METHOD: `POST` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:05.974196 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880ce6b-8fc6-447e-a30b-3288f9d39226 None None] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:05.974452 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880ce6b-8fc6-447e-a30b-3288f9d39226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:06.000825 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.auth.core [None req-8880ce6b-8fc6-447e-a30b-3288f9d39226 None None] MFA Rules not processed for user `1ea9625956ff498793167b8a23798f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91927) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:16:06.002036 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-8880ce6b-8fc6-447e-a30b-3288f9d39226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:16:06.042554 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:06.065570 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1447/2902] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:16:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:16:06.076966 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815753c-fc0c-4755-bbe4-0321c78048e0 admin admin] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:06.078742 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-d815753c-fc0c-4755-bbe4-0321c78048e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:16:06.278657 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815753c-fc0c-4755-bbe4-0321c78048e0 admin admin] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:06.282831 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea22bf4-7fcc-4633-95a8-88920227fbb7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e93d0321eaa4936a55390155d5aab0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:06.283460 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea22bf4-7fcc-4633-95a8-88920227fbb7 service glance] REQUEST_METHOD: `GET` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:06.283736 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea22bf4-7fcc-4633-95a8-88920227fbb7 service glance] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:06.284008 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea22bf4-7fcc-4633-95a8-88920227fbb7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:06.292079 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea22bf4-7fcc-4633-95a8-88920227fbb7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:06.293497 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea22bf4-7fcc-4633-95a8-88920227fbb7 service glance] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:06.302967 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1456/2903] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:16:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 15:16:16.137948 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=8 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:16.299047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=36 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:41.753738 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880ce6b-8fc6-447e-a30b-3288f9d39226 None None] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:41.814277 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880ce6b-8fc6-447e-a30b-3288f9d39226 None None] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:41.818839 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5d797-7278-41a3-877b-2fba225ce159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:41.819684 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5d797-7278-41a3-877b-2fba225ce159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:41.819962 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5d797-7278-41a3-877b-2fba225ce159 admin admin] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:41.820234 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5d797-7278-41a3-877b-2fba225ce159 admin admin] PATH_INFO: `/v3/users/1ea9625956ff498793167b8a23798f8c` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:41.821446 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5d797-7278-41a3-877b-2fba225ce159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea9625956ff498793167b8a23798f8c)` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:41.823336 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5d797-7278-41a3-877b-2fba225ce159 admin admin] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:42.004236 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9fb5d797-7278-41a3-877b-2fba225ce159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea9625956ff498793167b8a23798f8c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:42.015766 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9fb5d797-7278-41a3-877b-2fba225ce159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea9625956ff498793167b8a23798f8c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:42.094053 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9fb5d797-7278-41a3-877b-2fba225ce159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea9625956ff498793167b8a23798f8c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:42.094656 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9fb5d797-7278-41a3-877b-2fba225ce159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea9625956ff498793167b8a23798f8c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:42.102093 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.notifications [None req-9fb5d797-7278-41a3-877b-2fba225ce159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea9625956ff498793167b8a23798f8c'} {{(pid=91927) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:42.109381 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1448/2904] 10.222.0.44 () {58 vars in 1223 bytes} [Mon Jun 27 15:16:41 2022] DELETE /identity/v3/users/1ea9625956ff498793167b8a23798f8c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:16:42.112677 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f37ac9-c4c8-4ab1-af7a-a3618212acb4 None None] REQUEST_METHOD: `POST` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:42.113343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f37ac9-c4c8-4ab1-af7a-a3618212acb4 None None] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:42.113343 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f37ac9-c4c8-4ab1-af7a-a3618212acb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:42.130624 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.auth.core [None req-11f37ac9-c4c8-4ab1-af7a-a3618212acb4 None None] MFA Rules not processed for user `34ee4c4ab8ea4807905f919862ea9620`. Rule list: `[]` (Enabled: `True`). {{(pid=91926) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 15:16:42.131802 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-11f37ac9-c4c8-4ab1-af7a-a3618212acb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:16:42.188055 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1457/2905] 10.222.0.44 () {58 vars in 957 bytes} [Mon Jun 27 15:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 15:16:42.198102 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5d797-7278-41a3-877b-2fba225ce159 admin admin] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:42.199517 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-9fb5d797-7278-41a3-877b-2fba225ce159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:16:42.255821 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5d797-7278-41a3-877b-2fba225ce159 admin admin] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:42.259337 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd43b7-4dde-48ed-b652-af3b352e1cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf31d7d8c164809bde0e12b71ecfca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:42.259973 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd43b7-4dde-48ed-b652-af3b352e1cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:42.260252 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd43b7-4dde-48ed-b652-af3b352e1cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:42.260525 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd43b7-4dde-48ed-b652-af3b352e1cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:42.270030 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd43b7-4dde-48ed-b652-af3b352e1cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:42.271431 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd43b7-4dde-48ed-b652-af3b352e1cf2 service neutron] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:42.280765 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1449/2906] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:16:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:16:42.704419 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f37ac9-c4c8-4ab1-af7a-a3618212acb4 None None] Authenticating user token {{(pid=91926) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:16:42.705845 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.fernet_utils [None req-11f37ac9-c4c8-4ab1-af7a-a3618212acb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91926) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:16:42.717860 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f37ac9-c4c8-4ab1-af7a-a3618212acb4 None None] Validating token access rules against request {{(pid=91926) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:16:42.722844 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad7342-be4f-41d8-96e0-0445f7983f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34ee4c4ab8ea4807905f919862ea9620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782bd5d4029d44cc9364a47cef782a05', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91926) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:16:42.723694 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad7342-be4f-41d8-96e0-0445f7983f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:16:42.723972 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad7342-be4f-41d8-96e0-0445f7983f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:16:42.724369 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad7342-be4f-41d8-96e0-0445f7983f03 admin admin] PATH_INFO: `/v3/projects/5b7c5911c6f34f9681a90ca5d62f696f` {{(pid=91926) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:16:42.725585 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad7342-be4f-41d8-96e0-0445f7983f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7c5911c6f34f9681a90ca5d62f696f)` {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:16:42.727464 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad7342-be4f-41d8-96e0-0445f7983f03 admin admin] RBAC: Authorization granted {{(pid=91926) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:16:42.866805 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f5ad7342-be4f-41d8-96e0-0445f7983f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7c5911c6f34f9681a90ca5d62f696f', 'request_id': 'req-f5ad7342-be4f-41d8-96e0-0445f7983f03'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:42.872999 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f5ad7342-be4f-41d8-96e0-0445f7983f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7c5911c6f34f9681a90ca5d62f696f', 'request_id': 'req-f5ad7342-be4f-41d8-96e0-0445f7983f03'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:42.945492 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f5ad7342-be4f-41d8-96e0-0445f7983f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7c5911c6f34f9681a90ca5d62f696f', 'request_id': 'req-f5ad7342-be4f-41d8-96e0-0445f7983f03'} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:42.956052 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f5ad7342-be4f-41d8-96e0-0445f7983f03 admin admin] The token cache is being invalidate because project 5b7c5911c6f34f9681a90ca5d62f696f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91926) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 15:16:42.956403 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f5ad7342-be4f-41d8-96e0-0445f7983f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:42.957027 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG keystone.notifications [None req-f5ad7342-be4f-41d8-96e0-0445f7983f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91926) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 15:16:42.958557 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: [pid: 91926|app: 0|req: 1458/2907] 10.222.0.44 () {58 vars in 1232 bytes} [Mon Jun 27 15:16:42 2022] DELETE /identity/v3/projects/5b7c5911c6f34f9681a90ca5d62f696f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 15:16:52.276544 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:16:52.953047 dv-cinder-797608-35-iscsi devstack@keystone.service[91926]: DEBUG dbcounter [-] [91926] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91926) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:20:06.910313 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd43b7-4dde-48ed-b652-af3b352e1cf2 service neutron] Authenticating user token {{(pid=91927) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 15:20:06.911689 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-dafd43b7-4dde-48ed-b652-af3b352e1cf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:20:07.051035 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd43b7-4dde-48ed-b652-af3b352e1cf2 service neutron] Validating token access rules against request {{(pid=91927) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 15:20:07.110393 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08c1da-ad8f-4dfe-8cf5-1d36ed1a5adb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3ced893407a484e8ed0c4918438edf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af4d24603fa24a62946a57fabb774756', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91927) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 15:20:07.111096 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08c1da-ad8f-4dfe-8cf5-1d36ed1a5adb service placement] REQUEST_METHOD: `GET` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 15:20:07.111384 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08c1da-ad8f-4dfe-8cf5-1d36ed1a5adb service placement] SCRIPT_NAME: `/identity` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 15:20:07.111662 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08c1da-ad8f-4dfe-8cf5-1d36ed1a5adb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91927) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 15:20:07.113489 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.fernet_utils [None req-1e08c1da-ad8f-4dfe-8cf5-1d36ed1a5adb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91927) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 15:20:07.125589 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08c1da-ad8f-4dfe-8cf5-1d36ed1a5adb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 15:20:07.127185 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08c1da-ad8f-4dfe-8cf5-1d36ed1a5adb service placement] RBAC: Authorization granted {{(pid=91927) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 15:20:07.137715 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: [pid: 91927|app: 0|req: 1450/2908] 10.222.0.44 () {60 vars in 1365 bytes} [Mon Jun 27 15:20:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 15:20:17.132792 dv-cinder-797608-35-iscsi devstack@keystone.service[91927]: DEBUG dbcounter [-] [91927] Writing DB stats keystone:SELECT=89 {{(pid=91927) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}